2026-03-29 20:05:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 20:05:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 20:05:04 [motorway.uk] INFO: Batch mode enabled: batch 2/4
2026-03-29 20:05:04 [motorway.uk] INFO: Starting spider motorway.uk
2026-03-29 20:05:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 20:05:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 20:05:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 20:05:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 20:05:04 [scrapy.extensions.telnet] INFO: Telnet Password: e35286789ae9b24e
2026-03-29 20:05:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-29 20:05:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/motorway.uk/task_3_2026-03-29T20_05_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-29 20:05:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 20:05:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 20:05:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 20:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 20:05:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 20:05:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-29 20:05:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 20:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 20:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 20:05:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 20:05:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 20:05:05 [scrapy.core.engine] INFO: Spider opened
2026-03-29 20:05:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 20:05:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-29 20:05:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-29 20:05:05 [scrapy-playwright] INFO: Starting download handler
2026-03-29 20:05:05 [scrapy-playwright] INFO: Starting download handler
2026-03-29 20:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://pro.motorway.co.uk/api/login> (referer: None) ['zyte-api']
2026-03-29 20:05:14 [motorway.uk] INFO: Scrapy-formatted cookies: [{'name': 'access-token', 'value': 'eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ2ZXJzaW9uIjoyLCJpZCI6ODQyOSwibmFtZSI6IlNhbmogS3Jpc2huYXNhbXkiLCJlbWFpbCI6ImluZm9Ac2tkaXJlY3QuY28udWsiLCJmZWF0dXJlcyI6eyJzZWxsZXJCYW5rU3RhdGVtZW50Ijp0cnVlLCJTRUxMRVJfUkVFTlRSWSI6dHJ1ZSwiRE9DVU1FTlRTX1BST0dSRVNTSVZFX1VQTE9BRCI6dHJ1ZSwiZG9jdW1lbnRDYXB0dXJlVjIiOmZhbHNlLCJwYXltZW50c01WUCI6ZmFsc2UsInBheW1lbnRzSGlkZVNlbGxlckJhbmtEZXRhaWxzIjpmYWxzZSwicGF5bWVudHNLWUMiOmZhbHNlLCJwYXltZW50c012cFRyYW5zYWN0aW9uU3RhdGVtZW50Ijp0cnVlLCJwYXltZW50c0ZlZUNvbGxlY3Rpb24iOmZhbHNlfSwiaGFzSW52b2ljZUFjY2VzcyI6dHJ1ZSwicGhvbmUiOiIwNzc4NzU3ODIxMSIsIm90cFBob25lIjpudWxsLCJwaG9uZUNvbmZpcm1lZEF0IjpudWxsLCJkZWFsZXJOYW1lIjoiUyBLIERpcmVjdCIsImRlYWxlcklzVHJhZGUiOmZhbHNlLCJwcmltYXJ5Q29udGFjdCI6dHJ1ZSwiZGVhbGVySWQiOjgyMjMsImRlYWxlclN0YXR1cyI6eyJzbHVnIjoiaW5hY3RpdmUiLCJiaWRkaW5nRW5hYmxlZCI6dHJ1ZX0sImxhdGl0dWRlIjo1MS42MDE4MTkxLCJsb25naXR1ZGUiOi0wLjY3NzYxNTgsInBvc3Rjb2RlIjoiSFAxMDBOTiIsInBhcnRuZXJzIjpbXSwiaWRlbnRpdHkiOiJleUpoYkdjaU9pSklVekkxTmlJc0luUjVjQ0k2SWtwWFZDSjkuZXlKcFpHVnVkR2wwYVdWeklqcGJleUpwWkNJNk9EUXlPU3dpWlcxaGFXd2lPaUpwYm1adlFITnJaR2x5WldOMExtTnZMblZySWl3aWRIbHdaU0k2SW1SbFlXeGxjaUlzSW1WNGNHbHlaWE1pT2lJeU1ESTJMVEEwTFRJNFZESXdPakExT2pFeUxqQTJNbG9pTENKd1lYSjBibVZ5Y3lJNlcxMTlYU3dpYVdGMElqb3hOemMwT0RFME56RXlmUS5jZHY2eksxbVZCVVM5Mlo0ODJlQl9QYkM2R3VCbDBPTC10bXAzZjhsNGFRIiwiZGVhbGVyUGVybWlzc2lvbnMiOlsiaW52b2ljaW5nIiwia3ljIl0sInJlZnJlc2hUb2tlbiI6ImM2ZGU3ZmI1M2ZjNjdkMmM2MzdiMTU3YzM1YjBhYmViNTA1MTdiZjFjYjg5ODRjNDk5ZjZhZDEwZTVjMWQwY2MiLCJkZWFsZXJUaWVyIjoic2VsZi1zZXJ2ZSIsImlzc3VlZEF0IjoxNzc0ODE0NzEzODQzLCJpYXQiOjE3NzQ4MTQ3MTMsImV4cCI6MTc3NDgxNTAxM30.bsw2wssCMC_UGNZEQfdU1kcFpPMeiuQDkDnXvchOtVk', 'domain': '.motorway.co.uk', 'path': '/'}]
2026-03-29 20:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk> (referer: https://pro.motorway.co.uk/api/login) ['zyte-api']
2026-03-29 20:05:17 [motorway.uk] INFO: Extracted Build ID: gL_OFaxoLv6tVLfo6F2-N
2026-03-29 20:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=0&page=0&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=buyItNow&loadedCount=0&page=0&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20210884
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 18349632
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20491343
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491343%27 HTTP/1.1" 200 None
2026-03-29 20:05:18 [motorway.uk] INFO: Scrape type for 20491343: 1
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 19335779
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20478384
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20420964
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720420964%27 HTTP/1.1" 200 None
2026-03-29 20:05:18 [motorway.uk] INFO: Scrape type for 20420964: 2
2026-03-29 20:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 19293050
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 11469561
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 16791811
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 16345921
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20501784
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720501784%27 HTTP/1.1" 200 None
2026-03-29 20:05:18 [motorway.uk] INFO: Scrape type for 20501784: 1
2026-03-29 20:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20434421
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20406874
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20486638
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 15631500
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 19204416
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20462868
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20403112
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20380533
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20438346
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 18341236
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 19960036
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 19356442
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20217457
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20183041
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 17833819
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 6235966
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276235966%27 HTTP/1.1" 200 None
2026-03-29 20:05:18 [motorway.uk] INFO: Scrape type for 6235966: 1
2026-03-29 20:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 8799286
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 12116877
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20485059
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 14687227
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20371220
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720371220%27 HTTP/1.1" 200 None
2026-03-29 20:05:18 [motorway.uk] INFO: Scrape type for 20371220: 1
2026-03-29 20:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20221411
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20482651
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 20414596
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720414596%27 HTTP/1.1" 200 None
2026-03-29 20:05:18 [motorway.uk] INFO: Scrape type for 20414596: 1
2026-03-29 20:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:18 [motorway.uk] INFO: Found listing with ID: 13957348
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713957348%27 HTTP/1.1" 200 None
2026-03-29 20:05:18 [motorway.uk] INFO: Scrape type for 13957348: 1
2026-03-29 20:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13957348.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad28839c-24ee-5b99-ae7a-1e9671edfb36 with identifier: 13957348
2026-03-29 20:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad28839c-24ee-5b99-ae7a-1e9671edfb36 with scrape type 1
2026-03-29 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad28839c-24ee-5b99-ae7a-1e9671edfb36
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7348%252F13957348%252Fexterior_front_driver-1774700499104.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_front_driver-1774700499104.jpg not downloaded yet
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7348%252F13957348%252Fexterior_rear_driver-1774700539940.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_rear_driver-1774700539940.jpg not downloaded yet
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7348%252F13957348%252Fexterior_front_passenger-1774700663192.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_front_passenger-1774700663192.jpg not downloaded yet
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7348%252F13957348%252Fexterior_rear_passenger-1774700567657.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_rear_passenger-1774700567657.jpg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7348%252F13957348%252Finterior_front_seats-1774701285294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7348/13957348/interior_front_seats-1774701285294.jpg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7348%252F13957348%252Finterior_rear_seats-1774701494343.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7348/13957348/interior_rear_seats-1774701494343.jpg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7348%252F13957348%252Finterior_dashboard-1774701530093.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7348/13957348/interior_dashboard-1774701530093.jpg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7348%252F13957348%252Finstrument_cluster-1774703122867.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7348/13957348/instrument_cluster-1774703122867.jpg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7348%252F13957348%252Finterior_boot-1774701540495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7348/13957348/interior_boot-1774701540495.jpg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7348%252F13957348%252Fdocs_service_history-1774702623197.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D274afa5753a978745c4005e638c18ab5%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7348/13957348/docs_service_history-1774702623197.jpg?ixlib=js-3.8.0&auto=format&s=274afa5753a978745c4005e638c18ab5 not downloaded yet
2026-03-29 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20414596.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20491343.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7053600-a680-5172-93ee-f2cd9876c3b1 with identifier: 20414596
2026-03-29 20:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7053600-a680-5172-93ee-f2cd9876c3b1 with scrape type 1
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7053600-a680-5172-93ee-f2cd9876c3b1
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4596%252F20414596%252Fexterior_front_driver-1774723789580.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4596/20414596/exterior_front_driver-1774723789580.jpeg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4596%252F20414596%252F20414596-exterior_rear_driver-modified-1774794413904.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4596/20414596/20414596-exterior_rear_driver-modified-1774794413904.jpeg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4596%252F20414596%252F20414596-exterior_front_passenger-modified-1774794475511.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4596/20414596/20414596-exterior_front_passenger-modified-1774794475511.jpeg not downloaded yet
2026-03-29 20:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b71c4cae-77f6-5a0c-9ecb-ed37349c574b with identifier: 20491343
2026-03-29 20:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b with scrape type 1
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1343%252F20491343%252Fexterior_front_driver-1774714272929.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_front_driver-1774714272929.jpg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4596%252F20414596%252F20414596-exterior_rear_passenger-modified-1774794490598.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4596/20414596/20414596-exterior_rear_passenger-modified-1774794490598.jpeg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1343%252F20491343%252Fexterior_rear_driver-1774714290658.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_rear_driver-1774714290658.jpg not downloaded yet
2026-03-29 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/6235966.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4596%252F20414596%252Finterior_front_seats-1774723856553.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4596/20414596/interior_front_seats-1774723856553.jpeg not downloaded yet
2026-03-29 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20420964.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1343%252F20491343%252Fexterior_front_passenger-1774714316994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_front_passenger-1774714316994.jpg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4596%252F20414596%252Finterior_rear_seats-1774723903079.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4596/20414596/interior_rear_seats-1774723903079.jpeg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1343%252F20491343%252Fexterior_rear_passenger-1774714299201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_rear_passenger-1774714299201.jpg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4596%252F20414596%252F20414596-interior_dashboard-modified-1774794517185.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4596/20414596/20414596-interior_dashboard-modified-1774794517185.jpeg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1343%252F20491343%252Finterior_front_seats-1774714842921.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1343/20491343/interior_front_seats-1774714842921.jpg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4596%252F20414596%252F20414596-instrument_cluster-modified-1774794466817.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4596/20414596/20414596-instrument_cluster-modified-1774794466817.jpeg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1343%252F20491343%252Finterior_rear_seats-1774714774015.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1343/20491343/interior_rear_seats-1774714774015.jpg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4596%252F20414596%252F20414596-interior_boot-modified-1774794531245.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4596/20414596/20414596-interior_boot-modified-1774794531245.jpeg not downloaded yet
2026-03-29 20:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c08f048-93f5-54c7-993c-3c2c03bb91d2 with identifier: 6235966
2026-03-29 20:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2 with scrape type 1
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5966%252F6235966%252Fexterior_front_driver-1774695027231.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_front_driver-1774695027231.jpg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1343%252F20491343%252Finterior_dashboard-1774714790741.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1343/20491343/interior_dashboard-1774714790741.jpg not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4596%252F20414596%252Fdocs_service_history-1774742710830.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1dd0c3927d7bef231d147f67f91db03b%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4596/20414596/docs_service_history-1774742710830.jpeg?ixlib=js-3.8.0&auto=format&s=1dd0c3927d7bef231d147f67f91db03b not downloaded yet
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5966%252F6235966%252Fexterior_rear_driver-1774695058455.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_rear_driver-1774695058455.jpg not downloaded yet
2026-03-29 20:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b57f9d5f-21b3-52bd-90eb-fac028d03e96 with identifier: 20420964
2026-03-29 20:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b57f9d5f-21b3-52bd-90eb-fac028d03e96 with scrape type 2
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b57f9d5f-21b3-52bd-90eb-fac028d03e96 with scrape type 2
2026-03-29 20:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b57f9d5f-21b3-52bd-90eb-fac028d03e96, identifier: 20420964
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1343%252F20491343%252Finstrument_cluster-1774714974170.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1343/20491343/instrument_cluster-1774714974170.jpg not downloaded yet
2026-03-29 20:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b57f9d5f-21b3-52bd-90eb-fac028d03e96 with identifier: 20420964
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey HTTP/1.1" 200 None
2026-03-29 20:05:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2026-03-29 20:05:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b57f9d5f-21b3-52bd-90eb-fac028d03e96 with identifier: 20420964
2026-03-29 20:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b57f9d5f-21b3-52bd-90eb-fac028d03e96 with identifier: 20420964 to the API
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20420964.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '4.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'b57f9d5f-21b3-52bd-90eb-fac028d03e96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA68 YHW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20420964',
'listing': 'auction',
'location': 'Greater London West Drayton',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 68000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 28719,
'price_includes_vat': False,
'registration_date': '2018-10-29',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover A-BIO SDV8',
'transmission': 'automatic',
'trim': 'A-BIO SDV8',
'vin': 'SALGA2AJ1KA531521',
'year': 2018}
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720420964%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [motorway.uk] INFO: Saving data for 20420964: {'auction_closing_time': 1774884600.0, 'created_time': 1774382741.165313, 'last_price_update_time': 1774814722.599351}
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20420964') HTTP/1.1" 204 0
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5966%252F6235966%252Fexterior_front_passenger-1774695104618.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_front_passenger-1774695104618.jpg not downloaded yet
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1343%252F20491343%252Finterior_boot-1774714802923.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1343/20491343/interior_boot-1774714802923.jpg not downloaded yet
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5966%252F6235966%252Fexterior_rear_passenger-1774695070625.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_rear_passenger-1774695070625.jpg not downloaded yet
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1343%252F20491343%252Fdocs_service_history-1774715726918-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5bb5f4a4d6cec98e105ce606de15ec22%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1343/20491343/docs_service_history-1774715726918-1.jpeg?ixlib=js-3.8.0&auto=format&s=5bb5f4a4d6cec98e105ce606de15ec22 not downloaded yet
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5966%252F6235966%252Finterior_front_seats-1774695533228.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5966/6235966/interior_front_seats-1774695533228.jpg not downloaded yet
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item ad28839c-24ee-5b99-ae7a-1e9671edfb36 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item ad28839c-24ee-5b99-ae7a-1e9671edfb36 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item ad28839c-24ee-5b99-ae7a-1e9671edfb36 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5966%252F6235966%252Finterior_rear_seats-1774695558051.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5966/6235966/interior_rear_seats-1774695558051.jpg not downloaded yet
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5966%252F6235966%252Finterior_dashboard-1774695653718.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5966/6235966/interior_dashboard-1774695653718.jpg not downloaded yet
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5966%252F6235966%252Finstrument_cluster-1774695621726.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5966/6235966/instrument_cluster-1774695621726.jpg not downloaded yet
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5966%252F6235966%252Finterior_boot-1774695605813.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5966/6235966/interior_boot-1774695605813.jpg not downloaded yet
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_rear_driver-1774700539940.jpg> (referer: None)
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5966%252F6235966%252Fdocs_service_history-1774695936881.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3280880f3ca1eed06626bd913fef15f3%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5966/6235966/docs_service_history-1774695936881.jpg?ixlib=js-3.8.0&auto=format&s=3280880f3ca1eed06626bd913fef15f3 not downloaded yet
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4596/20414596/exterior_front_driver-1774723789580.jpeg> (referer: None)
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_front_driver-1774700499104.jpg> (referer: None)
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_front_passenger-1774700663192.jpg> (referer: None)
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_rear_passenger-1774700567657.jpg> (referer: None)
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7348/13957348/interior_front_seats-1774701285294.jpg> (referer: None)
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7348/13957348/interior_rear_seats-1774701494343.jpg> (referer: None)
2026-03-29 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7348/13957348/interior_dashboard-1774701530093.jpg> (referer: None)
2026-03-29 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20371220.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f359d6550>
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2106
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7348%252F13957348%252Fexterior_rear_driver-1774700539940.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_rear_driver-1774700539940.jpg saved to cache
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad28839c-24ee-5b99-ae7a-1e9671edfb36
2026-03-29 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4596/20414596/20414596-exterior_rear_passenger-modified-1774794490598.jpeg> (referer: None)
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dafb6d0>
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4596%252F20414596%252Fexterior_front_driver-1774723789580.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4596/20414596/exterior_front_driver-1774723789580.jpeg saved to cache
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7053600-a680-5172-93ee-f2cd9876c3b1
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dda4850>
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7348%252F13957348%252Fexterior_front_driver-1774700499104.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_front_driver-1774700499104.jpg saved to cache
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad28839c-24ee-5b99-ae7a-1e9671edfb36
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddbf350>
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7348%252F13957348%252Fexterior_front_passenger-1774700663192.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_front_passenger-1774700663192.jpg saved to cache
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad28839c-24ee-5b99-ae7a-1e9671edfb36
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddb3e50>
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7348%252F13957348%252Fexterior_rear_passenger-1774700567657.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_rear_passenger-1774700567657.jpg saved to cache
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad28839c-24ee-5b99-ae7a-1e9671edfb36
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e104190>
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7348%252F13957348%252Finterior_front_seats-1774701285294.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7348/13957348/interior_front_seats-1774701285294.jpg saved to cache
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad28839c-24ee-5b99-ae7a-1e9671edfb36
2026-03-29 20:05:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dda6d50>
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7348%252F13957348%252Finterior_rear_seats-1774701494343.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7348/13957348/interior_rear_seats-1774701494343.jpg saved to cache
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad28839c-24ee-5b99-ae7a-1e9671edfb36
2026-03-29 20:05:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd4b850>
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7348%252F13957348%252Finterior_dashboard-1774701530093.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7348/13957348/interior_dashboard-1774701530093.jpg saved to cache
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad28839c-24ee-5b99-ae7a-1e9671edfb36
2026-03-29 20:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad28839c-24ee-5b99-ae7a-1e9671edfb36, skipping ID generation
2026-03-29 20:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad28839c-24ee-5b99-ae7a-1e9671edfb36 with scrape type 1
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad28839c-24ee-5b99-ae7a-1e9671edfb36 sending to next pipeline
2026-03-29 20:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ad28839c-24ee-5b99-ae7a-1e9671edfb36, identifier: 13957348
2026-03-29 20:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8667c1c8-ff0e-5a66-8146-1f7555beb5d2 with identifier: 20371220
2026-03-29 20:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2 with scrape type 1
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1220%252F20371220%252Fexterior_front_driver-1774622021771.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_front_driver-1774622021771.jpg not downloaded yet
2026-03-29 20:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ad28839c-24ee-5b99-ae7a-1e9671edfb36 with identifier: 13957348
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Hybrid HTTP/1.1" 200 None
2026-03-29 20:05:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ad28839c-24ee-5b99-ae7a-1e9671edfb36 with identifier: 13957348
2026-03-29 20:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ad28839c-24ee-5b99-ae7a-1e9671edfb36 with identifier: 13957348 to the API
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7348/13957348/interior_dashboard-1774701530093.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'ad28839c-24ee-5b99-ae7a-1e9671edfb36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HT73 RKK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13957348',
'listing': 'auction',
'location': 'Hampshire Havant',
'make': 'Volvo',
'model': 'XC90',
'odometer': 21370,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1784348,
'Height': 2516,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_front_driver-1774700499104.jpg',
'Width': 3354},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1495597,
'Height': 2320,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_rear_driver-1774700539940.jpg',
'Width': 3093},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2461979,
'Height': 2699,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_front_passenger-1774700663192.jpg',
'Width': 3598},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2470417,
'Height': 2727,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7348/13957348/exterior_rear_passenger-1774700567657.jpg',
'Width': 3636},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2604575,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7348/13957348/interior_front_seats-1774701285294.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2596523,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7348/13957348/interior_rear_seats-1774701494343.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad28839c-24ee-5b99-ae7a-1e9671edfb36/ad28839c-24ee-5b99-ae7a-1e9671edfb36_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3036220,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7348/13957348/interior_dashboard-1774701530093.jpg',
'Width': 4032}],
'price': 44849,
'price_includes_vat': False,
'registration_date': '2024-01-26',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC90 Ultimate T8 Rechrge AWD A',
'transmission': 'automatic',
'trim': 'Ultimate T8 Rechrge AWD A',
'vin': 'YV1LFH7V1R1219031',
'year': 2024}
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713957348%27 HTTP/1.1" 200 None
2026-03-29 20:05:24 [motorway.uk] INFO: Saving data for 13957348: {'created_time': 1774814724.993101, 'last_price_update_time': 1774814724.993114, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13957348') HTTP/1.1" 204 0
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1220%252F20371220%252Fexterior_rear_driver-1774622045121.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_rear_driver-1774622045121.jpg not downloaded yet
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1220%252F20371220%252Fexterior_front_passenger-1774614698130.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_front_passenger-1774614698130.jpg not downloaded yet
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd88150>
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4596%252F20414596%252F20414596-exterior_rear_passenger-modified-1774794490598.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4596/20414596/20414596-exterior_rear_passenger-modified-1774794490598.jpeg saved to cache
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7053600-a680-5172-93ee-f2cd9876c3b1
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1220%252F20371220%252Fexterior_rear_passenger-1774614793879.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_rear_passenger-1774614793879.jpg not downloaded yet
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1220%252F20371220%252Finterior_front_seats-1774615357216.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1220/20371220/interior_front_seats-1774615357216.jpg not downloaded yet
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1220%252F20371220%252Finterior_rear_seats-1774615380292.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1220/20371220/interior_rear_seats-1774615380292.jpg not downloaded yet
2026-03-29 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_rear_driver-1774714290658.jpg> (referer: None)
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1220%252F20371220%252Finterior_dashboard-1774615411580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1220/20371220/interior_dashboard-1774615411580.jpg not downloaded yet
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1220%252F20371220%252Finstrument_cluster-1774626910569.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1220/20371220/instrument_cluster-1774626910569.jpg not downloaded yet
2026-03-29 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1343/20491343/instrument_cluster-1774714974170.jpg> (referer: None)
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1220%252F20371220%252Finterior_boot-1774615434495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1220/20371220/interior_boot-1774615434495.jpg not downloaded yet
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1220%252F20371220%252Fdocs_service_history-1774620128448.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D729e42eb5674a245f41f4a8ef2697102%27 HTTP/1.1" 200 None
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1220/20371220/docs_service_history-1774620128448.jpg?ixlib=js-3.8.0&auto=format&s=729e42eb5674a245f41f4a8ef2697102 not downloaded yet
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d535890>
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1343%252F20491343%252Fexterior_rear_driver-1774714290658.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_rear_driver-1774714290658.jpg saved to cache
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f664e50>
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1343%252F20491343%252Finstrument_cluster-1774714974170.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1343/20491343/instrument_cluster-1774714974170.jpg saved to cache
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b
2026-03-29 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_rear_driver-1774695058455.jpg> (referer: None)
2026-03-29 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5966/6235966/interior_dashboard-1774695653718.jpg> (referer: None)
2026-03-29 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_front_passenger-1774695104618.jpg> (referer: None)
2026-03-29 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_rear_passenger-1774695070625.jpg> (referer: None)
2026-03-29 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5966/6235966/instrument_cluster-1774695621726.jpg> (referer: None)
2026-03-29 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_front_driver-1774622021771.jpg> (referer: None)
2026-03-29 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5966/6235966/interior_boot-1774695605813.jpg> (referer: None)
2026-03-29 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5966/6235966/interior_rear_seats-1774695558051.jpg> (referer: None)
2026-03-29 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5966/6235966/interior_front_seats-1774695533228.jpg> (referer: None)
2026-03-29 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1220/20371220/instrument_cluster-1774626910569.jpg> (referer: None)
2026-03-29 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1343/20491343/docs_service_history-1774715726918-1.jpeg?ixlib=js-3.8.0&auto=format&s=5bb5f4a4d6cec98e105ce606de15ec22> (referer: None)
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2deedc50>
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5966%252F6235966%252Fexterior_rear_driver-1774695058455.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_rear_driver-1774695058455.jpg saved to cache
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddb3910>
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5966%252F6235966%252Finterior_dashboard-1774695653718.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5966/6235966/interior_dashboard-1774695653718.jpg saved to cache
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d99bb90>
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5966%252F6235966%252Fexterior_front_passenger-1774695104618.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_front_passenger-1774695104618.jpg saved to cache
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9aa750>
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5966%252F6235966%252Fexterior_rear_passenger-1774695070625.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_rear_passenger-1774695070625.jpg saved to cache
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9ab990>
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5966%252F6235966%252Finstrument_cluster-1774695621726.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5966/6235966/instrument_cluster-1774695621726.jpg saved to cache
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d980150>
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1220%252F20371220%252Fexterior_front_driver-1774622021771.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_front_driver-1774622021771.jpg saved to cache
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9c6f50>
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5966%252F6235966%252Finterior_boot-1774695605813.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5966/6235966/interior_boot-1774695605813.jpg saved to cache
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9a8e50>
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5966%252F6235966%252Finterior_rear_seats-1774695558051.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5966/6235966/interior_rear_seats-1774695558051.jpg saved to cache
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d99b9d0>
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5966%252F6235966%252Finterior_front_seats-1774695533228.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5966/6235966/interior_front_seats-1774695533228.jpg saved to cache
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9c4c90>
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1220%252F20371220%252Finstrument_cluster-1774626910569.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1220/20371220/instrument_cluster-1774626910569.jpg saved to cache
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddb2890>
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1343%252F20491343%252Fdocs_service_history-1774715726918-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5bb5f4a4d6cec98e105ce606de15ec22') HTTP/1.1" 204 0
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1343/20491343/docs_service_history-1774715726918-1.jpeg?ixlib=js-3.8.0&auto=format&s=5bb5f4a4d6cec98e105ce606de15ec22 saved to cache
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b
2026-03-29 20:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1220/20371220/docs_service_history-1774620128448.jpg?ixlib=js-3.8.0&auto=format&s=729e42eb5674a245f41f4a8ef2697102> (referer: None)
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5966/6235966/docs_service_history-1774695936881.jpg?ixlib=js-3.8.0&auto=format&s=3280880f3ca1eed06626bd913fef15f3> (referer: None)
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1343/20491343/interior_boot-1774714802923.jpg> (referer: None)
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9b10d0>
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1220%252F20371220%252Fdocs_service_history-1774620128448.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D729e42eb5674a245f41f4a8ef2697102') HTTP/1.1" 204 0
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1220/20371220/docs_service_history-1774620128448.jpg?ixlib=js-3.8.0&auto=format&s=729e42eb5674a245f41f4a8ef2697102 saved to cache
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9249d0>
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5966%252F6235966%252Fdocs_service_history-1774695936881.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3280880f3ca1eed06626bd913fef15f3') HTTP/1.1" 204 0
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5966/6235966/docs_service_history-1774695936881.jpg?ixlib=js-3.8.0&auto=format&s=3280880f3ca1eed06626bd913fef15f3 saved to cache
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f502690>
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1343%252F20491343%252Finterior_boot-1774714802923.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1343/20491343/interior_boot-1774714802923.jpg saved to cache
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20501784.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1220/20371220/interior_rear_seats-1774615380292.jpg> (referer: None)
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4596/20414596/docs_service_history-1774742710830.jpeg?ixlib=js-3.8.0&auto=format&s=1dd0c3927d7bef231d147f67f91db03b> (referer: None)
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1220/20371220/interior_boot-1774615434495.jpg> (referer: None)
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_front_driver-1774695027231.jpg> (referer: None)
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_rear_passenger-1774614793879.jpg> (referer: None)
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1343/20491343/interior_dashboard-1774714790741.jpg> (referer: None)
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1220/20371220/interior_dashboard-1774615411580.jpg> (referer: None)
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4596/20414596/20414596-interior_boot-modified-1774794531245.jpeg> (referer: None)
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_rear_driver-1774622045121.jpg> (referer: None)
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_front_passenger-1774614698130.jpg> (referer: None)
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1343/20491343/interior_rear_seats-1774714774015.jpg> (referer: None)
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1220/20371220/interior_front_seats-1774615357216.jpg> (referer: None)
2026-03-29 20:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1539a2e-a21d-5f2b-b036-d5c759bad9ef with identifier: 20501784
2026-03-29 20:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef with scrape type 1
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1784%252F20501784%252Fexterior_front_driver-1774782967221.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_front_driver-1774782967221.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1784%252F20501784%252Fexterior_rear_driver-1774782982277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_rear_driver-1774782982277.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1784%252F20501784%252Fexterior_front_passenger-1774783004593.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_front_passenger-1774783004593.jpg not downloaded yet
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d924bd0>
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1220%252F20371220%252Finterior_rear_seats-1774615380292.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1220/20371220/interior_rear_seats-1774615380292.jpg saved to cache
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1784%252F20501784%252Fexterior_rear_passenger-1774782993608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_rear_passenger-1774782993608.jpg not downloaded yet
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d57ec10>
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4596%252F20414596%252Fdocs_service_history-1774742710830.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1dd0c3927d7bef231d147f67f91db03b') HTTP/1.1" 204 0
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4596/20414596/docs_service_history-1774742710830.jpeg?ixlib=js-3.8.0&auto=format&s=1dd0c3927d7bef231d147f67f91db03b saved to cache
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7053600-a680-5172-93ee-f2cd9876c3b1
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1784%252F20501784%252Finterior_front_seats-1774784370786.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1784/20501784/interior_front_seats-1774784370786.jpg not downloaded yet
2026-03-29 20:05:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd085d0>
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1220%252F20371220%252Finterior_boot-1774615434495.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1220/20371220/interior_boot-1774615434495.jpg saved to cache
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d97f890>
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5966%252F6235966%252Fexterior_front_driver-1774695027231.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_front_driver-1774695027231.jpg saved to cache
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2
2026-03-29 20:05:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c08f048-93f5-54c7-993c-3c2c03bb91d2, skipping ID generation
2026-03-29 20:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2 with scrape type 1
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c08f048-93f5-54c7-993c-3c2c03bb91d2 sending to next pipeline
2026-03-29 20:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8c08f048-93f5-54c7-993c-3c2c03bb91d2, identifier: 6235966
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d91ebd0>
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1220%252F20371220%252Fexterior_rear_passenger-1774614793879.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_rear_passenger-1774614793879.jpg saved to cache
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dde5110>
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1343%252F20491343%252Finterior_dashboard-1774714790741.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1343/20491343/interior_dashboard-1774714790741.jpg saved to cache
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d924b90>
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1220%252F20371220%252Finterior_dashboard-1774615411580.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1220/20371220/interior_dashboard-1774615411580.jpg saved to cache
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9a95d0>
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4596%252F20414596%252F20414596-interior_boot-modified-1774794531245.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4596/20414596/20414596-interior_boot-modified-1774794531245.jpeg saved to cache
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7053600-a680-5172-93ee-f2cd9876c3b1
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d97d210>
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1220%252F20371220%252Fexterior_rear_driver-1774622045121.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_rear_driver-1774622045121.jpg saved to cache
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d557890>
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1220%252F20371220%252Fexterior_front_passenger-1774614698130.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_front_passenger-1774614698130.jpg saved to cache
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9b23d0>
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1343%252F20491343%252Finterior_rear_seats-1774714774015.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1343/20491343/interior_rear_seats-1774714774015.jpg saved to cache
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9c6b10>
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1220%252F20371220%252Finterior_front_seats-1774615357216.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1220/20371220/interior_front_seats-1774615357216.jpg saved to cache
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2
2026-03-29 20:05:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8667c1c8-ff0e-5a66-8146-1f7555beb5d2, skipping ID generation
2026-03-29 20:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2 with scrape type 1
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8667c1c8-ff0e-5a66-8146-1f7555beb5d2 sending to next pipeline
2026-03-29 20:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8667c1c8-ff0e-5a66-8146-1f7555beb5d2, identifier: 20371220
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1784%252F20501784%252Finterior_rear_seats-1774784364955.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1784/20501784/interior_rear_seats-1774784364955.jpg not downloaded yet
2026-03-29 20:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8c08f048-93f5-54c7-993c-3c2c03bb91d2 with identifier: 6235966
2026-03-29 20:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8c08f048-93f5-54c7-993c-3c2c03bb91d2 with identifier: 6235966
2026-03-29 20:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8c08f048-93f5-54c7-993c-3c2c03bb91d2 with identifier: 6235966 to the API
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_front_driver-1774695027231.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8c08f048-93f5-54c7-993c-3c2c03bb91d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RK21 PXO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/6235966',
'listing': 'auction',
'location': 'Berkshire Hungerford',
'make': 'Audi',
'model': 'Q8',
'odometer': 58834,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2077945,
'Height': 2576,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_front_driver-1774695027231.jpg',
'Width': 3435},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2310420,
'Height': 2730,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_rear_driver-1774695058455.jpg',
'Width': 3640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2849941,
'Height': 2810,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_front_passenger-1774695104618.jpg',
'Width': 3746},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2153265,
'Height': 2724,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5966/6235966/exterior_rear_passenger-1774695070625.jpg',
'Width': 3632},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3126204,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5966/6235966/interior_front_seats-1774695533228.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3117604,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5966/6235966/interior_rear_seats-1774695558051.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1495831,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5966/6235966/interior_dashboard-1774695653718.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2948030,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5966/6235966/instrument_cluster-1774695621726.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3373193,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5966/6235966/interior_boot-1774695605813.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c08f048-93f5-54c7-993c-3c2c03bb91d2/8c08f048-93f5-54c7-993c-3c2c03bb91d2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4872735,
'Height': 4114,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5966/6235966/docs_service_history-1774695936881.jpg?ixlib=js-3.8.0&auto=format&s=3280880f3ca1eed06626bd913fef15f3',
'Width': 2604}],
'price': 35179,
'price_includes_vat': False,
'registration_date': '2021-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q8 SLN BLK ED 50 TDI MHEV QT A',
'transmission': 'automatic',
'trim': 'SLN BLK ED 50 TDI MHEV QT A',
'vin': 'WAUZZZF19MD019756',
'year': 2021}
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276235966%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [motorway.uk] INFO: Saving data for 6235966: {'created_time': 1774814729.979654, 'last_price_update_time': 1774814729.979672, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='6235966') HTTP/1.1" 204 0
2026-03-29 20:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8667c1c8-ff0e-5a66-8146-1f7555beb5d2 with identifier: 20371220
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8667c1c8-ff0e-5a66-8146-1f7555beb5d2 with identifier: 20371220
2026-03-29 20:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8667c1c8-ff0e-5a66-8146-1f7555beb5d2 with identifier: 20371220 to the API
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/1220/20371220/interior_front_seats-1774615357216.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '8667c1c8-ff0e-5a66-8146-1f7555beb5d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GC17 OZL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20371220',
'listing': 'auction',
'location': 'Kent Hythe',
'make': 'Audi',
'model': 'Q2',
'odometer': 41000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2371796,
'Height': 2831,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_front_driver-1774622021771.jpg',
'Width': 3774},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1979790,
'Height': 2763,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_rear_driver-1774622045121.jpg',
'Width': 3684},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2041348,
'Height': 2666,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_front_passenger-1774614698130.jpg',
'Width': 3554},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1508247,
'Height': 2418,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1220/20371220/exterior_rear_passenger-1774614793879.jpg',
'Width': 3224},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3132110,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1220/20371220/interior_front_seats-1774615357216.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2600803,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1220/20371220/interior_rear_seats-1774615380292.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2366202,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1220/20371220/interior_dashboard-1774615411580.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1928248,
'Height': 4284,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1220/20371220/instrument_cluster-1774626910569.jpg',
'Width': 5712},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3725450,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1220/20371220/interior_boot-1774615434495.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8667c1c8-ff0e-5a66-8146-1f7555beb5d2/8667c1c8-ff0e-5a66-8146-1f7555beb5d2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210767,
'Height': 1813,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1220/20371220/docs_service_history-1774620128448.jpg?ixlib=js-3.8.0&auto=format&s=729e42eb5674a245f41f4a8ef2697102',
'Width': 1360}],
'price': 15046,
'price_includes_vat': False,
'registration_date': '2017-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q2 S Line Edition 1 TFSI S-A',
'transmission': 'automatic',
'trim': 'S Line Edition 1 TFSI S-A',
'vin': 'WAUZZZGA7JA001560',
'year': 2017}
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720371220%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [motorway.uk] INFO: Saving data for 20371220: {'created_time': 1774814730.572172, 'last_price_update_time': 1774814730.572183, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20371220') HTTP/1.1" 204 0
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1784%252F20501784%252Finterior_dashboard-1774784228801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1784/20501784/interior_dashboard-1774784228801.jpg not downloaded yet
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=36&page=1&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1784%252F20501784%252Finstrument_cluster-1774785847856.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1784/20501784/instrument_cluster-1774785847856.jpg not downloaded yet
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1784%252F20501784%252Finterior_boot-1774784274515.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1784/20501784/interior_boot-1774784274515.jpg not downloaded yet
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1784%252F20501784%252Fwheels_front_driver-1774783040814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1784/20501784/wheels_front_driver-1774783040814.jpg not downloaded yet
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4596/20414596/20414596-instrument_cluster-modified-1774794466817.jpeg> (referer: None)
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4596/20414596/20414596-interior_dashboard-modified-1774794517185.jpeg> (referer: None)
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_rear_passenger-1774714299201.jpg> (referer: None)
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 12213512
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 20488190
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 20491954
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 18395283
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 20007284
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 10801992
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 19925917
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719925917%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [motorway.uk] INFO: Scrape type for 19925917: 1
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 19874916
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 20226377
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 20343618
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720343618%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [motorway.uk] INFO: Scrape type for 20343618: 1
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4596/20414596/interior_rear_seats-1774723903079.jpeg> (referer: None)
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 19943436
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 20452938
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720452938%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [motorway.uk] INFO: Scrape type for 20452938: 1
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 17257209
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717257209%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [motorway.uk] INFO: Scrape type for 17257209: 1
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 20481812
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 19560308
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 20485589
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 20425191
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 9396121
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 19478931
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 20428242
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 20451701
2026-03-29 20:05:30 [motorway.uk] INFO: Found listing with ID: 20458099
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720458099%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [motorway.uk] INFO: Scrape type for 20458099: 1
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2c5890>
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4596%252F20414596%252F20414596-instrument_cluster-modified-1774794466817.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4596/20414596/20414596-instrument_cluster-modified-1774794466817.jpeg saved to cache
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7053600-a680-5172-93ee-f2cd9876c3b1
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35c6cc10>
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4596%252F20414596%252F20414596-interior_dashboard-modified-1774794517185.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4596/20414596/20414596-interior_dashboard-modified-1774794517185.jpeg saved to cache
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7053600-a680-5172-93ee-f2cd9876c3b1
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 15842916
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 20460677
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 18909824
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718909824%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [motorway.uk] INFO: Scrape type for 18909824: 1
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2de1d0>
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1343%252F20491343%252Fexterior_rear_passenger-1774714299201.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_rear_passenger-1774714299201.jpg saved to cache
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 20468920
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720468920%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [motorway.uk] INFO: Scrape type for 20468920: 1
2026-03-29 20:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 9709918
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 20449963
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 16442218
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716442218%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [motorway.uk] INFO: Scrape type for 16442218: 1
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 14 Pro\x00'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 174 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 182 - value: b'26.4\x00'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 188 - value: b'2026:03:28 18:51:40\x00'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 208 - value: b'iPhone 14 Pro\x00'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xde'
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35532410>
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4596%252F20414596%252Finterior_rear_seats-1774723903079.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4596/20414596/interior_rear_seats-1774723903079.jpeg saved to cache
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7053600-a680-5172-93ee-f2cd9876c3b1
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1343/20491343/interior_front_seats-1774714842921.jpg> (referer: None)
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 20468049
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 18710113
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 9721294
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 20454912
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 10856544
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 20471927
2026-03-29 20:05:31 [motorway.uk] INFO: Found listing with ID: 18459962
2026-03-29 20:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4596/20414596/20414596-exterior_front_passenger-modified-1774794475511.jpeg> (referer: None)
2026-03-29 20:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1784/20501784/instrument_cluster-1774785847856.jpg> (referer: None)
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1784/20501784/wheels_front_driver-1774783040814.jpg> (referer: None)
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_rear_driver-1774782982277.jpg> (referer: None)
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_front_passenger-1774714316994.jpg> (referer: None)
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_front_driver-1774782967221.jpg> (referer: None)
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4596/20414596/interior_front_seats-1774723856553.jpeg> (referer: None)
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_front_passenger-1774783004593.jpg> (referer: None)
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_rear_passenger-1774782993608.jpg> (referer: None)
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1784/20501784/interior_rear_seats-1774784364955.jpg> (referer: None)
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1784/20501784/interior_dashboard-1774784228801.jpg> (referer: None)
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_front_driver-1774714272929.jpg> (referer: None)
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1784/20501784/interior_front_seats-1774784370786.jpg> (referer: None)
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1784/20501784/interior_boot-1774784274515.jpg> (referer: None)
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f502b90>
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1343%252F20491343%252Finterior_front_seats-1774714842921.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1343/20491343/interior_front_seats-1774714842921.jpg saved to cache
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3f0350>
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4596%252F20414596%252F20414596-exterior_front_passenger-modified-1774794475511.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4596/20414596/20414596-exterior_front_passenger-modified-1774794475511.jpeg saved to cache
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7053600-a680-5172-93ee-f2cd9876c3b1
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35448a90>
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1784%252F20501784%252Finstrument_cluster-1774785847856.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1784/20501784/instrument_cluster-1774785847856.jpg saved to cache
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d972b90>
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1784%252F20501784%252Fwheels_front_driver-1774783040814.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1784/20501784/wheels_front_driver-1774783040814.jpg saved to cache
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d91df50>
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1784%252F20501784%252Fexterior_rear_driver-1774782982277.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_rear_driver-1774782982277.jpg saved to cache
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d971310>
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1343%252F20491343%252Fexterior_front_passenger-1774714316994.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_front_passenger-1774714316994.jpg saved to cache
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f664e90>
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1784%252F20501784%252Fexterior_front_driver-1774782967221.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_front_driver-1774782967221.jpg saved to cache
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 14 Pro\x00'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 174 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 182 - value: b'26.4\x00'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 188 - value: b'2026:03:28 18:50:53\x00'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 208 - value: b'iPhone 14 Pro\x00'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xde'
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3d2c50>
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4596%252F20414596%252Finterior_front_seats-1774723856553.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4596/20414596/interior_front_seats-1774723856553.jpeg saved to cache
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7053600-a680-5172-93ee-f2cd9876c3b1
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2a87d0>
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1784%252F20501784%252Fexterior_front_passenger-1774783004593.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_front_passenger-1774783004593.jpg saved to cache
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d57de50>
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1784%252F20501784%252Fexterior_rear_passenger-1774782993608.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_rear_passenger-1774782993608.jpg saved to cache
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35c6cc10>
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1784%252F20501784%252Finterior_rear_seats-1774784364955.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1784/20501784/interior_rear_seats-1774784364955.jpg saved to cache
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dabf910>
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1784%252F20501784%252Finterior_dashboard-1774784228801.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1784/20501784/interior_dashboard-1774784228801.jpg saved to cache
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f664250>
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1343%252F20491343%252Fexterior_front_driver-1774714272929.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_front_driver-1774714272929.jpg saved to cache
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b
2026-03-29 20:05:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b71c4cae-77f6-5a0c-9ecb-ed37349c574b, skipping ID generation
2026-03-29 20:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b with scrape type 1
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b71c4cae-77f6-5a0c-9ecb-ed37349c574b sending to next pipeline
2026-03-29 20:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b71c4cae-77f6-5a0c-9ecb-ed37349c574b, identifier: 20491343
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d92b750>
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1784%252F20501784%252Finterior_front_seats-1774784370786.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1784/20501784/interior_front_seats-1774784370786.jpg saved to cache
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f355ade50>
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1784%252F20501784%252Finterior_boot-1774784274515.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1784/20501784/interior_boot-1774784274515.jpg saved to cache
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef
2026-03-29 20:05:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1539a2e-a21d-5f2b-b036-d5c759bad9ef, skipping ID generation
2026-03-29 20:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef with scrape type 1
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1539a2e-a21d-5f2b-b036-d5c759bad9ef sending to next pipeline
2026-03-29 20:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d1539a2e-a21d-5f2b-b036-d5c759bad9ef, identifier: 20501784
2026-03-29 20:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b71c4cae-77f6-5a0c-9ecb-ed37349c574b with identifier: 20491343
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2026-03-29 20:05:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b71c4cae-77f6-5a0c-9ecb-ed37349c574b with identifier: 20491343
2026-03-29 20:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b71c4cae-77f6-5a0c-9ecb-ed37349c574b with identifier: 20491343 to the API
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_front_driver-1774714272929.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'b71c4cae-77f6-5a0c-9ecb-ed37349c574b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VO24 KNX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20491343',
'listing': 'auction',
'location': 'Gloucestershire Tewkesbury',
'make': 'Jaguar',
'model': 'Other Jaguar',
'odometer': 23151,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2808524,
'Height': 2846,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_front_driver-1774714272929.jpg',
'Width': 3795},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2027572,
'Height': 2599,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_rear_driver-1774714290658.jpg',
'Width': 3465},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1903894,
'Height': 2600,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_front_passenger-1774714316994.jpg',
'Width': 3467},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1703300,
'Height': 2423,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1343/20491343/exterior_rear_passenger-1774714299201.jpg',
'Width': 3230},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2966374,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1343/20491343/interior_front_seats-1774714842921.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2693705,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1343/20491343/interior_rear_seats-1774714774015.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1705320,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1343/20491343/interior_dashboard-1774714790741.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1294554,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1343/20491343/instrument_cluster-1774714974170.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3394973,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1343/20491343/interior_boot-1774714802923.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b71c4cae-77f6-5a0c-9ecb-ed37349c574b/b71c4cae-77f6-5a0c-9ecb-ed37349c574b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60192,
'Height': 1263,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1343/20491343/docs_service_history-1774715726918-1.jpeg?ixlib=js-3.8.0&auto=format&s=5bb5f4a4d6cec98e105ce606de15ec22',
'Width': 892}],
'price': 22686,
'price_includes_vat': False,
'registration_date': '2024-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar XE R-DYNAMIC SE Black D MHEV A',
'transmission': 'automatic',
'trim': 'XE R-DYNAMIC SE Black D MHEV A',
'vin': 'SAJAB4AN1RCP71659',
'year': 2024}
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491343%27 HTTP/1.1" 200 None
2026-03-29 20:05:34 [motorway.uk] INFO: Saving data for 20491343: {'created_time': 1774814734.524154, 'last_price_update_time': 1774814734.524168, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20491343') HTTP/1.1" 204 0
2026-03-29 20:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d1539a2e-a21d-5f2b-b036-d5c759bad9ef with identifier: 20501784
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2026-03-29 20:05:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d1539a2e-a21d-5f2b-b036-d5c759bad9ef with identifier: 20501784
2026-03-29 20:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d1539a2e-a21d-5f2b-b036-d5c759bad9ef with identifier: 20501784 to the API
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/1784/20501784/interior_boot-1774784274515.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': 'd1539a2e-a21d-5f2b-b036-d5c759bad9ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP25 CJO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20501784',
'listing': 'auction',
'location': 'Somerset Shepton Mallet',
'make': 'Audi',
'model': 'Other Audi',
'odometer': 3565,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2777462,
'Height': 2855,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_front_driver-1774782967221.jpg',
'Width': 3807},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1790205,
'Height': 2392,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_rear_driver-1774782982277.jpg',
'Width': 3189},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2171326,
'Height': 2699,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_front_passenger-1774783004593.jpg',
'Width': 3598},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2370009,
'Height': 2736,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1784/20501784/exterior_rear_passenger-1774782993608.jpg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3133876,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1784/20501784/interior_front_seats-1774784370786.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2563067,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1784/20501784/interior_rear_seats-1774784364955.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2732250,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1784/20501784/interior_dashboard-1774784228801.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1863555,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1784/20501784/instrument_cluster-1774785847856.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4313969,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1784/20501784/interior_boot-1774784274515.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1539a2e-a21d-5f2b-b036-d5c759bad9ef/d1539a2e-a21d-5f2b-b036-d5c759bad9ef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1361484,
'Height': 2328,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1784/20501784/wheels_front_driver-1774783040814.jpg',
'Width': 3104}],
'price': 60550,
'price_includes_vat': False,
'registration_date': '2025-06-24',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q6 E-TRON Edition 1 Quattro',
'transmission': 'automatic',
'trim': 'Q6 E-TRON Edition 1 Quattro',
'vin': 'WAUZZZGF6SA061939',
'year': 2025}
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720501784%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [motorway.uk] INFO: Saving data for 20501784: {'created_time': 1774814735.241903, 'last_price_update_time': 1774814735.241915, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20501784') HTTP/1.1" 204 0
2026-03-29 20:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4596/20414596/20414596-exterior_rear_driver-modified-1774794413904.jpeg> (referer: None)
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5c6f50>
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4596%252F20414596%252F20414596-exterior_rear_driver-modified-1774794413904.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4596/20414596/20414596-exterior_rear_driver-modified-1774794413904.jpeg saved to cache
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7053600-a680-5172-93ee-f2cd9876c3b1
2026-03-29 20:05:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7053600-a680-5172-93ee-f2cd9876c3b1, skipping ID generation
2026-03-29 20:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7053600-a680-5172-93ee-f2cd9876c3b1 with scrape type 1
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7053600-a680-5172-93ee-f2cd9876c3b1 sending to next pipeline
2026-03-29 20:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d7053600-a680-5172-93ee-f2cd9876c3b1, identifier: 20414596
2026-03-29 20:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d7053600-a680-5172-93ee-f2cd9876c3b1 with identifier: 20414596
2026-03-29 20:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d7053600-a680-5172-93ee-f2cd9876c3b1 with identifier: 20414596
2026-03-29 20:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d7053600-a680-5172-93ee-f2cd9876c3b1 with identifier: 20414596 to the API
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/4596/20414596/20414596-exterior_rear_driver-modified-1774794413904.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'd7053600-a680-5172-93ee-f2cd9876c3b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN72 GGE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20414596',
'listing': 'auction',
'location': 'Surrey Ashford',
'make': 'BMW',
'model': 'X3',
'odometer': 29249,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1338370,
'Height': 2477,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4596/20414596/exterior_front_driver-1774723789580.jpeg',
'Width': 3302},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 971859,
'Height': 2098,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4596/20414596/20414596-exterior_rear_driver-modified-1774794413904.jpeg',
'Width': 2797},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1213586,
'Height': 2074,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4596/20414596/20414596-exterior_front_passenger-modified-1774794475511.jpeg',
'Width': 2765},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1077015,
'Height': 2203,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4596/20414596/20414596-exterior_rear_passenger-modified-1774794490598.jpeg',
'Width': 2937},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2115624,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4596/20414596/interior_front_seats-1774723856553.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2129897,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4596/20414596/interior_rear_seats-1774723903079.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1160301,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4596/20414596/20414596-interior_dashboard-modified-1774794517185.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 810663,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4596/20414596/20414596-instrument_cluster-modified-1774794466817.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1847016,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4596/20414596/20414596-interior_boot-modified-1774794531245.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7053600-a680-5172-93ee-f2cd9876c3b1/d7053600-a680-5172-93ee-f2cd9876c3b1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1577020,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4596/20414596/docs_service_history-1774742710830.jpeg?ixlib=js-3.8.0&auto=format&s=1dd0c3927d7bef231d147f67f91db03b',
'Width': 4032}],
'price': 43875,
'price_includes_vat': False,
'registration_date': '2023-01-31',
'seats_number': None,
'seller_name': None,
'title': 'BMW X3 M40I MHEV Auto',
'transmission': 'automatic',
'trim': 'M40I MHEV Auto',
'vin': 'WBA86DP070N190572',
'year': 2023}
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720414596%27 HTTP/1.1" 200 None
2026-03-29 20:05:36 [motorway.uk] INFO: Saving data for 20414596: {'created_time': 1774814736.220007, 'last_price_update_time': 1774814736.22002, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20414596') HTTP/1.1" 204 0
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=72&page=2&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 6579411
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 18288929
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 10230435
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710230435%27 HTTP/1.1" 200 None
2026-03-29 20:05:36 [motorway.uk] INFO: Scrape type for 10230435: 1
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20413878
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20489985
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489985%27 HTTP/1.1" 200 None
2026-03-29 20:05:36 [motorway.uk] INFO: Scrape type for 20489985: 1
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20266437
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 18704338
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20479276
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 13909960
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20487021
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 19601663
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20444990
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20184498
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20155249
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 14811957
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 4700757
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20492157
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20415455
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20465121
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 19763259
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20407866
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 19657268
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 4217945
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274217945%27 HTTP/1.1" 200 None
2026-03-29 20:05:36 [motorway.uk] INFO: Scrape type for 4217945: 1
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20421154
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20426599
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20483409
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20382764
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 17702324
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 19979923
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 7899191
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 9335437
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20443228
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 14132265
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 19384929
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20385350
2026-03-29 20:05:36 [motorway.uk] INFO: Found listing with ID: 20231987
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720231987%27 HTTP/1.1" 200 None
2026-03-29 20:05:36 [motorway.uk] INFO: Scrape type for 20231987: 1
2026-03-29 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16442218.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f53201e7-db2c-51d4-acb5-ac0c2a0126db with identifier: 16442218
2026-03-29 20:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f53201e7-db2c-51d4-acb5-ac0c2a0126db with scrape type 1
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f53201e7-db2c-51d4-acb5-ac0c2a0126db
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2218%252F16442218%252Fexterior_front_driver-1772098637583.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2218/16442218/exterior_front_driver-1772098637583.jpg already downloaded
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2218%252F16442218%252Fexterior_rear_driver-1772098662395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2218/16442218/exterior_rear_driver-1772098662395.jpg already downloaded
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2218%252F16442218%252Fexterior_front_passenger-1772098679963.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2218/16442218/exterior_front_passenger-1772098679963.jpg already downloaded
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2218%252F16442218%252Fexterior_rear_passenger-1772098665357.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2218/16442218/exterior_rear_passenger-1772098665357.jpg already downloaded
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2218%252F16442218%252Finterior_front_seats-1772099074393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2218/16442218/interior_front_seats-1772099074393.jpg already downloaded
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2218%252F16442218%252Finterior_rear_seats-1772099079363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2218/16442218/interior_rear_seats-1772099079363.jpg already downloaded
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2218%252F16442218%252Finterior_dashboard-1772099109667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2218/16442218/interior_dashboard-1772099109667.jpg already downloaded
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2218%252F16442218%252Finstrument_cluster-1772099042500.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2218/16442218/instrument_cluster-1772099042500.jpg already downloaded
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2218%252F16442218%252Finterior_boot-1772099114248.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2218/16442218/interior_boot-1772099114248.jpg already downloaded
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2218%252F16442218%252Fdocs_service_history-1772105210279.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daf2c5ce6859409a32b5f76859aec86c2%27 HTTP/1.1" 200 None
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2218/16442218/docs_service_history-1772105210279.jpg?ixlib=js-3.8.0&auto=format&s=af2c5ce6859409a32b5f76859aec86c2 already downloaded
2026-03-29 20:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f53201e7-db2c-51d4-acb5-ac0c2a0126db, identifier: 16442218
2026-03-29 20:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f53201e7-db2c-51d4-acb5-ac0c2a0126db with identifier: 16442218
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Blue HTTP/1.1" 200 None
2026-03-29 20:05:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f53201e7-db2c-51d4-acb5-ac0c2a0126db with identifier: 16442218
2026-03-29 20:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f53201e7-db2c-51d4-acb5-ac0c2a0126db with identifier: 16442218 to the API
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16442218.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f53201e7-db2c-51d4-acb5-ac0c2a0126db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ71 YXL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16442218',
'listing': 'auction',
'location': 'Greater Manchester Manchester',
'make': 'Porsche',
'model': '911',
'odometer': 9000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/2218/16442218/exterior_front_driver-1772098637583.jpg',
'https://motorway-photos-redacted.imgix.net/2218/16442218/exterior_rear_driver-1772098662395.jpg',
'https://motorway-photos-redacted.imgix.net/2218/16442218/exterior_front_passenger-1772098679963.jpg',
'https://motorway-photos-redacted.imgix.net/2218/16442218/exterior_rear_passenger-1772098665357.jpg',
'https://motorway-photos.imgix.net/2218/16442218/interior_front_seats-1772099074393.jpg',
'https://motorway-photos.imgix.net/2218/16442218/interior_rear_seats-1772099079363.jpg',
'https://motorway-photos-redacted.imgix.net/2218/16442218/interior_dashboard-1772099109667.jpg',
'https://motorway-photos.imgix.net/2218/16442218/instrument_cluster-1772099042500.jpg',
'https://motorway-photos.imgix.net/2218/16442218/interior_boot-1772099114248.jpg',
'https://motorway-service-history-photos.imgix.net/modified/2218/16442218/docs_service_history-1772105210279.jpg?ixlib=js-3.8.0&auto=format&s=af2c5ce6859409a32b5f76859aec86c2'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53201e7-db2c-51d4-acb5-ac0c2a0126db/f53201e7-db2c-51d4-acb5-ac0c2a0126db_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2060000,
'Height': 2732,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2218/16442218/exterior_front_driver-1772098637583.jpg',
'Width': 3642},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53201e7-db2c-51d4-acb5-ac0c2a0126db/f53201e7-db2c-51d4-acb5-ac0c2a0126db_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2165499,
'Height': 2723,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2218/16442218/exterior_rear_driver-1772098662395.jpg',
'Width': 3631},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53201e7-db2c-51d4-acb5-ac0c2a0126db/f53201e7-db2c-51d4-acb5-ac0c2a0126db_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1862699,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2218/16442218/exterior_front_passenger-1772098679963.jpg',
'Width': 3455},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53201e7-db2c-51d4-acb5-ac0c2a0126db/f53201e7-db2c-51d4-acb5-ac0c2a0126db_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1832626,
'Height': 2551,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2218/16442218/exterior_rear_passenger-1772098665357.jpg',
'Width': 3401},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53201e7-db2c-51d4-acb5-ac0c2a0126db/f53201e7-db2c-51d4-acb5-ac0c2a0126db_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3086240,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2218/16442218/interior_front_seats-1772099074393.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53201e7-db2c-51d4-acb5-ac0c2a0126db/f53201e7-db2c-51d4-acb5-ac0c2a0126db_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2063058,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2218/16442218/interior_rear_seats-1772099079363.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53201e7-db2c-51d4-acb5-ac0c2a0126db/f53201e7-db2c-51d4-acb5-ac0c2a0126db_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2774060,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2218/16442218/interior_dashboard-1772099109667.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53201e7-db2c-51d4-acb5-ac0c2a0126db/f53201e7-db2c-51d4-acb5-ac0c2a0126db_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2280994,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2218/16442218/instrument_cluster-1772099042500.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53201e7-db2c-51d4-acb5-ac0c2a0126db/f53201e7-db2c-51d4-acb5-ac0c2a0126db_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2242441,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2218/16442218/interior_boot-1772099114248.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53201e7-db2c-51d4-acb5-ac0c2a0126db/f53201e7-db2c-51d4-acb5-ac0c2a0126db_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1295667,
'Height': 3772,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/2218/16442218/docs_service_history-1772105210279.jpg?ixlib=js-3.8.0&auto=format&s=af2c5ce6859409a32b5f76859aec86c2',
'Width': 2829}],
'price': 99991,
'price_includes_vat': False,
'registration_date': '2022-02-10',
'seats_number': None,
'seller_name': None,
'title': 'Porsche 911 Carrera S',
'transmission': 'manual',
'trim': 'Carrera S',
'vin': 'WP0ZZZ99ZNS211197',
'year': 2022}
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716442218%27 HTTP/1.1" 200 None
2026-03-29 20:05:38 [motorway.uk] INFO: Saving data for 16442218: {'created_time': 1774814738.115444, 'last_price_update_time': 1774814738.115455, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16442218') HTTP/1.1" 204 0
2026-03-29 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18909824.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20343618.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20452938.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4708f380-ef8e-51e0-84e0-924017bca348 with identifier: 18909824
2026-03-29 20:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4708f380-ef8e-51e0-84e0-924017bca348 with scrape type 1
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4708f380-ef8e-51e0-84e0-924017bca348
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9824%252F18909824%252Fexterior_front_driver-1774708052989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9824/18909824/exterior_front_driver-1774708052989.jpg not downloaded yet
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9824%252F18909824%252Fexterior_rear_driver-1774708052694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9824/18909824/exterior_rear_driver-1774708052694.jpg not downloaded yet
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9824%252F18909824%252Fexterior_front_passenger-1774708095297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9824/18909824/exterior_front_passenger-1774708095297.jpg not downloaded yet
2026-03-29 20:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d62c0e66-577e-58f4-9731-f1e5d1d5dfb0 with identifier: 20343618
2026-03-29 20:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d62c0e66-577e-58f4-9731-f1e5d1d5dfb0 with scrape type 1
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d62c0e66-577e-58f4-9731-f1e5d1d5dfb0
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3618%252F20343618%252Fexterior_front_driver-1774348530241.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3618/20343618/exterior_front_driver-1774348530241.jpg not downloaded yet
2026-03-29 20:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 801aa270-c146-5676-a200-b017b1f97547 with identifier: 20452938
2026-03-29 20:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 801aa270-c146-5676-a200-b017b1f97547 with scrape type 1
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 801aa270-c146-5676-a200-b017b1f97547
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2938%252F20452938%252Fexterior_front_driver-1774714542364.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2938/20452938/exterior_front_driver-1774714542364.jpg not downloaded yet
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9824%252F18909824%252Fexterior_rear_passenger-1774708081645.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9824/18909824/exterior_rear_passenger-1774708081645.jpg not downloaded yet
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3618%252F20343618%252Fexterior_rear_driver-1774273467720.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3618/20343618/exterior_rear_driver-1774273467720.jpg not downloaded yet
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2938%252F20452938%252Fexterior_rear_driver-1774714563102.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2938/20452938/exterior_rear_driver-1774714563102.jpg not downloaded yet
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9824%252F18909824%252Finterior_front_seats-1774708762293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9824/18909824/interior_front_seats-1774708762293.jpg not downloaded yet
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3618%252F20343618%252Fexterior_front_passenger-1774348612402.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3618/20343618/exterior_front_passenger-1774348612402.jpg not downloaded yet
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2938%252F20452938%252Fexterior_front_passenger-1774714585026.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2938/20452938/exterior_front_passenger-1774714585026.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9824%252F18909824%252Finterior_rear_seats-1774708671057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9824/18909824/interior_rear_seats-1774708671057.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3618%252F20343618%252Fexterior_rear_passenger-1774349055594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3618/20343618/exterior_rear_passenger-1774349055594.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2938%252F20452938%252Fexterior_rear_passenger-1774714574264.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2938/20452938/exterior_rear_passenger-1774714574264.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9824%252F18909824%252Finterior_dashboard-1774708703257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9824/18909824/interior_dashboard-1774708703257.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3618%252F20343618%252Finterior_front_seats-1774349439292.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3618/20343618/interior_front_seats-1774349439292.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2938%252F20452938%252Finterior_front_seats-1774715299040.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2938/20452938/interior_front_seats-1774715299040.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9824%252F18909824%252Finstrument_cluster-1774708766353.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9824/18909824/instrument_cluster-1774708766353.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3618%252F20343618%252Finterior_rear_seats-1774349305534.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3618/20343618/interior_rear_seats-1774349305534.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2938%252F20452938%252Finterior_rear_seats-1774715122323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2938/20452938/interior_rear_seats-1774715122323.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9824%252F18909824%252Finterior_boot-1774708717147.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9824/18909824/interior_boot-1774708717147.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3618%252F20343618%252Finterior_dashboard-1774349403811.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3618/20343618/interior_dashboard-1774349403811.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2938%252F20452938%252Finterior_dashboard-1774715188211.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2938/20452938/interior_dashboard-1774715188211.jpg not downloaded yet
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17257209.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9824%252F18909824%252Fdocs_service_history-1774709133023.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df3a94db92658617bdbca2edf48281278%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9824/18909824/docs_service_history-1774709133023.jpg?ixlib=js-3.8.0&auto=format&s=f3a94db92658617bdbca2edf48281278 not downloaded yet
2026-03-29 20:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3618%252F20343618%252Finstrument_cluster-1774349336690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3618/20343618/instrument_cluster-1774349336690.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2938%252F20452938%252Finstrument_cluster-1774715124194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2938/20452938/instrument_cluster-1774715124194.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3618%252F20343618%252Finterior_boot-1774349412805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3618/20343618/interior_boot-1774349412805.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2938%252F20452938%252Finterior_boot-1774715207719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2938/20452938/interior_boot-1774715207719.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3618%252F20343618%252Fdocs_service_history-1774273084148.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1ad97d6308d30ed7e0d0beaef10fc3ed%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3618/20343618/docs_service_history-1774273084148.jpg?ixlib=js-3.8.0&auto=format&s=1ad97d6308d30ed7e0d0beaef10fc3ed not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2938%252F20452938%252Fdocs_service_history-1774715499643.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df5da5e902397d2ee2bc5032f3ee4911c%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2938/20452938/docs_service_history-1774715499643.jpg?ixlib=js-3.8.0&auto=format&s=f5da5e902397d2ee2bc5032f3ee4911c not downloaded yet
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19925917.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6c672da-3062-5530-8f58-dd6672d0ab7d with identifier: 17257209
2026-03-29 20:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c672da-3062-5530-8f58-dd6672d0ab7d with scrape type 1
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6c672da-3062-5530-8f58-dd6672d0ab7d
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7209%252F17257209%252Fexterior_front_driver-1774704795898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7209/17257209/exterior_front_driver-1774704795898.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7209%252F17257209%252Fexterior_rear_driver-1774704811586.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7209/17257209/exterior_rear_driver-1774704811586.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7209%252F17257209%252Fexterior_front_passenger-1774704889731.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7209/17257209/exterior_front_passenger-1774704889731.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7209%252F17257209%252Fexterior_rear_passenger-1774706302779.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7209/17257209/exterior_rear_passenger-1774706302779.jpg not downloaded yet
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9824/18909824/exterior_front_driver-1774708052989.jpg> (referer: None)
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9824/18909824/exterior_rear_driver-1774708052694.jpg> (referer: None)
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7209%252F17257209%252Finterior_front_seats-1774705321726.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7209/17257209/interior_front_seats-1774705321726.jpg not downloaded yet
2026-03-29 20:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abafba5e-306d-5a79-bc88-57f92371fe28 with identifier: 19925917
2026-03-29 20:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abafba5e-306d-5a79-bc88-57f92371fe28 with scrape type 1
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item abafba5e-306d-5a79-bc88-57f92371fe28
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5917%252F19925917%252Fexterior_front_driver-1774693954805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5917/19925917/exterior_front_driver-1774693954805.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7209%252F17257209%252Finterior_rear_seats-1774705346024.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7209/17257209/interior_rear_seats-1774705346024.jpg not downloaded yet
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9824/18909824/exterior_rear_passenger-1774708081645.jpg> (referer: None)
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5917%252F19925917%252Fexterior_rear_driver-1773920494087.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5917/19925917/exterior_rear_driver-1773920494087.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7209%252F17257209%252Finterior_dashboard-1774706390727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7209/17257209/interior_dashboard-1774706390727.jpg not downloaded yet
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9824/18909824/exterior_front_passenger-1774708095297.jpg> (referer: None)
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5917%252F19925917%252Fexterior_front_passenger-1773920439968.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5917/19925917/exterior_front_passenger-1773920439968.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7209%252F17257209%252Finstrument_cluster-1774705434721.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7209/17257209/instrument_cluster-1774705434721.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5917%252F19925917%252Fexterior_rear_passenger-1773920287277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5917/19925917/exterior_rear_passenger-1773920287277.jpg not downloaded yet
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc81590>
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4708f380-ef8e-51e0-84e0-924017bca348/4708f380-ef8e-51e0-84e0-924017bca348_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9824%252F18909824%252Fexterior_front_driver-1774708052989.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9824/18909824/exterior_front_driver-1774708052989.jpg saved to cache
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4708f380-ef8e-51e0-84e0-924017bca348
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5f9e90>
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4708f380-ef8e-51e0-84e0-924017bca348/4708f380-ef8e-51e0-84e0-924017bca348_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9824%252F18909824%252Fexterior_rear_driver-1774708052694.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9824/18909824/exterior_rear_driver-1774708052694.jpg saved to cache
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4708f380-ef8e-51e0-84e0-924017bca348
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7209%252F17257209%252Finterior_boot-1774706405927.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7209/17257209/interior_boot-1774706405927.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5917%252F19925917%252Finterior_front_seats-1774693738023.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5917/19925917/interior_front_seats-1774693738023.jpg not downloaded yet
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7209%252F17257209%252Fdamage_scratches-1774704958590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7209/17257209/damage_scratches-1774704958590.jpg not downloaded yet
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5917%252F19925917%252Finterior_rear_seats-1774534410046.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5917/19925917/interior_rear_seats-1774534410046.jpg not downloaded yet
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5d1a50>
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4708f380-ef8e-51e0-84e0-924017bca348/4708f380-ef8e-51e0-84e0-924017bca348_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9824%252F18909824%252Fexterior_rear_passenger-1774708081645.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9824/18909824/exterior_rear_passenger-1774708081645.jpg saved to cache
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4708f380-ef8e-51e0-84e0-924017bca348
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc8f750>
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4708f380-ef8e-51e0-84e0-924017bca348/4708f380-ef8e-51e0-84e0-924017bca348_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9824%252F18909824%252Fexterior_front_passenger-1774708095297.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9824/18909824/exterior_front_passenger-1774708095297.jpg saved to cache
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4708f380-ef8e-51e0-84e0-924017bca348
2026-03-29 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3618/20343618/exterior_front_driver-1774348530241.jpg> (referer: None)
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5917%252F19925917%252Finterior_dashboard-1774629387668.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5917/19925917/interior_dashboard-1774629387668.jpg not downloaded yet
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5917%252F19925917%252Finstrument_cluster-1774629511961.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5917/19925917/instrument_cluster-1774629511961.jpg not downloaded yet
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5917%252F19925917%252Finterior_boot-1774629665189.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5917/19925917/interior_boot-1774629665189.jpg not downloaded yet
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5917%252F19925917%252Fdocs_service_history-1774621204756.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc56baa5ae0fe9b90ec1cc55576a49c03%27 HTTP/1.1" 200 None
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5917/19925917/docs_service_history-1774621204756.png?ixlib=js-3.8.0&auto=format&s=c56baa5ae0fe9b90ec1cc55576a49c03 not downloaded yet
2026-03-29 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2938/20452938/exterior_front_driver-1774714542364.jpg> (referer: None)
2026-03-29 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2938/20452938/exterior_rear_driver-1774714563102.jpg> (referer: None)
2026-03-29 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2938/20452938/docs_service_history-1774715499643.jpg?ixlib=js-3.8.0&auto=format&s=f5da5e902397d2ee2bc5032f3ee4911c> (referer: None)
2026-03-29 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7209/17257209/exterior_front_passenger-1774704889731.jpg> (referer: None)
2026-03-29 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7209/17257209/exterior_rear_passenger-1774706302779.jpg> (referer: None)
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc726d0>
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62c0e66-577e-58f4-9731-f1e5d1d5dfb0/d62c0e66-577e-58f4-9731-f1e5d1d5dfb0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3618%252F20343618%252Fexterior_front_driver-1774348530241.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3618/20343618/exterior_front_driver-1774348530241.jpg saved to cache
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d62c0e66-577e-58f4-9731-f1e5d1d5dfb0
2026-03-29 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9824/18909824/interior_boot-1774708717147.jpg> (referer: None)
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d58f890>
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_801aa270-c146-5676-a200-b017b1f97547/801aa270-c146-5676-a200-b017b1f97547_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2938%252F20452938%252Fexterior_front_driver-1774714542364.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2938/20452938/exterior_front_driver-1774714542364.jpg saved to cache
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 801aa270-c146-5676-a200-b017b1f97547
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6086d0>
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_801aa270-c146-5676-a200-b017b1f97547/801aa270-c146-5676-a200-b017b1f97547_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2938%252F20452938%252Fexterior_rear_driver-1774714563102.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2938/20452938/exterior_rear_driver-1774714563102.jpg saved to cache
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 801aa270-c146-5676-a200-b017b1f97547
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f20f090>
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_801aa270-c146-5676-a200-b017b1f97547/801aa270-c146-5676-a200-b017b1f97547_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2938%252F20452938%252Fdocs_service_history-1774715499643.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df5da5e902397d2ee2bc5032f3ee4911c') HTTP/1.1" 204 0
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2938/20452938/docs_service_history-1774715499643.jpg?ixlib=js-3.8.0&auto=format&s=f5da5e902397d2ee2bc5032f3ee4911c saved to cache
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 801aa270-c146-5676-a200-b017b1f97547
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f355309d0>
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c672da-3062-5530-8f58-dd6672d0ab7d/f6c672da-3062-5530-8f58-dd6672d0ab7d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7209%252F17257209%252Fexterior_front_passenger-1774704889731.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7209/17257209/exterior_front_passenger-1774704889731.jpg saved to cache
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6c672da-3062-5530-8f58-dd6672d0ab7d
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f20d810>
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c672da-3062-5530-8f58-dd6672d0ab7d/f6c672da-3062-5530-8f58-dd6672d0ab7d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7209%252F17257209%252Fexterior_rear_passenger-1774706302779.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7209/17257209/exterior_rear_passenger-1774706302779.jpg saved to cache
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6c672da-3062-5530-8f58-dd6672d0ab7d
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5917/19925917/docs_service_history-1774621204756.png?ixlib=js-3.8.0&auto=format&s=c56baa5ae0fe9b90ec1cc55576a49c03> (referer: None)
2026-03-29 20:05:41 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (16777780) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5917/19925917/interior_rear_seats-1774534410046.jpg>.
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=108&page=3&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f62e7d0>
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4708f380-ef8e-51e0-84e0-924017bca348/4708f380-ef8e-51e0-84e0-924017bca348_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9824%252F18909824%252Finterior_boot-1774708717147.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9824/18909824/interior_boot-1774708717147.jpg saved to cache
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4708f380-ef8e-51e0-84e0-924017bca348
2026-03-29 20:05:41 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:05:41 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-29 20:05:41 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-29 20:05:41 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-29 20:05:41 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 56446
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd147d0>
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abafba5e-306d-5a79-bc88-57f92371fe28/abafba5e-306d-5a79-bc88-57f92371fe28_image_9.png HTTP/1.1" 201 0
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5917%252F19925917%252Fdocs_service_history-1774621204756.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc56baa5ae0fe9b90ec1cc55576a49c03') HTTP/1.1" 204 0
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5917/19925917/docs_service_history-1774621204756.png?ixlib=js-3.8.0&auto=format&s=c56baa5ae0fe9b90ec1cc55576a49c03 saved to cache
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item abafba5e-306d-5a79-bc88-57f92371fe28
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20449304
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 17481408
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20476083
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20450250
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20443071
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20263862
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20476478
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20477592
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 19952830
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719952830%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [motorway.uk] INFO: Scrape type for 19952830: 1
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 19845582
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719845582%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [motorway.uk] INFO: Scrape type for 19845582: 1
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20231987.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20485961
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 19583490
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20485937
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20431432
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20420321
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 19097531
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719097531%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [motorway.uk] INFO: Scrape type for 19097531: 1
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20491041
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491041%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [motorway.uk] INFO: Scrape type for 20491041: 1
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 15524366
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20382551
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20477418
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20305532
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 18763419
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718763419%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [motorway.uk] INFO: Scrape type for 18763419: 1
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5917/19925917/exterior_rear_passenger-1773920287277.jpg> (referer: None)
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 17680882
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717680882%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [motorway.uk] INFO: Scrape type for 17680882: 1
2026-03-29 20:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 8876821
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20413933
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 11696787
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711696787%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [motorway.uk] INFO: Scrape type for 11696787: 1
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20136196
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20500894
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20411106
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 18971390
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20311155
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20401199
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720401199%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [motorway.uk] INFO: Scrape type for 20401199: 1
2026-03-29 20:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 602f07fd-be18-576c-9c3d-2d2cd6996f34 with identifier: 20231987
2026-03-29 20:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 602f07fd-be18-576c-9c3d-2d2cd6996f34 with scrape type 1
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 602f07fd-be18-576c-9c3d-2d2cd6996f34
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1987%252F20231987%252Fexterior_front_driver-1773316499157.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1987/20231987/exterior_front_driver-1773316499157.jpg already downloaded
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1987%252F20231987%252Fexterior_rear_driver-1773316509103.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1987/20231987/exterior_rear_driver-1773316509103.jpg already downloaded
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1987%252F20231987%252Fexterior_front_passenger-1773316532574.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1987/20231987/exterior_front_passenger-1773316532574.jpg already downloaded
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1987%252F20231987%252Fexterior_rear_passenger-1773316518783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1987/20231987/exterior_rear_passenger-1773316518783.jpg already downloaded
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1987%252F20231987%252Finterior_front_seats-1773317234053.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1987/20231987/interior_front_seats-1773317234053.jpg already downloaded
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1987%252F20231987%252Finterior_rear_seats-1773317185338.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1987/20231987/interior_rear_seats-1773317185338.jpg already downloaded
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1987%252F20231987%252Finterior_dashboard-1774614599179.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1987/20231987/interior_dashboard-1774614599179.jpg not downloaded yet
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 16449198
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20386812
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720386812%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [motorway.uk] INFO: Scrape type for 20386812: 1
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1987%252F20231987%252Finstrument_cluster-1773317025359.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1987/20231987/instrument_cluster-1773317025359.jpg already downloaded
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1987%252F20231987%252Finterior_boot-1774614611412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1987/20231987/interior_boot-1774614611412.jpg not downloaded yet
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 20464629
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720464629%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [motorway.uk] INFO: Scrape type for 20464629: 1
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7209/17257209/instrument_cluster-1774705434721.jpg> (referer: None)
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1987%252F20231987%252Fdocs_service_history-1773317369747.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D348bd6fdda62ef98adc9b037a311dbb7%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1987/20231987/docs_service_history-1773317369747.jpg?ixlib=js-3.8.0&auto=format&s=348bd6fdda62ef98adc9b037a311dbb7 already downloaded
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daddc50>
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abafba5e-306d-5a79-bc88-57f92371fe28/abafba5e-306d-5a79-bc88-57f92371fe28_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5917%252F19925917%252Fexterior_rear_passenger-1773920287277.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5917/19925917/exterior_rear_passenger-1773920287277.jpg saved to cache
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item abafba5e-306d-5a79-bc88-57f92371fe28
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5917/19925917/interior_dashboard-1774629387668.jpg> (referer: None)
2026-03-29 20:05:41 [motorway.uk] INFO: Found listing with ID: 13048174
2026-03-29 20:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daf0bd0>
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c672da-3062-5530-8f58-dd6672d0ab7d/f6c672da-3062-5530-8f58-dd6672d0ab7d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7209%252F17257209%252Finstrument_cluster-1774705434721.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7209/17257209/instrument_cluster-1774705434721.jpg saved to cache
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6c672da-3062-5530-8f58-dd6672d0ab7d
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a73d0>
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abafba5e-306d-5a79-bc88-57f92371fe28/abafba5e-306d-5a79-bc88-57f92371fe28_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5917%252F19925917%252Finterior_dashboard-1774629387668.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5917/19925917/interior_dashboard-1774629387668.jpg saved to cache
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item abafba5e-306d-5a79-bc88-57f92371fe28
2026-03-29 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20458099.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5917/19925917/interior_boot-1774629665189.jpg> (referer: None)
2026-03-29 20:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5917/19925917/exterior_front_passenger-1773920439968.jpg> (referer: None)
2026-03-29 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7209/17257209/interior_boot-1774706405927.jpg> (referer: None)
2026-03-29 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7209/17257209/damage_scratches-1774704958590.jpg> (referer: None)
2026-03-29 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5917/19925917/interior_front_seats-1774693738023.jpg> (referer: None)
2026-03-29 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5917/19925917/instrument_cluster-1774629511961.jpg> (referer: None)
2026-03-29 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10230435.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 063ef592-6005-5ac4-adb9-c995ec091f6f with identifier: 20458099
2026-03-29 20:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063ef592-6005-5ac4-adb9-c995ec091f6f with scrape type 1
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 063ef592-6005-5ac4-adb9-c995ec091f6f
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20458099%252Fexterior_front_driver-1774718895223.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20458099/exterior_front_driver-1774718895223.jpg not downloaded yet
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20458099%252Fexterior_rear_driver-1774776068296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20458099/exterior_rear_driver-1774776068296.jpg not downloaded yet
2026-03-29 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489985.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20458099%252Fexterior_front_passenger-1774718948790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20458099/exterior_front_passenger-1774718948790.jpg not downloaded yet
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 22 - Data Location: 86 - value: b'Galaxy A14\x00'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 46 - Data Location: 97 - value: b'2026:03:26 13:50:57\x00'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00}'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x01w'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 117 - value: b'samsung\x00'
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f623c10>
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abafba5e-306d-5a79-bc88-57f92371fe28/abafba5e-306d-5a79-bc88-57f92371fe28_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5917%252F19925917%252Finterior_boot-1774629665189.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5917/19925917/interior_boot-1774629665189.jpg saved to cache
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item abafba5e-306d-5a79-bc88-57f92371fe28
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9bb990>
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abafba5e-306d-5a79-bc88-57f92371fe28/abafba5e-306d-5a79-bc88-57f92371fe28_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5917%252F19925917%252Fexterior_front_passenger-1773920439968.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5917/19925917/exterior_front_passenger-1773920439968.jpg saved to cache
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item abafba5e-306d-5a79-bc88-57f92371fe28
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc75a90>
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c672da-3062-5530-8f58-dd6672d0ab7d/f6c672da-3062-5530-8f58-dd6672d0ab7d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7209%252F17257209%252Finterior_boot-1774706405927.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7209/17257209/interior_boot-1774706405927.jpg saved to cache
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6c672da-3062-5530-8f58-dd6672d0ab7d
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8099%252F20458099%252Fexterior_rear_passenger-1774776120370.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8099/20458099/exterior_rear_passenger-1774776120370.jpg not downloaded yet
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1bf4d0>
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c672da-3062-5530-8f58-dd6672d0ab7d/f6c672da-3062-5530-8f58-dd6672d0ab7d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7209%252F17257209%252Fdamage_scratches-1774704958590.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7209/17257209/damage_scratches-1774704958590.jpg saved to cache
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6c672da-3062-5530-8f58-dd6672d0ab7d
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 22 - Data Location: 86 - value: b'Galaxy A14\x00'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 46 - Data Location: 97 - value: b'2026:03:23 16:04:52\x00'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00}'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x01w'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 117 - value: b'samsung\x00'
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f4312b090>
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abafba5e-306d-5a79-bc88-57f92371fe28/abafba5e-306d-5a79-bc88-57f92371fe28_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5917%252F19925917%252Finterior_front_seats-1774693738023.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5917/19925917/interior_front_seats-1774693738023.jpg saved to cache
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item abafba5e-306d-5a79-bc88-57f92371fe28
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 22 - Data Location: 86 - value: b'Galaxy A14\x00'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 46 - Data Location: 97 - value: b'2026:03:26 13:45:57\x00'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00}'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x01w'
2026-03-29 20:05:42 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 117 - value: b'samsung\x00'
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1e55d0>
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abafba5e-306d-5a79-bc88-57f92371fe28/abafba5e-306d-5a79-bc88-57f92371fe28_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5917%252F19925917%252Finstrument_cluster-1774629511961.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5917/19925917/instrument_cluster-1774629511961.jpg saved to cache
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item abafba5e-306d-5a79-bc88-57f92371fe28
2026-03-29 20:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 196d8474-dc37-5f3c-923f-4dad16ab7c88 with identifier: 10230435
2026-03-29 20:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 196d8474-dc37-5f3c-923f-4dad16ab7c88 with scrape type 1
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 196d8474-dc37-5f3c-923f-4dad16ab7c88
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F10230435%252Fexterior_front_driver-1774705484504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/10230435/exterior_front_driver-1774705484504.jpg not downloaded yet
2026-03-29 20:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f8b5838-d4ed-50f6-ad1e-7774f4ae648f with identifier: 20489985
2026-03-29 20:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f8b5838-d4ed-50f6-ad1e-7774f4ae648f with scrape type 1
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f8b5838-d4ed-50f6-ad1e-7774f4ae648f
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9985%252F20489985%252Fexterior_front_driver-1774709246524.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9985/20489985/exterior_front_driver-1774709246524.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8099%252F20458099%252Finterior_front_seats-1774719384682.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8099/20458099/interior_front_seats-1774719384682.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F10230435%252Fexterior_rear_driver-1774705500609.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/10230435/exterior_rear_driver-1774705500609.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9985%252F20489985%252Fexterior_rear_driver-1774709294517.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9985/20489985/exterior_rear_driver-1774709294517.jpg not downloaded yet
2026-03-29 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4217945.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8099%252F20458099%252Finterior_rear_seats-1774719400133.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8099/20458099/interior_rear_seats-1774719400133.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F10230435%252Fexterior_front_passenger-1774705526371.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/10230435/exterior_front_passenger-1774705526371.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9985%252F20489985%252Fexterior_front_passenger-1774709477798.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9985/20489985/exterior_front_passenger-1774709477798.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20458099%252Finterior_dashboard-1774719433701.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20458099/interior_dashboard-1774719433701.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F10230435%252Fexterior_rear_passenger-1774705513644.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/10230435/exterior_rear_passenger-1774705513644.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9985%252F20489985%252Fexterior_rear_passenger-1774709412792.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9985/20489985/exterior_rear_passenger-1774709412792.jpg not downloaded yet
2026-03-29 20:05:43 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5917/19925917/interior_rear_seats-1774534410046.jpg>.
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20458099%252Finstrument_cluster-1774719847864.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20458099/instrument_cluster-1774719847864.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0435%252F10230435%252Finterior_front_seats-1774705936590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0435/10230435/interior_front_seats-1774705936590.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9985%252F20489985%252Finterior_front_seats-1774710988929.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9985/20489985/interior_front_seats-1774710988929.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8099%252F20458099%252Finterior_boot-1774719446172.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8099/20458099/interior_boot-1774719446172.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0435%252F10230435%252Finterior_rear_seats-1774705953571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0435/10230435/interior_rear_seats-1774705953571.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9985%252F20489985%252Finterior_rear_seats-1774710782765.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9985/20489985/interior_rear_seats-1774710782765.jpg not downloaded yet
2026-03-29 20:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 569c1a9e-fe74-57e4-b8fd-0fcb88a1b0a8 with identifier: 4217945
2026-03-29 20:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 569c1a9e-fe74-57e4-b8fd-0fcb88a1b0a8 with scrape type 1
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 569c1a9e-fe74-57e4-b8fd-0fcb88a1b0a8
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7945%252F4217945%252Fexterior_front_driver-1774784948268.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7945/4217945/exterior_front_driver-1774784948268.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20458099%252Fwheels_front_driver-1774719034500.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20458099/wheels_front_driver-1774719034500.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F10230435%252Finterior_dashboard-1774705992579.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/10230435/interior_dashboard-1774705992579.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9985%252F20489985%252Finterior_dashboard-1774710830616.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9985/20489985/interior_dashboard-1774710830616.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7945%252F4217945%252Fexterior_rear_driver-1774784959843.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7945/4217945/exterior_rear_driver-1774784959843.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F10230435%252Finstrument_cluster-1774706028162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/10230435/instrument_cluster-1774706028162.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9985%252F20489985%252Finstrument_cluster-1774710549247.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9985/20489985/instrument_cluster-1774710549247.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7945%252F4217945%252Fexterior_front_passenger-1774784976290.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7945/4217945/exterior_front_passenger-1774784976290.jpg not downloaded yet
2026-03-29 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=144&page=4&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0435%252F10230435%252Finterior_boot-1774706037222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0435/10230435/interior_boot-1774706037222.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9985%252F20489985%252Finterior_boot-1774710913910.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9985/20489985/interior_boot-1774710913910.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7945%252F4217945%252Fexterior_rear_passenger-1774786787518.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7945/4217945/exterior_rear_passenger-1774786787518.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0435%252F10230435%252Fdamage_scratches-1774705576255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0435/10230435/damage_scratches-1774705576255.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9985%252F20489985%252Fdocs_service_history-1774712432901-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da742192528de91f3b63f4ffba8aa2e42%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9985/20489985/docs_service_history-1774712432901-1.jpeg?ixlib=js-3.8.0&auto=format&s=a742192528de91f3b63f4ffba8aa2e42 not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7945%252F4217945%252Finterior_front_seats-1774785122497.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7945/4217945/interior_front_seats-1774785122497.jpg not downloaded yet
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7945%252F4217945%252Finterior_rear_seats-1774785132530.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7945/4217945/interior_rear_seats-1774785132530.jpg not downloaded yet
2026-03-29 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18763419.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 20490005
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 6813303
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 20443922
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720443922%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [motorway.uk] INFO: Scrape type for 20443922: 1
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7945%252F4217945%252Finterior_dashboard-1774785156106.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7945/4217945/interior_dashboard-1774785156106.jpg not downloaded yet
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 20487361
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 20363550
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 9266502
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279266502%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [motorway.uk] INFO: Scrape type for 9266502: 1
2026-03-29 20:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7945%252F4217945%252Finterior_boot-1774785171738.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7945/4217945/interior_boot-1774785171738.jpg not downloaded yet
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 19877308
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 17678385
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 20457330
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 10427170
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 20496977
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 20251350
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720251350%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [motorway.uk] INFO: Scrape type for 20251350: 1
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7945%252F4217945%252Fdocs_service_history-1774786599811.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Deb944d7e3067e5e23c1226590f05fce3%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7945/4217945/docs_service_history-1774786599811.jpg?ixlib=js-3.8.0&auto=format&s=eb944d7e3067e5e23c1226590f05fce3 not downloaded yet
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 20431049
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 20500887
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 20491991
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491991%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [motorway.uk] INFO: Scrape type for 20491991: 1
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7945%252F4217945%252Fwheels_front_driver-1774784987310.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7945/4217945/wheels_front_driver-1774784987310.jpg not downloaded yet
2026-03-29 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0435/10230435/exterior_front_driver-1774705484504.jpg> (referer: None)
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 19662517
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 20437069
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 20439564
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 3925743
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 20473314
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 19289424
2026-03-29 20:05:43 [motorway.uk] INFO: Found listing with ID: 13901334
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713901334%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [motorway.uk] INFO: Scrape type for 13901334: 1
2026-03-29 20:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:44 [motorway.uk] ERROR: Error parsing details
Traceback (most recent call last):
File "/usr/src/app/crawlers/spiders/motorway.py", line 262, in parse_details
item = self._extract_listing_item(detail_data, auction_type)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 290, in _extract_listing_item
trim = self._extract_trim(detail_data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 476, in _extract_trim
.replace(model, "")
^^^^^^^^^^^^^^^^^^
TypeError: replace() argument 1 must be str, not None
2026-03-29 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20464629.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 19716040
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 19665928
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 20477540
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 20488894
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 20392952
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 20448956
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 4497838
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 20408834
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 20494023
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720494023%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [motorway.uk] INFO: Scrape type for 20494023: 1
2026-03-29 20:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 19574622
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 20483061
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483061%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [motorway.uk] INFO: Scrape type for 20483061: 1
2026-03-29 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9985/20489985/exterior_front_driver-1774709246524.jpg> (referer: None)
2026-03-29 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19952830.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1987/20231987/interior_dashboard-1774614599179.jpg> (referer: None)
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 20487257
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 19110205
2026-03-29 20:05:44 [motorway.uk] INFO: Found listing with ID: 7326413
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6d4590>
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_196d8474-dc37-5f3c-923f-4dad16ab7c88/196d8474-dc37-5f3c-923f-4dad16ab7c88_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F10230435%252Fexterior_front_driver-1774705484504.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/10230435/exterior_front_driver-1774705484504.jpg saved to cache
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 196d8474-dc37-5f3c-923f-4dad16ab7c88
2026-03-29 20:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e with identifier: 20464629
2026-03-29 20:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e with scrape type 1
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4629%252F20464629%252Fexterior_front_driver-1774693134220.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4629/20464629/exterior_front_driver-1774693134220.jpg not downloaded yet
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4629%252F20464629%252Fexterior_rear_driver-1774693152949.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4629/20464629/exterior_rear_driver-1774693152949.jpg not downloaded yet
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc94dd0>
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f8b5838-d4ed-50f6-ad1e-7774f4ae648f/8f8b5838-d4ed-50f6-ad1e-7774f4ae648f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9985%252F20489985%252Fexterior_front_driver-1774709246524.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9985/20489985/exterior_front_driver-1774709246524.jpg saved to cache
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f8b5838-d4ed-50f6-ad1e-7774f4ae648f
2026-03-29 20:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e577470-f9f8-5720-833b-da55b593b054 with identifier: 19952830
2026-03-29 20:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e577470-f9f8-5720-833b-da55b593b054 with scrape type 1
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e577470-f9f8-5720-833b-da55b593b054
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2830%252F19952830%252Fexterior_front_driver-1774620041755.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_front_driver-1774620041755.jpg not downloaded yet
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9b6f10>
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_602f07fd-be18-576c-9c3d-2d2cd6996f34/602f07fd-be18-576c-9c3d-2d2cd6996f34_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1987%252F20231987%252Finterior_dashboard-1774614599179.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1987/20231987/interior_dashboard-1774614599179.jpg saved to cache
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 602f07fd-be18-576c-9c3d-2d2cd6996f34
2026-03-29 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1987/20231987/interior_boot-1774614611412.jpg> (referer: None)
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4629%252F20464629%252Fexterior_front_passenger-1774693188457.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4629/20464629/exterior_front_passenger-1774693188457.jpg not downloaded yet
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2830%252F19952830%252Fexterior_rear_driver-1774620059950.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_rear_driver-1774620059950.jpg not downloaded yet
2026-03-29 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8099/20458099/exterior_front_passenger-1774718948790.jpg> (referer: None)
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4629%252F20464629%252Fexterior_rear_passenger-1774693164142.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4629/20464629/exterior_rear_passenger-1774693164142.jpg not downloaded yet
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2830%252F19952830%252Fexterior_front_passenger-1774620087162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_front_passenger-1774620087162.jpg not downloaded yet
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4629%252F20464629%252Finterior_front_seats-1774693517302.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4629/20464629/interior_front_seats-1774693517302.jpg not downloaded yet
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2830%252F19952830%252Fexterior_rear_passenger-1774620077887.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_rear_passenger-1774620077887.jpg not downloaded yet
2026-03-29 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7945/4217945/exterior_front_passenger-1774784976290.jpg> (referer: None)
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4629%252F20464629%252Finterior_rear_seats-1774693532820.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4629/20464629/interior_rear_seats-1774693532820.jpg not downloaded yet
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2830%252F19952830%252Finterior_front_seats-1774620335483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2830/19952830/interior_front_seats-1774620335483.jpg not downloaded yet
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db75850>
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_602f07fd-be18-576c-9c3d-2d2cd6996f34/602f07fd-be18-576c-9c3d-2d2cd6996f34_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1987%252F20231987%252Finterior_boot-1774614611412.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1987/20231987/interior_boot-1774614611412.jpg saved to cache
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 602f07fd-be18-576c-9c3d-2d2cd6996f34
2026-03-29 20:05:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 602f07fd-be18-576c-9c3d-2d2cd6996f34, skipping ID generation
2026-03-29 20:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 602f07fd-be18-576c-9c3d-2d2cd6996f34 with scrape type 1
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 602f07fd-be18-576c-9c3d-2d2cd6996f34 sending to next pipeline
2026-03-29 20:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 602f07fd-be18-576c-9c3d-2d2cd6996f34, identifier: 20231987
2026-03-29 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8099/20458099/exterior_rear_driver-1774776068296.jpg> (referer: None)
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4629%252F20464629%252Finterior_dashboard-1774693684691.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4629/20464629/interior_dashboard-1774693684691.jpg not downloaded yet
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2830%252F19952830%252Finterior_dashboard-1774620395360.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2830/19952830/interior_dashboard-1774620395360.jpg not downloaded yet
2026-03-29 20:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 602f07fd-be18-576c-9c3d-2d2cd6996f34 with identifier: 20231987
2026-03-29 20:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 602f07fd-be18-576c-9c3d-2d2cd6996f34 with identifier: 20231987
2026-03-29 20:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 602f07fd-be18-576c-9c3d-2d2cd6996f34 with identifier: 20231987 to the API
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/1987/20231987/interior_boot-1774614611412.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '602f07fd-be18-576c-9c3d-2d2cd6996f34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'NY68 MWF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20231987',
'listing': 'auction',
'location': 'Surrey Woking',
'make': 'BMW',
'model': 'X3',
'odometer': 41100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db48ca5-51a4-5d2b-9c76-5119e2d5831c/4db48ca5-51a4-5d2b-9c76-5119e2d5831c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1775723,
'Height': 2348,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1987/20231987/exterior_front_driver-1773316499157.jpg',
'Width': 3131},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db48ca5-51a4-5d2b-9c76-5119e2d5831c/4db48ca5-51a4-5d2b-9c76-5119e2d5831c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1925686,
'Height': 2629,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1987/20231987/exterior_rear_driver-1773316509103.jpg',
'Width': 3505},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db48ca5-51a4-5d2b-9c76-5119e2d5831c/4db48ca5-51a4-5d2b-9c76-5119e2d5831c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1068513,
'Height': 2138,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1987/20231987/exterior_front_passenger-1773316532574.jpg',
'Width': 2850},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db48ca5-51a4-5d2b-9c76-5119e2d5831c/4db48ca5-51a4-5d2b-9c76-5119e2d5831c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1964705,
'Height': 2685,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1987/20231987/exterior_rear_passenger-1773316518783.jpg',
'Width': 3580},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db48ca5-51a4-5d2b-9c76-5119e2d5831c/4db48ca5-51a4-5d2b-9c76-5119e2d5831c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3989458,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1987/20231987/interior_front_seats-1773317234053.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db48ca5-51a4-5d2b-9c76-5119e2d5831c/4db48ca5-51a4-5d2b-9c76-5119e2d5831c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3210275,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1987/20231987/interior_rear_seats-1773317185338.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_602f07fd-be18-576c-9c3d-2d2cd6996f34/602f07fd-be18-576c-9c3d-2d2cd6996f34_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2417410,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1987/20231987/interior_dashboard-1774614599179.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db48ca5-51a4-5d2b-9c76-5119e2d5831c/4db48ca5-51a4-5d2b-9c76-5119e2d5831c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2980494,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1987/20231987/instrument_cluster-1773317025359.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_602f07fd-be18-576c-9c3d-2d2cd6996f34/602f07fd-be18-576c-9c3d-2d2cd6996f34_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3064332,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1987/20231987/interior_boot-1774614611412.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4db48ca5-51a4-5d2b-9c76-5119e2d5831c/4db48ca5-51a4-5d2b-9c76-5119e2d5831c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5042160,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1987/20231987/docs_service_history-1773317369747.jpg?ixlib=js-3.8.0&auto=format&s=348bd6fdda62ef98adc9b037a311dbb7',
'Width': 4032}],
'price': 27448,
'price_includes_vat': False,
'registration_date': '2019-01-21',
'seats_number': None,
'seller_name': None,
'title': 'BMW X3 M40D Auto',
'transmission': 'automatic',
'trim': 'M40D Auto',
'vin': 'WBATX92050LC52948',
'year': 2019}
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720231987%27 HTTP/1.1" 200 None
2026-03-29 20:05:45 [motorway.uk] INFO: Saving data for 20231987: {'created_time': 1774814745.770011, 'last_price_update_time': 1774814745.770022, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20231987') HTTP/1.1" 204 0
2026-03-29 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8099/20458099/exterior_front_driver-1774718895223.jpg> (referer: None)
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6ac790>
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063ef592-6005-5ac4-adb9-c995ec091f6f/063ef592-6005-5ac4-adb9-c995ec091f6f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20458099%252Fexterior_front_passenger-1774718948790.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20458099/exterior_front_passenger-1774718948790.jpg saved to cache
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 063ef592-6005-5ac4-adb9-c995ec091f6f
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4629%252F20464629%252Finstrument_cluster-1774693604656.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4629/20464629/instrument_cluster-1774693604656.jpg not downloaded yet
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2830%252F19952830%252Finterior_boot-1774620382477.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2830/19952830/interior_boot-1774620382477.jpg not downloaded yet
2026-03-29 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20386812.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4629%252F20464629%252Finterior_boot-1774693625881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4629/20464629/interior_boot-1774693625881.jpg not downloaded yet
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2830%252F19952830%252Fdocs_service_history-1774620645382.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D50eac9b2fe51c03e1cd454b8cb3a6776%27 HTTP/1.1" 200 None
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2830/19952830/docs_service_history-1774620645382.jpg?ixlib=js-3.8.0&auto=format&s=50eac9b2fe51c03e1cd454b8cb3a6776 not downloaded yet
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d944f50>
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569c1a9e-fe74-57e4-b8fd-0fcb88a1b0a8/569c1a9e-fe74-57e4-b8fd-0fcb88a1b0a8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7945%252F4217945%252Fexterior_front_passenger-1774784976290.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7945/4217945/exterior_front_passenger-1774784976290.jpg saved to cache
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 569c1a9e-fe74-57e4-b8fd-0fcb88a1b0a8
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6e7a50>
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063ef592-6005-5ac4-adb9-c995ec091f6f/063ef592-6005-5ac4-adb9-c995ec091f6f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20458099%252Fexterior_rear_driver-1774776068296.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20458099/exterior_rear_driver-1774776068296.jpg saved to cache
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 063ef592-6005-5ac4-adb9-c995ec091f6f
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dda4d50>
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063ef592-6005-5ac4-adb9-c995ec091f6f/063ef592-6005-5ac4-adb9-c995ec091f6f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20458099%252Fexterior_front_driver-1774718895223.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20458099/exterior_front_driver-1774718895223.jpg saved to cache
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 063ef592-6005-5ac4-adb9-c995ec091f6f
2026-03-29 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8099/20458099/interior_front_seats-1774719384682.jpg> (referer: None)
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4629%252F20464629%252Fdocs_service_history-1774694400443.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D03a98552bbbd5cf3e0822dcdc34eb37c%27 HTTP/1.1" 200 None
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4629/20464629/docs_service_history-1774694400443.jpg?ixlib=js-3.8.0&auto=format&s=03a98552bbbd5cf3e0822dcdc34eb37c not downloaded yet
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2830%252F19952830%252Fdocs_service_history-1774701063464.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8a93fd9e30923563d897e6b26297cece%27 HTTP/1.1" 200 None
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2830/19952830/docs_service_history-1774701063464.jpg?ixlib=js-3.8.0&auto=format&s=8a93fd9e30923563d897e6b26297cece not downloaded yet
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2830%252F19952830%252Fdocs_service_history-1774701063056.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D170d7e2e0711e9bdc950f8ee3cfad6e4%27 HTTP/1.1" 200 None
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2830/19952830/docs_service_history-1774701063056.jpg?ixlib=js-3.8.0&auto=format&s=170d7e2e0711e9bdc950f8ee3cfad6e4 not downloaded yet
2026-03-29 20:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b9603c8-21a7-5fb0-b716-5c5200a795de with identifier: 20386812
2026-03-29 20:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b9603c8-21a7-5fb0-b716-5c5200a795de with scrape type 1
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b9603c8-21a7-5fb0-b716-5c5200a795de
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6812%252F20386812%252Fexterior_front_driver-1774457820964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_front_driver-1774457820964.jpg not downloaded yet
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6812%252F20386812%252Fexterior_rear_driver-1774457831904.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_rear_driver-1774457831904.jpg not downloaded yet
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6812%252F20386812%252Fexterior_front_passenger-1774457861554.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_front_passenger-1774457861554.jpg not downloaded yet
2026-03-29 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8099/20458099/exterior_rear_passenger-1774776120370.jpg> (referer: None)
2026-03-29 20:05:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5cc790>
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063ef592-6005-5ac4-adb9-c995ec091f6f/063ef592-6005-5ac4-adb9-c995ec091f6f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8099%252F20458099%252Finterior_front_seats-1774719384682.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8099/20458099/interior_front_seats-1774719384682.jpg saved to cache
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 063ef592-6005-5ac4-adb9-c995ec091f6f
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6812%252F20386812%252Fexterior_rear_passenger-1774457866498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_rear_passenger-1774457866498.jpg not downloaded yet
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6812%252F20386812%252Finterior_front_seats-1774458118955.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6812/20386812/interior_front_seats-1774458118955.jpg not downloaded yet
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc9a2d0>
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063ef592-6005-5ac4-adb9-c995ec091f6f/063ef592-6005-5ac4-adb9-c995ec091f6f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8099%252F20458099%252Fexterior_rear_passenger-1774776120370.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8099/20458099/exterior_rear_passenger-1774776120370.jpg saved to cache
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 063ef592-6005-5ac4-adb9-c995ec091f6f
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6812%252F20386812%252Finterior_rear_seats-1774458130794.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6812/20386812/interior_rear_seats-1774458130794.jpg not downloaded yet
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6812%252F20386812%252Finterior_dashboard-1774458166887.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6812/20386812/interior_dashboard-1774458166887.jpg not downloaded yet
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6812%252F20386812%252Finstrument_cluster-1774458213167.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6812/20386812/instrument_cluster-1774458213167.jpg not downloaded yet
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6812%252F20386812%252Finterior_boot-1774458181405.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6812/20386812/interior_boot-1774458181405.jpg not downloaded yet
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6812%252F20386812%252Fdocs_service_history-1774458308273.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3d5338c24b7a64488bb168976e924d50%27 HTTP/1.1" 200 None
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6812/20386812/docs_service_history-1774458308273.jpg?ixlib=js-3.8.0&auto=format&s=3d5338c24b7a64488bb168976e924d50 not downloaded yet
2026-03-29 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2830/19952830/docs_service_history-1774620645382.jpg?ixlib=js-3.8.0&auto=format&s=50eac9b2fe51c03e1cd454b8cb3a6776> (referer: None)
2026-03-29 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5917/19925917/interior_rear_seats-1774534410046.jpg> (referer: None)
2026-03-29 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4629/20464629/instrument_cluster-1774693604656.jpg> (referer: None)
2026-03-29 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4629/20464629/interior_dashboard-1774693684691.jpg> (referer: None)
2026-03-29 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4629/20464629/interior_boot-1774693625881.jpg> (referer: None)
2026-03-29 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2830/19952830/interior_boot-1774620382477.jpg> (referer: None)
2026-03-29 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2830/19952830/interior_front_seats-1774620335483.jpg> (referer: None)
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6a1390>
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2830%252F19952830%252Fdocs_service_history-1774620645382.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D50eac9b2fe51c03e1cd454b8cb3a6776') HTTP/1.1" 204 0
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2830/19952830/docs_service_history-1774620645382.jpg?ixlib=js-3.8.0&auto=format&s=50eac9b2fe51c03e1cd454b8cb3a6776 saved to cache
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e577470-f9f8-5720-833b-da55b593b054
2026-03-29 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20443922.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=180&page=5&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 22 - Data Location: 86 - value: b'Galaxy A14\x00'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 46 - Data Location: 97 - value: b'2026:03:23 16:05:48\x00'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00}'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x01w'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 117 - value: b'samsung\x00'
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f293950>
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abafba5e-306d-5a79-bc88-57f92371fe28/abafba5e-306d-5a79-bc88-57f92371fe28_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5917%252F19925917%252Finterior_rear_seats-1774534410046.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5917/19925917/interior_rear_seats-1774534410046.jpg saved to cache
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item abafba5e-306d-5a79-bc88-57f92371fe28
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daad2d0>
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e/2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4629%252F20464629%252Finstrument_cluster-1774693604656.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4629/20464629/instrument_cluster-1774693604656.jpg saved to cache
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daaff50>
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e/2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4629%252F20464629%252Finterior_dashboard-1774693684691.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4629/20464629/interior_dashboard-1774693684691.jpg saved to cache
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5bc0d0>
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e/2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4629%252F20464629%252Finterior_boot-1774693625881.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4629/20464629/interior_boot-1774693625881.jpg saved to cache
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f268290>
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2830%252F19952830%252Finterior_boot-1774620382477.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2830/19952830/interior_boot-1774620382477.jpg saved to cache
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e577470-f9f8-5720-833b-da55b593b054
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5dba90>
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2830%252F19952830%252Finterior_front_seats-1774620335483.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2830/19952830/interior_front_seats-1774620335483.jpg saved to cache
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e577470-f9f8-5720-833b-da55b593b054
2026-03-29 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13901334.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20491991.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13c719db-cdd4-5429-a547-8a96c04809e4 with identifier: 20443922
2026-03-29 20:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13c719db-cdd4-5429-a547-8a96c04809e4 with scrape type 1
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13c719db-cdd4-5429-a547-8a96c04809e4
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3922%252F20443922%252Fexterior_front_driver-1774463240229.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_front_driver-1774463240229.jpeg not downloaded yet
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 12933192
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 19413644
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20447824
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720447824%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [motorway.uk] INFO: Scrape type for 20447824: 1
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3922%252F20443922%252Fexterior_rear_driver-1774463268875.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_rear_driver-1774463268875.jpeg not downloaded yet
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20458673
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20493712
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 19203575
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20421091
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 13065298
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 18832352
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718832352%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [motorway.uk] INFO: Scrape type for 18832352: 1
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3922%252F20443922%252Fexterior_front_passenger-1774463252640.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_front_passenger-1774463252640.jpeg not downloaded yet
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 19439933
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20275909
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20423182
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20445222
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20488693
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 19816072
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20478238
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 13689897
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20446195
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 17461058
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20421275
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 3909564
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 19490864
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 18327972
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718327972%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [motorway.uk] INFO: Scrape type for 18327972: 1
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3922%252F20443922%252Fexterior_rear_passenger-1774463261526.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_rear_passenger-1774463261526.jpeg not downloaded yet
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20286049
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720286049%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [motorway.uk] INFO: Scrape type for 20286049: 1
2026-03-29 20:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d00239a4-ecd0-5549-9dff-a6bfb357faaf with identifier: 13901334
2026-03-29 20:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d00239a4-ecd0-5549-9dff-a6bfb357faaf with scrape type 1
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d00239a4-ecd0-5549-9dff-a6bfb357faaf
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1334%252F13901334%252F13901334-exterior_front_driver-modified-1774716752738.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1334/13901334/13901334-exterior_front_driver-modified-1774716752738.jpeg not downloaded yet
2026-03-29 20:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d95b7a08-d44c-53f7-9d91-61d67051e0d4 with identifier: 20491991
2026-03-29 20:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d95b7a08-d44c-53f7-9d91-61d67051e0d4 with scrape type 1
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d95b7a08-d44c-53f7-9d91-61d67051e0d4
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1991%252F20491991%252Fexterior_front_driver-1774715717587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_front_driver-1774715717587.jpg not downloaded yet
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3922%252F20443922%252Finterior_front_seats-1774463390713.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3922/20443922/interior_front_seats-1774463390713.jpeg not downloaded yet
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 4371469
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274371469%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [motorway.uk] INFO: Scrape type for 4371469: 1
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1334%252F13901334%252Fexterior_rear_driver-1774708246178.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1334/13901334/exterior_rear_driver-1774708246178.jpg not downloaded yet
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1991%252F20491991%252Fexterior_rear_driver-1774715684780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_rear_driver-1774715684780.jpg not downloaded yet
2026-03-29 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20494023.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20483061.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3922%252F20443922%252Finterior_rear_seats-1774463335392.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3922/20443922/interior_rear_seats-1774463335392.jpeg not downloaded yet
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20404359
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 9314864
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20489620
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 18663443
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718663443%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [motorway.uk] INFO: Scrape type for 18663443: 1
2026-03-29 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2830/19952830/docs_service_history-1774701063056.jpg?ixlib=js-3.8.0&auto=format&s=170d7e2e0711e9bdc950f8ee3cfad6e4> (referer: None)
2026-03-29 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2830/19952830/docs_service_history-1774701063464.jpg?ixlib=js-3.8.0&auto=format&s=8a93fd9e30923563d897e6b26297cece> (referer: None)
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1334%252F13901334%252Fexterior_front_passenger-1774708200498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1334/13901334/exterior_front_passenger-1774708200498.jpg not downloaded yet
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1991%252F20491991%252Fexterior_front_passenger-1774715696367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_front_passenger-1774715696367.jpg not downloaded yet
2026-03-29 20:05:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3922%252F20443922%252F20443922-interior_dashboard-modified-1774502138690.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3922/20443922/20443922-interior_dashboard-modified-1774502138690.jpeg not downloaded yet
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 18821611
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 5937182
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 19115404
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20341600
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 19718816
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 19360225
2026-03-29 20:05:48 [motorway.uk] INFO: Found listing with ID: 20098323
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1334%252F13901334%252Fexterior_rear_passenger-1774708229912.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1334/13901334/exterior_rear_passenger-1774708229912.jpg not downloaded yet
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1991%252F20491991%252Fexterior_rear_passenger-1774715674579.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_rear_passenger-1774715674579.jpg not downloaded yet
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3922%252F20443922%252Finterior_boot-1774463368099.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3922/20443922/interior_boot-1774463368099.jpeg not downloaded yet
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1334%252F13901334%252Finterior_front_seats-1774709268520.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1334/13901334/interior_front_seats-1774709268520.jpg not downloaded yet
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1991%252F20491991%252Finterior_front_seats-1774716725866.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1991/20491991/interior_front_seats-1774716725866.jpg not downloaded yet
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3922%252F20443922%252Fdocs_service_history-1774519500397.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D12625e03d580e774ebafa6671adece73%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3922/20443922/docs_service_history-1774519500397.jpeg?ixlib=js-3.8.0&auto=format&s=12625e03d580e774ebafa6671adece73 not downloaded yet
2026-03-29 20:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf435ec2-92ed-56f8-b3a9-c49605e5b5cc with identifier: 20494023
2026-03-29 20:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc with scrape type 1
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4023%252F20494023%252Fexterior_front_driver-1774721526377.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4023/20494023/exterior_front_driver-1774721526377.jpg not downloaded yet
2026-03-29 20:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28efa075-4bbf-54e9-8402-f60c3dbac7e6 with identifier: 20483061
2026-03-29 20:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6 with scrape type 1
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3061%252F20483061%252Fexterior_front_driver-1774687141853.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3061/20483061/exterior_front_driver-1774687141853.jpg not downloaded yet
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f435910>
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2830%252F19952830%252Fdocs_service_history-1774701063056.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D170d7e2e0711e9bdc950f8ee3cfad6e4') HTTP/1.1" 204 0
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2830/19952830/docs_service_history-1774701063056.jpg?ixlib=js-3.8.0&auto=format&s=170d7e2e0711e9bdc950f8ee3cfad6e4 saved to cache
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e577470-f9f8-5720-833b-da55b593b054
2026-03-29 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d109990>
2026-03-29 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2830%252F19952830%252Fdocs_service_history-1774701063464.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8a93fd9e30923563d897e6b26297cece') HTTP/1.1" 204 0
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2830/19952830/docs_service_history-1774701063464.jpg?ixlib=js-3.8.0&auto=format&s=8a93fd9e30923563d897e6b26297cece saved to cache
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e577470-f9f8-5720-833b-da55b593b054
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1334%252F13901334%252Finterior_rear_seats-1774708755718.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1334/13901334/interior_rear_seats-1774708755718.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1991%252F20491991%252F20491991-interior_dashboard-modified-1774777640495.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1991/20491991/20491991-interior_dashboard-modified-1774777640495.jpeg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3922%252F20443922%252Fdocs_service_history-1774519500456.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbf57e28bd4f698bd2ed842e780a19f1f%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3922/20443922/docs_service_history-1774519500456.jpeg?ixlib=js-3.8.0&auto=format&s=bf57e28bd4f698bd2ed842e780a19f1f not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4023%252F20494023%252Fexterior_rear_driver-1774721547311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4023/20494023/exterior_rear_driver-1774721547311.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3061%252F20483061%252Fexterior_rear_driver-1774687188560.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3061/20483061/exterior_rear_driver-1774687188560.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1334%252F13901334%252F13901334-interior_dashboard-modified-1774716803389.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1334/13901334/13901334-interior_dashboard-modified-1774716803389.jpeg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1991%252F20491991%252F20491991-instrument_cluster-modified-1774777623267.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1991/20491991/20491991-instrument_cluster-modified-1774777623267.jpeg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4023%252F20494023%252Fexterior_front_passenger-1774782568120.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4023/20494023/exterior_front_passenger-1774782568120.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3061%252F20483061%252Fexterior_front_passenger-1774689264109.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3061/20483061/exterior_front_passenger-1774689264109.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1334%252F13901334%252F13901334-instrument_cluster-modified-1774716816019.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1334/13901334/13901334-instrument_cluster-modified-1774716816019.jpeg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1991%252F20491991%252Finterior_boot-1774716674835.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1991/20491991/interior_boot-1774716674835.jpg not downloaded yet
2026-03-29 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_rear_passenger-1774457866498.jpg> (referer: None)
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4023%252F20494023%252Fexterior_rear_passenger-1774721561011.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4023/20494023/exterior_rear_passenger-1774721561011.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3061%252F20483061%252Fexterior_rear_passenger-1774687219485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3061/20483061/exterior_rear_passenger-1774687219485.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1334%252F13901334%252Finterior_boot-1774707629277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1334/13901334/interior_boot-1774707629277.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1991%252F20491991%252Fdocs_service_history-1774718469307.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc2a2c1d6d4819029b808ed1a9c674486%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1991/20491991/docs_service_history-1774718469307.jpg?ixlib=js-3.8.0&auto=format&s=c2a2c1d6d4819029b808ed1a9c674486 not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4023%252F20494023%252Finterior_front_seats-1774782610388.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4023/20494023/interior_front_seats-1774782610388.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3061%252F20483061%252Finterior_front_seats-1774689253261.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3061/20483061/interior_front_seats-1774689253261.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F1334%252F13901334%252F13901334-docs_service_history-default-1737534907474.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df1fbf5c7399ad16c89500f425a4222e9%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/1334/13901334/13901334-docs_service_history-default-1737534907474.jpg?ixlib=js-3.8.0&auto=format&s=f1fbf5c7399ad16c89500f425a4222e9 not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1991%252F20491991%252Fdamage_scratches-1774715890875.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1991/20491991/damage_scratches-1774715890875.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4023%252F20494023%252Finterior_rear_seats-1774722146991.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4023/20494023/interior_rear_seats-1774722146991.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3061%252F20483061%252Finterior_rear_seats-1774689241222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3061/20483061/interior_rear_seats-1774689241222.jpg not downloaded yet
2026-03-29 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1c1590>
2026-03-29 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6812%252F20386812%252Fexterior_rear_passenger-1774457866498.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_rear_passenger-1774457866498.jpg saved to cache
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b9603c8-21a7-5fb0-b716-5c5200a795de
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4023%252F20494023%252Finterior_dashboard-1774782020584.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4023/20494023/interior_dashboard-1774782020584.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3061%252F20483061%252Finterior_dashboard-1774689229034.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3061/20483061/interior_dashboard-1774689229034.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4023%252F20494023%252Finstrument_cluster-1774722227357.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4023/20494023/instrument_cluster-1774722227357.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3061%252F20483061%252Finterior_boot-1774688027394.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3061/20483061/interior_boot-1774688027394.jpg not downloaded yet
2026-03-29 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_rear_driver-1774457831904.jpg> (referer: None)
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4023%252F20494023%252Finterior_boot-1774722312762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4023/20494023/interior_boot-1774722312762.jpg not downloaded yet
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3061%252F20483061%252Fdamage_scratches-1774687522190.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3061/20483061/damage_scratches-1774687522190.jpg not downloaded yet
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2830/19952830/interior_dashboard-1774620395360.jpg> (referer: None)
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6812/20386812/docs_service_history-1774458308273.jpg?ixlib=js-3.8.0&auto=format&s=3d5338c24b7a64488bb168976e924d50> (referer: None)
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4023%252F20494023%252Fwheels_front_driver-1774721605041.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4023/20494023/wheels_front_driver-1774721605041.jpg not downloaded yet
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3061%252F20483061%252Fdamage_scratches-1774687641043.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3061/20483061/damage_scratches-1774687641043.jpg not downloaded yet
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6812/20386812/interior_dashboard-1774458166887.jpg> (referer: None)
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_front_driver-1774457820964.jpg> (referer: None)
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_front_passenger-1774457861554.jpg> (referer: None)
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1334/13901334/exterior_rear_driver-1774708246178.jpg> (referer: None)
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3e3210>
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6812%252F20386812%252Fexterior_rear_driver-1774457831904.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_rear_driver-1774457831904.jpg saved to cache
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b9603c8-21a7-5fb0-b716-5c5200a795de
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6812/20386812/instrument_cluster-1774458213167.jpg> (referer: None)
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4bb950>
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2830%252F19952830%252Finterior_dashboard-1774620395360.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2830/19952830/interior_dashboard-1774620395360.jpg saved to cache
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e577470-f9f8-5720-833b-da55b593b054
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8ee990>
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6812%252F20386812%252Fdocs_service_history-1774458308273.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3d5338c24b7a64488bb168976e924d50') HTTP/1.1" 204 0
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6812/20386812/docs_service_history-1774458308273.jpg?ixlib=js-3.8.0&auto=format&s=3d5338c24b7a64488bb168976e924d50 saved to cache
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b9603c8-21a7-5fb0-b716-5c5200a795de
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1bff50>
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6812%252F20386812%252Finterior_dashboard-1774458166887.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6812/20386812/interior_dashboard-1774458166887.jpg saved to cache
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b9603c8-21a7-5fb0-b716-5c5200a795de
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d63d690>
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6812%252F20386812%252Fexterior_front_driver-1774457820964.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_front_driver-1774457820964.jpg saved to cache
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b9603c8-21a7-5fb0-b716-5c5200a795de
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1bfed0>
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6812%252F20386812%252Fexterior_front_passenger-1774457861554.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_front_passenger-1774457861554.jpg saved to cache
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b9603c8-21a7-5fb0-b716-5c5200a795de
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_rear_driver-1774715684780.jpg> (referer: None)
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db6b0d0>
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1334%252F13901334%252Fexterior_rear_driver-1774708246178.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1334/13901334/exterior_rear_driver-1774708246178.jpg saved to cache
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d00239a4-ecd0-5549-9dff-a6bfb357faaf
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6812/20386812/interior_rear_seats-1774458130794.jpg> (referer: None)
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c818090>
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6812%252F20386812%252Finstrument_cluster-1774458213167.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6812/20386812/instrument_cluster-1774458213167.jpg saved to cache
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b9603c8-21a7-5fb0-b716-5c5200a795de
2026-03-29 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3922/20443922/interior_front_seats-1774463390713.jpeg> (referer: None)
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db4ae10>
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1991%252F20491991%252Fexterior_rear_driver-1774715684780.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_rear_driver-1774715684780.jpg saved to cache
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d95b7a08-d44c-53f7-9d91-61d67051e0d4
2026-03-29 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6812/20386812/interior_front_seats-1774458118955.jpg> (referer: None)
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5ee690>
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6812%252F20386812%252Finterior_rear_seats-1774458130794.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6812/20386812/interior_rear_seats-1774458130794.jpg saved to cache
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b9603c8-21a7-5fb0-b716-5c5200a795de
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00&\xc2\xd3\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x01n\x00&\xb8A\x00\x00\x00\x00'
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1c0590>
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3922%252F20443922%252Finterior_front_seats-1774463390713.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3922/20443922/interior_front_seats-1774463390713.jpeg saved to cache
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13c719db-cdd4-5429-a547-8a96c04809e4
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c818050>
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6812%252F20386812%252Finterior_front_seats-1774458118955.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6812/20386812/interior_front_seats-1774458118955.jpg saved to cache
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b9603c8-21a7-5fb0-b716-5c5200a795de
2026-03-29 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4371469.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3061/20483061/exterior_front_passenger-1774689264109.jpg> (referer: None)
2026-03-29 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6812/20386812/interior_boot-1774458181405.jpg> (referer: None)
2026-03-29 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3061/20483061/interior_boot-1774688027394.jpg> (referer: None)
2026-03-29 20:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c40300b5-7811-5cda-8c76-e5879977553c with identifier: 4371469
2026-03-29 20:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c40300b5-7811-5cda-8c76-e5879977553c with scrape type 1
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c40300b5-7811-5cda-8c76-e5879977553c
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1469%252F4371469%252Fexterior_front_driver-1774615418551.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1469/4371469/exterior_front_driver-1774615418551.jpg not downloaded yet
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1469%252F4371469%252Fexterior_rear_driver-1774615628602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1469/4371469/exterior_rear_driver-1774615628602.jpg not downloaded yet
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1469%252F4371469%252F4371469-exterior_front_passenger-modified-1774617111317.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1469/4371469/4371469-exterior_front_passenger-modified-1774617111317.jpeg not downloaded yet
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5efb90>
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3061%252F20483061%252Fexterior_front_passenger-1774689264109.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3061/20483061/exterior_front_passenger-1774689264109.jpg saved to cache
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6
2026-03-29 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5800d0>
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6812%252F20386812%252Finterior_boot-1774458181405.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6812/20386812/interior_boot-1774458181405.jpg saved to cache
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b9603c8-21a7-5fb0-b716-5c5200a795de
2026-03-29 20:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b9603c8-21a7-5fb0-b716-5c5200a795de, skipping ID generation
2026-03-29 20:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b9603c8-21a7-5fb0-b716-5c5200a795de with scrape type 1
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b9603c8-21a7-5fb0-b716-5c5200a795de sending to next pipeline
2026-03-29 20:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1b9603c8-21a7-5fb0-b716-5c5200a795de, identifier: 20386812
2026-03-29 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddf8410>
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3061%252F20483061%252Finterior_boot-1774688027394.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3061/20483061/interior_boot-1774688027394.jpg saved to cache
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1469%252F4371469%252F4371469-exterior_rear_passenger-modified-1774617121339.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1469/4371469/4371469-exterior_rear_passenger-modified-1774617121339.jpeg not downloaded yet
2026-03-29 20:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1b9603c8-21a7-5fb0-b716-5c5200a795de with identifier: 20386812
2026-03-29 20:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1b9603c8-21a7-5fb0-b716-5c5200a795de with identifier: 20386812
2026-03-29 20:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1b9603c8-21a7-5fb0-b716-5c5200a795de with identifier: 20386812 to the API
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6812/20386812/interior_boot-1774458181405.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '4.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '1b9603c8-21a7-5fb0-b716-5c5200a795de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'C6 TCR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20386812',
'listing': 'auction',
'location': 'Norfolk Thetford',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 125000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2210407,
'Height': 2918,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_front_driver-1774457820964.jpg',
'Width': 3891},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1741569,
'Height': 2570,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_rear_driver-1774457831904.jpg',
'Width': 3427},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2011625,
'Height': 2860,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_front_passenger-1774457861554.jpg',
'Width': 3813},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1940214,
'Height': 2669,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6812/20386812/exterior_rear_passenger-1774457866498.jpg',
'Width': 3558},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2912947,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6812/20386812/interior_front_seats-1774458118955.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2843825,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6812/20386812/interior_rear_seats-1774458130794.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1834398,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6812/20386812/interior_dashboard-1774458166887.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2280650,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6812/20386812/instrument_cluster-1774458213167.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4635552,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6812/20386812/interior_boot-1774458181405.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9603c8-21a7-5fb0-b716-5c5200a795de/1b9603c8-21a7-5fb0-b716-5c5200a795de_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2376448,
'Height': 2731,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6812/20386812/docs_service_history-1774458308273.jpg?ixlib=js-3.8.0&auto=format&s=3d5338c24b7a64488bb168976e924d50',
'Width': 1914}],
'price': 18595,
'price_includes_vat': False,
'registration_date': '2018-01-31',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Vogue SE SDV8 Auto',
'transmission': 'automatic',
'trim': 'Vogue SE SDV8 Auto',
'vin': 'SALGA2AJ6JA387009',
'year': 2018}
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720386812%27 HTTP/1.1" 200 None
2026-03-29 20:05:53 [motorway.uk] INFO: Saving data for 20386812: {'created_time': 1774814753.23182, 'last_price_update_time': 1774814753.231832, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20386812') HTTP/1.1" 204 0
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1469%252F4371469%252F4371469-interior_front_seats-modified-1774617135462.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1469/4371469/4371469-interior_front_seats-modified-1774617135462.jpeg not downloaded yet
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1469%252F4371469%252Finterior_rear_seats-1772028049375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1469/4371469/interior_rear_seats-1772028049375.jpg not downloaded yet
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1469%252F4371469%252F4371469-interior_dashboard-modified-1774619331581.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1469/4371469/4371469-interior_dashboard-modified-1774619331581.jpeg not downloaded yet
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1469%252F4371469%252Finstrument_cluster-1774623382877.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1469/4371469/instrument_cluster-1774623382877.jpg not downloaded yet
2026-03-29 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4023/20494023/wheels_front_driver-1774721605041.jpg> (referer: None)
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1469%252F4371469%252F4371469-interior_boot-modified-1774617203318.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1469/4371469/4371469-interior_boot-modified-1774617203318.jpeg not downloaded yet
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F1469%252F4371469%252F4371469-docs_service_history-default-1772026410256.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6ffc0427660aba01cf8143f92eafc558%27 HTTP/1.1" 200 None
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/1469/4371469/4371469-docs_service_history-default-1772026410256.jpg?ixlib=js-3.8.0&auto=format&s=6ffc0427660aba01cf8143f92eafc558 not downloaded yet
2026-03-29 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/1334/13901334/13901334-docs_service_history-default-1737534907474.jpg?ixlib=js-3.8.0&auto=format&s=f1fbf5c7399ad16c89500f425a4222e9> (referer: None)
2026-03-29 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1991/20491991/damage_scratches-1774715890875.jpg> (referer: None)
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d575610>
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4023%252F20494023%252Fwheels_front_driver-1774721605041.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4023/20494023/wheels_front_driver-1774721605041.jpg saved to cache
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc
2026-03-29 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3061/20483061/interior_rear_seats-1774689241222.jpg> (referer: None)
2026-03-29 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4023/20494023/interior_front_seats-1774782610388.jpg> (referer: None)
2026-03-29 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3061/20483061/interior_dashboard-1774689229034.jpg> (referer: None)
2026-03-29 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4023/20494023/interior_dashboard-1774782020584.jpg> (referer: None)
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd35b90>
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F1334%252F13901334%252F13901334-docs_service_history-default-1737534907474.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df1fbf5c7399ad16c89500f425a4222e9') HTTP/1.1" 204 0
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/1334/13901334/13901334-docs_service_history-default-1737534907474.jpg?ixlib=js-3.8.0&auto=format&s=f1fbf5c7399ad16c89500f425a4222e9 saved to cache
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d00239a4-ecd0-5549-9dff-a6bfb357faaf
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d549590>
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1991%252F20491991%252Fdamage_scratches-1774715890875.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1991/20491991/damage_scratches-1774715890875.jpg saved to cache
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d95b7a08-d44c-53f7-9d91-61d67051e0d4
2026-03-29 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4023/20494023/interior_rear_seats-1774722146991.jpg> (referer: None)
2026-03-29 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4023/20494023/instrument_cluster-1774722227357.jpg> (referer: None)
2026-03-29 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/1469/4371469/4371469-docs_service_history-default-1772026410256.jpg?ixlib=js-3.8.0&auto=format&s=6ffc0427660aba01cf8143f92eafc558> (referer: None)
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6d5a90>
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3061%252F20483061%252Finterior_rear_seats-1774689241222.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3061/20483061/interior_rear_seats-1774689241222.jpg saved to cache
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd2a710>
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4023%252F20494023%252Finterior_front_seats-1774782610388.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4023/20494023/interior_front_seats-1774782610388.jpg saved to cache
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d646790>
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3061%252F20483061%252Finterior_dashboard-1774689229034.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3061/20483061/interior_dashboard-1774689229034.jpg saved to cache
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5dbd50>
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4023%252F20494023%252Finterior_dashboard-1774782020584.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4023/20494023/interior_dashboard-1774782020584.jpg saved to cache
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc
2026-03-29 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4023/20494023/interior_boot-1774722312762.jpg> (referer: None)
2026-03-29 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3061/20483061/interior_front_seats-1774689253261.jpg> (referer: None)
2026-03-29 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3061/20483061/damage_scratches-1774687522190.jpg> (referer: None)
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d645d50>
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4023%252F20494023%252Finterior_rear_seats-1774722146991.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4023/20494023/interior_rear_seats-1774722146991.jpg saved to cache
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6d6b10>
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4023%252F20494023%252Finstrument_cluster-1774722227357.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4023/20494023/instrument_cluster-1774722227357.jpg saved to cache
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x048'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\t$'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 46 - Data Location: 74 - value: <table: 41 bytes>
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00s'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3300d0>
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F1469%252F4371469%252F4371469-docs_service_history-default-1772026410256.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6ffc0427660aba01cf8143f92eafc558') HTTP/1.1" 204 0
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/1469/4371469/4371469-docs_service_history-default-1772026410256.jpg?ixlib=js-3.8.0&auto=format&s=6ffc0427660aba01cf8143f92eafc558 saved to cache
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c40300b5-7811-5cda-8c76-e5879977553c
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a0cd0>
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4023%252F20494023%252Finterior_boot-1774722312762.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4023/20494023/interior_boot-1774722312762.jpg saved to cache
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5da8d0>
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3061%252F20483061%252Finterior_front_seats-1774689253261.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3061/20483061/interior_front_seats-1774689253261.jpg saved to cache
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d52af90>
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3061%252F20483061%252Fdamage_scratches-1774687522190.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3061/20483061/damage_scratches-1774687522190.jpg saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1469/4371469/4371469-exterior_rear_passenger-modified-1774617121339.jpeg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3061/20483061/damage_scratches-1774687641043.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1469/4371469/instrument_cluster-1774623382877.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1469/4371469/4371469-interior_front_seats-modified-1774617135462.jpeg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1469/4371469/exterior_front_driver-1774615418551.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1469/4371469/4371469-interior_boot-modified-1774617203318.jpeg> (referer: None)
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6d7c90>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1469%252F4371469%252F4371469-exterior_rear_passenger-modified-1774617121339.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1469/4371469/4371469-exterior_rear_passenger-modified-1774617121339.jpeg saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c40300b5-7811-5cda-8c76-e5879977553c
2026-03-29 20:05:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d52a850>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3061%252F20483061%252Fdamage_scratches-1774687641043.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3061/20483061/damage_scratches-1774687641043.jpg saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d537710>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1469%252F4371469%252Finstrument_cluster-1774623382877.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1469/4371469/instrument_cluster-1774623382877.jpg saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c40300b5-7811-5cda-8c76-e5879977553c
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d58ccd0>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1469%252F4371469%252F4371469-interior_front_seats-modified-1774617135462.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1469/4371469/4371469-interior_front_seats-modified-1774617135462.jpeg saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c40300b5-7811-5cda-8c76-e5879977553c
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da81990>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1469%252F4371469%252Fexterior_front_driver-1774615418551.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1469/4371469/exterior_front_driver-1774615418551.jpg saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c40300b5-7811-5cda-8c76-e5879977553c
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d58fe10>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1469%252F4371469%252F4371469-interior_boot-modified-1774617203318.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1469/4371469/4371469-interior_boot-modified-1774617203318.jpeg saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c40300b5-7811-5cda-8c76-e5879977553c
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1334/13901334/interior_boot-1774707629277.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1469/4371469/exterior_rear_driver-1774615628602.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1469/4371469/4371469-exterior_front_passenger-modified-1774617111317.jpeg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1991/20491991/docs_service_history-1774718469307.jpg?ixlib=js-3.8.0&auto=format&s=c2a2c1d6d4819029b808ed1a9c674486> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1334/13901334/13901334-instrument_cluster-modified-1774716816019.jpeg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4023/20494023/exterior_rear_passenger-1774721561011.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1469/4371469/interior_rear_seats-1772028049375.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1469/4371469/4371469-interior_dashboard-modified-1774619331581.jpeg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3061/20483061/exterior_rear_passenger-1774687219485.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4023/20494023/exterior_front_passenger-1774782568120.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1991/20491991/interior_boot-1774716674835.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3922/20443922/docs_service_history-1774519500456.jpeg?ixlib=js-3.8.0&auto=format&s=bf57e28bd4f698bd2ed842e780a19f1f> (referer: None)
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6e42d0>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1334%252F13901334%252Finterior_boot-1774707629277.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1334/13901334/interior_boot-1774707629277.jpg saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d00239a4-ecd0-5549-9dff-a6bfb357faaf
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daf2d10>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1469%252F4371469%252Fexterior_rear_driver-1774615628602.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1469/4371469/exterior_rear_driver-1774615628602.jpg saved to cache
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c40300b5-7811-5cda-8c76-e5879977553c
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35530d50>
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1469%252F4371469%252F4371469-exterior_front_passenger-modified-1774617111317.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1469/4371469/4371469-exterior_front_passenger-modified-1774617111317.jpeg saved to cache
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c40300b5-7811-5cda-8c76-e5879977553c
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d756050>
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1991%252F20491991%252Fdocs_service_history-1774718469307.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc2a2c1d6d4819029b808ed1a9c674486') HTTP/1.1" 204 0
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1991/20491991/docs_service_history-1774718469307.jpg?ixlib=js-3.8.0&auto=format&s=c2a2c1d6d4819029b808ed1a9c674486 saved to cache
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d95b7a08-d44c-53f7-9d91-61d67051e0d4
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d503090>
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1334%252F13901334%252F13901334-instrument_cluster-modified-1774716816019.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1334/13901334/13901334-instrument_cluster-modified-1774716816019.jpeg saved to cache
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d00239a4-ecd0-5549-9dff-a6bfb357faaf
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a2490>
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4023%252F20494023%252Fexterior_rear_passenger-1774721561011.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4023/20494023/exterior_rear_passenger-1774721561011.jpg saved to cache
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3e1cd0>
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1469%252F4371469%252Finterior_rear_seats-1772028049375.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1469/4371469/interior_rear_seats-1772028049375.jpg saved to cache
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c40300b5-7811-5cda-8c76-e5879977553c
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3d1cd0>
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1469%252F4371469%252F4371469-interior_dashboard-modified-1774619331581.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1469/4371469/4371469-interior_dashboard-modified-1774619331581.jpeg saved to cache
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c40300b5-7811-5cda-8c76-e5879977553c
2026-03-29 20:05:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c40300b5-7811-5cda-8c76-e5879977553c, skipping ID generation
2026-03-29 20:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c40300b5-7811-5cda-8c76-e5879977553c with scrape type 1
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c40300b5-7811-5cda-8c76-e5879977553c sending to next pipeline
2026-03-29 20:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c40300b5-7811-5cda-8c76-e5879977553c, identifier: 4371469
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc6a6d0>
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3061%252F20483061%252Fexterior_rear_passenger-1774687219485.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3061/20483061/exterior_rear_passenger-1774687219485.jpg saved to cache
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f449dd0>
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4023%252F20494023%252Fexterior_front_passenger-1774782568120.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4023/20494023/exterior_front_passenger-1774782568120.jpg saved to cache
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da82f10>
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1991%252F20491991%252Finterior_boot-1774716674835.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1991/20491991/interior_boot-1774716674835.jpg saved to cache
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d95b7a08-d44c-53f7-9d91-61d67051e0d4
2026-03-29 20:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c40300b5-7811-5cda-8c76-e5879977553c with identifier: 4371469
2026-03-29 20:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c40300b5-7811-5cda-8c76-e5879977553c with identifier: 4371469
2026-03-29 20:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c40300b5-7811-5cda-8c76-e5879977553c with identifier: 4371469 to the API
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/1469/4371469/4371469-interior_dashboard-modified-1774619331581.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'c40300b5-7811-5cda-8c76-e5879977553c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RJ71 NKD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/4371469',
'listing': 'auction',
'location': 'Greater London Croydon',
'make': 'Audi',
'model': 'A5',
'odometer': 37824,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 779036,
'Height': 1811,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1469/4371469/exterior_front_driver-1774615418551.jpg',
'Width': 2414},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 943815,
'Height': 2036,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1469/4371469/exterior_rear_driver-1774615628602.jpg',
'Width': 2714},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1060582,
'Height': 1987,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1469/4371469/4371469-exterior_front_passenger-modified-1774617111317.jpeg',
'Width': 2649},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1008262,
'Height': 1959,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1469/4371469/4371469-exterior_rear_passenger-modified-1774617121339.jpeg',
'Width': 2612},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1885118,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1469/4371469/4371469-interior_front_seats-modified-1774617135462.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1909712,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/1469/4371469/interior_rear_seats-1772028049375.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2066758,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1469/4371469/4371469-interior_dashboard-modified-1774619331581.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1562491,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1469/4371469/instrument_cluster-1774623382877.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1543471,
'Height': 2766,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1469/4371469/4371469-interior_boot-modified-1774617203318.jpeg',
'Width': 3688},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c40300b5-7811-5cda-8c76-e5879977553c/c40300b5-7811-5cda-8c76-e5879977553c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355248,
'Height': 2340,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/1469/4371469/4371469-docs_service_history-default-1772026410256.jpg?ixlib=js-3.8.0&auto=format&s=6ffc0427660aba01cf8143f92eafc558',
'Width': 1080}],
'price': 26241,
'price_includes_vat': False,
'registration_date': '2022-01-28',
'seats_number': None,
'seller_name': None,
'title': 'Audi A5 S LN BLK ED 40TDI MHEV',
'transmission': 'automatic',
'trim': 'S LN BLK ED 40TDI MHEV',
'vin': 'WAUZZZF57NA014951',
'year': 2022}
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274371469%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [motorway.uk] INFO: Saving data for 4371469: {'created_time': 1774814757.749815, 'last_price_update_time': 1774814757.749827, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='4371469') HTTP/1.1" 204 0
2026-03-29 20:05:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c919050>
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3922%252F20443922%252Fdocs_service_history-1774519500456.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbf57e28bd4f698bd2ed842e780a19f1f') HTTP/1.1" 204 0
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3922/20443922/docs_service_history-1774519500456.jpeg?ixlib=js-3.8.0&auto=format&s=bf57e28bd4f698bd2ed842e780a19f1f saved to cache
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13c719db-cdd4-5429-a547-8a96c04809e4
2026-03-29 20:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1991/20491991/20491991-instrument_cluster-modified-1774777623267.jpeg> (referer: None)
2026-03-29 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1334/13901334/interior_rear_seats-1774708755718.jpg> (referer: None)
2026-03-29 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4023/20494023/exterior_rear_driver-1774721547311.jpg> (referer: None)
2026-03-29 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3061/20483061/exterior_rear_driver-1774687188560.jpg> (referer: None)
2026-03-29 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1334/13901334/13901334-interior_dashboard-modified-1774716803389.jpeg> (referer: None)
2026-03-29 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1991/20491991/20491991-interior_dashboard-modified-1774777640495.jpeg> (referer: None)
2026-03-29 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3922/20443922/docs_service_history-1774519500397.jpeg?ixlib=js-3.8.0&auto=format&s=12625e03d580e774ebafa6671adece73> (referer: None)
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd824d0>
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1991%252F20491991%252F20491991-instrument_cluster-modified-1774777623267.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1991/20491991/20491991-instrument_cluster-modified-1774777623267.jpeg saved to cache
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d95b7a08-d44c-53f7-9d91-61d67051e0d4
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2c73d0>
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1334%252F13901334%252Finterior_rear_seats-1774708755718.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1334/13901334/interior_rear_seats-1774708755718.jpg saved to cache
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d00239a4-ecd0-5549-9dff-a6bfb357faaf
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c90ef50>
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4023%252F20494023%252Fexterior_rear_driver-1774721547311.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4023/20494023/exterior_rear_driver-1774721547311.jpg saved to cache
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dde3e90>
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3061%252F20483061%252Fexterior_rear_driver-1774687188560.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3061/20483061/exterior_rear_driver-1774687188560.jpg saved to cache
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd1ce50>
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1334%252F13901334%252F13901334-interior_dashboard-modified-1774716803389.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1334/13901334/13901334-interior_dashboard-modified-1774716803389.jpeg saved to cache
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d00239a4-ecd0-5549-9dff-a6bfb357faaf
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f502ad0>
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1991%252F20491991%252F20491991-interior_dashboard-modified-1774777640495.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1991/20491991/20491991-interior_dashboard-modified-1774777640495.jpeg saved to cache
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d95b7a08-d44c-53f7-9d91-61d67051e0d4
2026-03-29 20:05:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2c7610>
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3922%252F20443922%252Fdocs_service_history-1774519500397.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D12625e03d580e774ebafa6671adece73') HTTP/1.1" 204 0
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3922/20443922/docs_service_history-1774519500397.jpeg?ixlib=js-3.8.0&auto=format&s=12625e03d580e774ebafa6671adece73 saved to cache
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13c719db-cdd4-5429-a547-8a96c04809e4
2026-03-29 20:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4023/20494023/exterior_front_driver-1774721526377.jpg> (referer: None)
2026-03-29 20:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1334/13901334/exterior_front_passenger-1774708200498.jpg> (referer: None)
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1334/13901334/interior_front_seats-1774709268520.jpg> (referer: None)
2026-03-29 20:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1334/13901334/exterior_rear_passenger-1774708229912.jpg> (referer: None)
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3922/20443922/20443922-interior_dashboard-modified-1774502138690.jpeg> (referer: None)
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1991/20491991/interior_front_seats-1774716725866.jpg> (referer: None)
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3061/20483061/exterior_front_driver-1774687141853.jpg> (referer: None)
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3922/20443922/interior_boot-1774463368099.jpeg> (referer: None)
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_rear_passenger-1774715674579.jpg> (referer: None)
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_front_passenger-1774715696367.jpg> (referer: None)
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6acd90>
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4023%252F20494023%252Fexterior_front_driver-1774721526377.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4023/20494023/exterior_front_driver-1774721526377.jpg saved to cache
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc
2026-03-29 20:05:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf435ec2-92ed-56f8-b3a9-c49605e5b5cc, skipping ID generation
2026-03-29 20:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc with scrape type 1
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf435ec2-92ed-56f8-b3a9-c49605e5b5cc sending to next pipeline
2026-03-29 20:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cf435ec2-92ed-56f8-b3a9-c49605e5b5cc, identifier: 20494023
2026-03-29 20:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cf435ec2-92ed-56f8-b3a9-c49605e5b5cc with identifier: 20494023
2026-03-29 20:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cf435ec2-92ed-56f8-b3a9-c49605e5b5cc with identifier: 20494023
2026-03-29 20:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cf435ec2-92ed-56f8-b3a9-c49605e5b5cc with identifier: 20494023 to the API
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4023/20494023/exterior_front_driver-1774721526377.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'cf435ec2-92ed-56f8-b3a9-c49605e5b5cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV25 YTX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20494023',
'listing': 'auction',
'location': 'None London',
'make': 'Mercedes',
'model': 'AMG',
'odometer': 2950,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1539716,
'Height': 2124,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4023/20494023/exterior_front_driver-1774721526377.jpg',
'Width': 2832},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2657933,
'Height': 2895,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4023/20494023/exterior_rear_driver-1774721547311.jpg',
'Width': 3860},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2491333,
'Height': 2434,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4023/20494023/exterior_front_passenger-1774782568120.jpg',
'Width': 3245},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2639815,
'Height': 2813,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4023/20494023/exterior_rear_passenger-1774721561011.jpg',
'Width': 3750},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2100514,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4023/20494023/interior_front_seats-1774782610388.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2320593,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4023/20494023/interior_rear_seats-1774722146991.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2137804,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4023/20494023/interior_dashboard-1774782020584.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2433327,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4023/20494023/instrument_cluster-1774722227357.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2576688,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4023/20494023/interior_boot-1774722312762.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf435ec2-92ed-56f8-b3a9-c49605e5b5cc/cf435ec2-92ed-56f8-b3a9-c49605e5b5cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635861,
'Height': 1529,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4023/20494023/wheels_front_driver-1774721605041.jpg',
'Width': 2039}],
'price': 74050,
'price_includes_vat': False,
'registration_date': '2025-05-28',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes AMG GLE 53 Premium MHEV 4M A',
'transmission': 'automatic',
'trim': 'GLE 53 Premium MHEV 4M A',
'vin': 'W1NFB6BE1SB390199',
'year': 2025}
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720494023%27 HTTP/1.1" 200 None
2026-03-29 20:05:59 [motorway.uk] INFO: Saving data for 20494023: {'created_time': 1774814759.51053, 'last_price_update_time': 1774814759.510541, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20494023') HTTP/1.1" 204 0
2026-03-29 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=216&page=6&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f4311a450>
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1334%252F13901334%252Fexterior_front_passenger-1774708200498.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1334/13901334/exterior_front_passenger-1774708200498.jpg saved to cache
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d00239a4-ecd0-5549-9dff-a6bfb357faaf
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3f01d0>
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1334%252F13901334%252Finterior_front_seats-1774709268520.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1334/13901334/interior_front_seats-1774709268520.jpg saved to cache
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d00239a4-ecd0-5549-9dff-a6bfb357faaf
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a3d10>
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1334%252F13901334%252Fexterior_rear_passenger-1774708229912.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1334/13901334/exterior_rear_passenger-1774708229912.jpg saved to cache
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d00239a4-ecd0-5549-9dff-a6bfb357faaf
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daf3350>
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3922%252F20443922%252F20443922-interior_dashboard-modified-1774502138690.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3922/20443922/20443922-interior_dashboard-modified-1774502138690.jpeg saved to cache
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13c719db-cdd4-5429-a547-8a96c04809e4
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a0250>
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1991%252F20491991%252Finterior_front_seats-1774716725866.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1991/20491991/interior_front_seats-1774716725866.jpg saved to cache
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d95b7a08-d44c-53f7-9d91-61d67051e0d4
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de9a310>
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3061%252F20483061%252Fexterior_front_driver-1774687141853.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3061/20483061/exterior_front_driver-1774687141853.jpg saved to cache
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6
2026-03-29 20:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28efa075-4bbf-54e9-8402-f60c3dbac7e6, skipping ID generation
2026-03-29 20:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6 with scrape type 1
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28efa075-4bbf-54e9-8402-f60c3dbac7e6 sending to next pipeline
2026-03-29 20:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 28efa075-4bbf-54e9-8402-f60c3dbac7e6, identifier: 20483061
2026-03-29 20:06:00 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:00 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:00 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00(\x84\xab\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x881\x00(z\x19\x00\x00\x00\x00'
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc62090>
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3922%252F20443922%252Finterior_boot-1774463368099.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3922/20443922/interior_boot-1774463368099.jpeg saved to cache
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13c719db-cdd4-5429-a547-8a96c04809e4
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3335d0>
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1991%252F20491991%252Fexterior_rear_passenger-1774715674579.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_rear_passenger-1774715674579.jpg saved to cache
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d95b7a08-d44c-53f7-9d91-61d67051e0d4
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddbd090>
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1991%252F20491991%252Fexterior_front_passenger-1774715696367.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_front_passenger-1774715696367.jpg saved to cache
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d95b7a08-d44c-53f7-9d91-61d67051e0d4
2026-03-29 20:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 28efa075-4bbf-54e9-8402-f60c3dbac7e6 with identifier: 20483061
2026-03-29 20:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 28efa075-4bbf-54e9-8402-f60c3dbac7e6 with identifier: 20483061
2026-03-29 20:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 28efa075-4bbf-54e9-8402-f60c3dbac7e6 with identifier: 20483061 to the API
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3061/20483061/exterior_front_driver-1774687141853.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '4.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '28efa075-4bbf-54e9-8402-f60c3dbac7e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LT05 MZP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20483061',
'listing': 'auction',
'location': 'Hampshire Basingstoke',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 28557,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2214702,
'Height': 2882,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3061/20483061/exterior_front_driver-1774687141853.jpg',
'Width': 3843},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2084873,
'Height': 2781,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3061/20483061/exterior_rear_driver-1774687188560.jpg',
'Width': 3708},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2913702,
'Height': 2867,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3061/20483061/exterior_front_passenger-1774689264109.jpg',
'Width': 3823},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1966717,
'Height': 2710,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3061/20483061/exterior_rear_passenger-1774687219485.jpg',
'Width': 3613},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2394603,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3061/20483061/interior_front_seats-1774689253261.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2064230,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3061/20483061/interior_rear_seats-1774689241222.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2144179,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3061/20483061/interior_dashboard-1774689229034.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3553368,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3061/20483061/interior_boot-1774688027394.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2819813,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3061/20483061/damage_scratches-1774687522190.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28efa075-4bbf-54e9-8402-f60c3dbac7e6/28efa075-4bbf-54e9-8402-f60c3dbac7e6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3791153,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3061/20483061/damage_scratches-1774687641043.jpg',
'Width': 4032}],
'price': 12163,
'price_includes_vat': False,
'registration_date': '2005-04-26',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery 3 V8 HSE Auto',
'transmission': 'automatic',
'trim': '3 V8 HSE Auto',
'vin': 'SALLAAA535A312658',
'year': 2005}
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483061%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [motorway.uk] INFO: Saving data for 20483061: {'created_time': 1774814761.074914, 'last_price_update_time': 1774814761.074926, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20483061') HTTP/1.1" 204 0
2026-03-29 20:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20487615
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487615%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [motorway.uk] INFO: Scrape type for 20487615: 1
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20488394
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20464062
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20134898
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 19440586
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 19452010
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719452010%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [motorway.uk] INFO: Scrape type for 19452010: 1
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 10749345
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 19842266
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20386031
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20499683
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20118034
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20172802
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20497223
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 19286556
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20489789
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 12967935
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20254078
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 7263451
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 18322763
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718322763%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [motorway.uk] INFO: Scrape type for 18322763: 2
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20406653
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20490670
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490670%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [motorway.uk] INFO: Scrape type for 20490670: 1
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20502991
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20372589
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720372589%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [motorway.uk] INFO: Scrape type for 20372589: 1
2026-03-29 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_rear_passenger-1774463261526.jpeg> (referer: None)
2026-03-29 20:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20158404
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720158404%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [motorway.uk] INFO: Scrape type for 20158404: 1
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 18562849
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20417323
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20485001
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485001%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [motorway.uk] INFO: Scrape type for 20485001: 1
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20303214
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20459750
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459750%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [motorway.uk] INFO: Scrape type for 20459750: 1
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20491811
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20475595
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20127568
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720127568%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [motorway.uk] INFO: Scrape type for 20127568: 1
2026-03-29 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_front_driver-1774715717587.jpg> (referer: None)
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 19344017
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20260509
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720260509%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [motorway.uk] INFO: Scrape type for 20260509: 1
2026-03-29 20:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d937e90>
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3922%252F20443922%252Fexterior_rear_passenger-1774463261526.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_rear_passenger-1774463261526.jpeg saved to cache
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13c719db-cdd4-5429-a547-8a96c04809e4
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 20189241
2026-03-29 20:06:01 [motorway.uk] INFO: Found listing with ID: 12732265
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9864d0>
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1991%252F20491991%252Fexterior_front_driver-1774715717587.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_front_driver-1774715717587.jpg saved to cache
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d95b7a08-d44c-53f7-9d91-61d67051e0d4
2026-03-29 20:06:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d95b7a08-d44c-53f7-9d91-61d67051e0d4, skipping ID generation
2026-03-29 20:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d95b7a08-d44c-53f7-9d91-61d67051e0d4 with scrape type 1
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d95b7a08-d44c-53f7-9d91-61d67051e0d4 sending to next pipeline
2026-03-29 20:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d95b7a08-d44c-53f7-9d91-61d67051e0d4, identifier: 20491991
2026-03-29 20:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d95b7a08-d44c-53f7-9d91-61d67051e0d4 with identifier: 20491991
2026-03-29 20:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d95b7a08-d44c-53f7-9d91-61d67051e0d4 with identifier: 20491991
2026-03-29 20:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d95b7a08-d44c-53f7-9d91-61d67051e0d4 with identifier: 20491991 to the API
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_front_driver-1774715717587.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '4.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd95b7a08-d44c-53f7-9d91-61d67051e0d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM72 CFZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20491991',
'listing': 'auction',
'location': 'Edinburgh Edinburgh',
'make': 'Porsche',
'model': '718',
'odometer': 11695,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2130601,
'Height': 2599,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_front_driver-1774715717587.jpg',
'Width': 3465},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2181698,
'Height': 2853,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_rear_driver-1774715684780.jpg',
'Width': 3804},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2303389,
'Height': 2651,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_front_passenger-1774715696367.jpg',
'Width': 3534},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2302085,
'Height': 2680,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1991/20491991/exterior_rear_passenger-1774715674579.jpg',
'Width': 3573},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2682847,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1991/20491991/interior_front_seats-1774716725866.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2412307,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1991/20491991/20491991-interior_dashboard-modified-1774777640495.jpeg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558420,
'Height': 2406,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1991/20491991/20491991-instrument_cluster-modified-1774777623267.jpeg',
'Width': 3208},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2435082,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1991/20491991/interior_boot-1774716674835.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1352867,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1991/20491991/docs_service_history-1774718469307.jpg?ixlib=js-3.8.0&auto=format&s=c2a2c1d6d4819029b808ed1a9c674486',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d95b7a08-d44c-53f7-9d91-61d67051e0d4/d95b7a08-d44c-53f7-9d91-61d67051e0d4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1798279,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1991/20491991/damage_scratches-1774715890875.jpg',
'Width': 3840}],
'price': 63172,
'price_includes_vat': False,
'registration_date': '2023-01-16',
'seats_number': None,
'seller_name': None,
'title': 'Porsche 718 Boxster GTS S-A',
'transmission': 'automatic',
'trim': 'Boxster GTS S-A',
'vin': 'WP0ZZZ987PS214198',
'year': 2023}
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491991%27 HTTP/1.1" 200 None
2026-03-29 20:06:02 [motorway.uk] INFO: Saving data for 20491991: {'created_time': 1774814762.243059, 'last_price_update_time': 1774814762.24307, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20491991') HTTP/1.1" 204 0
2026-03-29 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_front_driver-1774463240229.jpeg> (referer: None)
2026-03-29 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_rear_driver-1774463268875.jpeg> (referer: None)
2026-03-29 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4629/20464629/docs_service_history-1774694400443.jpg?ixlib=js-3.8.0&auto=format&s=03a98552bbbd5cf3e0822dcdc34eb37c> (referer: None)
2026-03-29 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3922/20443922/interior_rear_seats-1774463335392.jpeg> (referer: None)
2026-03-29 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_front_passenger-1774463252640.jpeg> (referer: None)
2026-03-29 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_rear_passenger-1774620077887.jpg> (referer: None)
2026-03-29 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1334/13901334/13901334-exterior_front_driver-modified-1774716752738.jpeg> (referer: None)
2026-03-29 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4629/20464629/interior_rear_seats-1774693532820.jpg> (referer: None)
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d925c50>
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3922%252F20443922%252Fexterior_front_driver-1774463240229.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_front_driver-1774463240229.jpeg saved to cache
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13c719db-cdd4-5429-a547-8a96c04809e4
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f646a50>
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3922%252F20443922%252Fexterior_rear_driver-1774463268875.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_rear_driver-1774463268875.jpeg saved to cache
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13c719db-cdd4-5429-a547-8a96c04809e4
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2c7f10>
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e/2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4629%252F20464629%252Fdocs_service_history-1774694400443.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D03a98552bbbd5cf3e0822dcdc34eb37c') HTTP/1.1" 204 0
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4629/20464629/docs_service_history-1774694400443.jpg?ixlib=js-3.8.0&auto=format&s=03a98552bbbd5cf3e0822dcdc34eb37c saved to cache
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00&m[\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xa9>\x00&b\xc9\x00\x00\x00\x00'
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d577610>
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3922%252F20443922%252Finterior_rear_seats-1774463335392.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3922/20443922/interior_rear_seats-1774463335392.jpeg saved to cache
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13c719db-cdd4-5429-a547-8a96c04809e4
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db55b50>
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3922%252F20443922%252Fexterior_front_passenger-1774463252640.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_front_passenger-1774463252640.jpeg saved to cache
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13c719db-cdd4-5429-a547-8a96c04809e4
2026-03-29 20:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13c719db-cdd4-5429-a547-8a96c04809e4, skipping ID generation
2026-03-29 20:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13c719db-cdd4-5429-a547-8a96c04809e4 with scrape type 1
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13c719db-cdd4-5429-a547-8a96c04809e4 sending to next pipeline
2026-03-29 20:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 13c719db-cdd4-5429-a547-8a96c04809e4, identifier: 20443922
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a5c10>
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2830%252F19952830%252Fexterior_rear_passenger-1774620077887.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_rear_passenger-1774620077887.jpg saved to cache
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e577470-f9f8-5720-833b-da55b593b054
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d735450>
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1334%252F13901334%252F13901334-exterior_front_driver-modified-1774716752738.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1334/13901334/13901334-exterior_front_driver-modified-1774716752738.jpeg saved to cache
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d00239a4-ecd0-5549-9dff-a6bfb357faaf
2026-03-29 20:06:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d00239a4-ecd0-5549-9dff-a6bfb357faaf, skipping ID generation
2026-03-29 20:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d00239a4-ecd0-5549-9dff-a6bfb357faaf with scrape type 1
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d00239a4-ecd0-5549-9dff-a6bfb357faaf sending to next pipeline
2026-03-29 20:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d00239a4-ecd0-5549-9dff-a6bfb357faaf, identifier: 13901334
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f500110>
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e/2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4629%252F20464629%252Finterior_rear_seats-1774693532820.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4629/20464629/interior_rear_seats-1774693532820.jpg saved to cache
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e
2026-03-29 20:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 13c719db-cdd4-5429-a547-8a96c04809e4 with identifier: 20443922
2026-03-29 20:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 13c719db-cdd4-5429-a547-8a96c04809e4 with identifier: 20443922
2026-03-29 20:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 13c719db-cdd4-5429-a547-8a96c04809e4 with identifier: 20443922 to the API
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_front_passenger-1774463252640.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '13c719db-cdd4-5429-a547-8a96c04809e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WK69 UKF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20443922',
'listing': 'auction',
'location': 'Surrey Addlestone',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 59188,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1306720,
'Height': 2585,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_front_driver-1774463240229.jpeg',
'Width': 3446},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1276180,
'Height': 2621,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_rear_driver-1774463268875.jpeg',
'Width': 3495},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1827501,
'Height': 2987,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_front_passenger-1774463252640.jpeg',
'Width': 3983},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1076418,
'Height': 2306,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3922/20443922/exterior_rear_passenger-1774463261526.jpeg',
'Width': 3074},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2671681,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3922/20443922/interior_front_seats-1774463390713.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2627225,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3922/20443922/interior_rear_seats-1774463335392.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2117180,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3922/20443922/20443922-interior_dashboard-modified-1774502138690.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2821340,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3922/20443922/interior_boot-1774463368099.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255784,
'Height': 2622,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3922/20443922/docs_service_history-1774519500397.jpeg?ixlib=js-3.8.0&auto=format&s=12625e03d580e774ebafa6671adece73',
'Width': 1206},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c719db-cdd4-5429-a547-8a96c04809e4/13c719db-cdd4-5429-a547-8a96c04809e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274088,
'Height': 2622,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3922/20443922/docs_service_history-1774519500456.jpeg?ixlib=js-3.8.0&auto=format&s=bf57e28bd4f698bd2ed842e780a19f1f',
'Width': 1206}],
'price': 9162,
'price_includes_vat': False,
'registration_date': '2019-10-31',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo Beats TSI',
'transmission': 'manual',
'trim': 'Beats TSI',
'vin': 'WVWZZZAWZLU007550',
'year': 2019}
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720443922%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [motorway.uk] INFO: Saving data for 20443922: {'created_time': 1774814764.037285, 'last_price_update_time': 1774814764.037298, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20443922') HTTP/1.1" 204 0
2026-03-29 20:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d00239a4-ecd0-5549-9dff-a6bfb357faaf with identifier: 13901334
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Red HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d00239a4-ecd0-5549-9dff-a6bfb357faaf with identifier: 13901334
2026-03-29 20:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d00239a4-ecd0-5549-9dff-a6bfb357faaf with identifier: 13901334 to the API
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/1334/13901334/13901334-exterior_front_driver-modified-1774716752738.jpeg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '5.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd00239a4-ecd0-5549-9dff-a6bfb357faaf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'M999 NDJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13901334',
'listing': 'auction',
'location': 'Greater Manchester Wigan',
'make': 'Ford',
'model': 'Mustang',
'odometer': 48000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3384953,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1334/13901334/13901334-exterior_front_driver-modified-1774716752738.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 985659,
'Height': 1993,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1334/13901334/exterior_rear_driver-1774708246178.jpg',
'Width': 2657},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 602742,
'Height': 1547,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1334/13901334/exterior_front_passenger-1774708200498.jpg',
'Width': 2063},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1212114,
'Height': 2324,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1334/13901334/exterior_rear_passenger-1774708229912.jpg',
'Width': 3098},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2022210,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/1334/13901334/interior_front_seats-1774709268520.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1575326,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/1334/13901334/interior_rear_seats-1774708755718.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2432332,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1334/13901334/13901334-interior_dashboard-modified-1774716803389.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1488057,
'Height': 2861,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1334/13901334/13901334-instrument_cluster-modified-1774716816019.jpeg',
'Width': 3815},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1676358,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/1334/13901334/interior_boot-1774707629277.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00239a4-ecd0-5549-9dff-a6bfb357faaf/d00239a4-ecd0-5549-9dff-a6bfb357faaf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 926212,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/1334/13901334/13901334-docs_service_history-default-1737534907474.jpg?ixlib=js-3.8.0&auto=format&s=f1fbf5c7399ad16c89500f425a4222e9',
'Width': 3000}],
'price': 23952,
'price_includes_vat': False,
'registration_date': '2015-12-05',
'seats_number': None,
'seller_name': None,
'title': 'Ford Mustang GT',
'transmission': 'manual',
'trim': 'GT',
'vin': '1FA6P8CF6G5212313',
'year': 2015}
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713901334%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [motorway.uk] INFO: Saving data for 13901334: {'created_time': 1774814764.618173, 'last_price_update_time': 1774814764.618185, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13901334') HTTP/1.1" 204 0
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18327972.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490670.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20127568.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20286049.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18832352.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20447824.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18663443.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b219d59-7e30-55bf-bae9-20590cdd6bf0 with identifier: 18327972
2026-03-29 20:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b219d59-7e30-55bf-bae9-20590cdd6bf0 with scrape type 1
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b219d59-7e30-55bf-bae9-20590cdd6bf0
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7972%252F18327972%252F18327972-exterior_front_driver-default-1774694950023.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7972/18327972/18327972-exterior_front_driver-default-1774694950023.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7972%252F18327972%252F18327972-exterior_rear_driver-default-1774694940957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7972/18327972/18327972-exterior_rear_driver-default-1774694940957.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7972%252F18327972%252F18327972-exterior_front_passenger-default-1774694935011.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7972/18327972/18327972-exterior_front_passenger-default-1774694935011.jpg not downloaded yet
2026-03-29 20:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328fb3ca-2b51-57eb-86d0-510e6deb32ae with identifier: 20490670
2026-03-29 20:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328fb3ca-2b51-57eb-86d0-510e6deb32ae with scrape type 1
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 328fb3ca-2b51-57eb-86d0-510e6deb32ae
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0670%252F20490670%252Fexterior_front_driver-1774711235994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0670/20490670/exterior_front_driver-1774711235994.jpg not downloaded yet
2026-03-29 20:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57266667-a7ea-5f5b-9b23-a7839f0bff3f with identifier: 20127568
2026-03-29 20:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57266667-a7ea-5f5b-9b23-a7839f0bff3f with scrape type 1
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57266667-a7ea-5f5b-9b23-a7839f0bff3f
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7568%252F20127568%252Fexterior_front_driver-1774450697609.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7568/20127568/exterior_front_driver-1774450697609.jpg not downloaded yet
2026-03-29 20:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 040161ab-964b-5100-877d-b6ed73aba9d3 with identifier: 20286049
2026-03-29 20:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040161ab-964b-5100-877d-b6ed73aba9d3 with scrape type 1
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 040161ab-964b-5100-877d-b6ed73aba9d3
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F20286049%252Fexterior_front_driver-1774708421270.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/20286049/exterior_front_driver-1774708421270.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7972%252F18327972%252F18327972-exterior_rear_passenger-default-1774694884071.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7972/18327972/18327972-exterior_rear_passenger-default-1774694884071.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0670%252F20490670%252Fexterior_rear_driver-1774711237334.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0670/20490670/exterior_rear_driver-1774711237334.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7568%252F20127568%252Fexterior_rear_driver-1774450721936.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7568/20127568/exterior_rear_driver-1774450721936.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F20286049%252Fexterior_rear_driver-1774708516795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/20286049/exterior_rear_driver-1774708516795.jpg not downloaded yet
2026-03-29 20:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6a9cc52-84ce-57f2-b289-5a209e195aa5 with identifier: 18832352
2026-03-29 20:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6a9cc52-84ce-57f2-b289-5a209e195aa5 with scrape type 1
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6a9cc52-84ce-57f2-b289-5a209e195aa5
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2352%252F18832352%252Fexterior_front_driver-1774777087958.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2352/18832352/exterior_front_driver-1774777087958.jpg not downloaded yet
2026-03-29 20:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b with identifier: 20447824
2026-03-29 20:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b with scrape type 1
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7824%252F20447824%252Fexterior_front_driver-1774519546712.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7824/20447824/exterior_front_driver-1774519546712.jpg not downloaded yet
2026-03-29 20:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed97f66-d218-5c4b-8f4b-bb24e241aceb with identifier: 18663443
2026-03-29 20:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed97f66-d218-5c4b-8f4b-bb24e241aceb with scrape type 1
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fed97f66-d218-5c4b-8f4b-bb24e241aceb
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3443%252F18663443%252Fexterior_front_driver-1774550930717.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3443/18663443/exterior_front_driver-1774550930717.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7972%252F18327972%252F18327972-interior_front_seats-default-1774694854932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7972/18327972/18327972-interior_front_seats-default-1774694854932.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0670%252F20490670%252Fexterior_front_passenger-1774712877580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0670/20490670/exterior_front_passenger-1774712877580.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7568%252F20127568%252Fexterior_front_passenger-1774450778576.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7568/20127568/exterior_front_passenger-1774450778576.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F20286049%252Fexterior_front_passenger-1774708505371.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/20286049/exterior_front_passenger-1774708505371.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2352%252F18832352%252Fexterior_rear_driver-1774780712631.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2352/18832352/exterior_rear_driver-1774780712631.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7824%252F20447824%252Fexterior_rear_driver-1774519558687.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7824/20447824/exterior_rear_driver-1774519558687.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3443%252F18663443%252Fexterior_rear_driver-1774550901126.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3443/18663443/exterior_rear_driver-1774550901126.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7972%252F18327972%252F18327972-interior_dashboard-default-1774694935051.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7972/18327972/18327972-interior_dashboard-default-1774694935051.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0670%252F20490670%252Fexterior_rear_passenger-1774711240596.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0670/20490670/exterior_rear_passenger-1774711240596.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7568%252F20127568%252Fexterior_rear_passenger-1774450823602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7568/20127568/exterior_rear_passenger-1774450823602.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F20286049%252Fexterior_rear_passenger-1774708468234.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/20286049/exterior_rear_passenger-1774708468234.jpg not downloaded yet
2026-03-29 20:06:05 [scrapy.extensions.logstats] INFO: Crawled 45 pages (at 45 pages/min), scraped 16 items (at 16 items/min)
2026-03-29 20:06:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 236MiB
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2352%252F18832352%252Fexterior_front_passenger-1774777146898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2352/18832352/exterior_front_passenger-1774777146898.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7824%252F20447824%252Fexterior_front_passenger-1774519598759.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7824/20447824/exterior_front_passenger-1774519598759.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3443%252F18663443%252Fexterior_front_passenger-1774550924925.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3443/18663443/exterior_front_passenger-1774550924925.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7972%252F18327972%252F18327972-interior_boot-default-1774694921032.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7972/18327972/18327972-interior_boot-default-1774694921032.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0670%252F20490670%252Finterior_front_seats-1774767793254.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0670/20490670/interior_front_seats-1774767793254.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7568%252F20127568%252Finterior_front_seats-1774457411208.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7568/20127568/interior_front_seats-1774457411208.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F20286049%252Finterior_front_seats-1774709047800.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/20286049/interior_front_seats-1774709047800.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2352%252F18832352%252Fexterior_rear_passenger-1774780728906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2352/18832352/exterior_rear_passenger-1774780728906.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7824%252F20447824%252Fexterior_rear_passenger-1774520298935.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7824/20447824/exterior_rear_passenger-1774520298935.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3443%252F18663443%252Fexterior_rear_passenger-1774550908832.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3443/18663443/exterior_rear_passenger-1774550908832.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7972%252F18327972%252Fdamage_dents-1762359569447.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7972/18327972/damage_dents-1762359569447.jpeg already downloaded
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7972%252F18327972%252F18327972-wheels_front_driver-default-1774694935677.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7972/18327972/18327972-wheels_front_driver-default-1774694935677.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0670%252F20490670%252Finterior_rear_seats-1774712015175.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0670/20490670/interior_rear_seats-1774712015175.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7568%252F20127568%252Finterior_rear_seats-1774451652514.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7568/20127568/interior_rear_seats-1774451652514.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F20286049%252Finterior_rear_seats-1774709307991.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/20286049/interior_rear_seats-1774709307991.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2352%252F18832352%252Finterior_front_seats-1774778184474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2352/18832352/interior_front_seats-1774778184474.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7824%252F20447824%252Finterior_front_seats-1774696115268.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7824/20447824/interior_front_seats-1774696115268.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3443%252F18663443%252Finterior_front_seats-1774551372399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3443/18663443/interior_front_seats-1774551372399.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7972%252F18327972%252F18327972-wheels_rear_driver-default-1774694937293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7972/18327972/18327972-wheels_rear_driver-default-1774694937293.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0670%252F20490670%252Finterior_dashboard-1774767872335.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0670/20490670/interior_dashboard-1774767872335.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7568%252F20127568%252Finterior_dashboard-1774782172349.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7568/20127568/interior_dashboard-1774782172349.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F20286049%252Finterior_dashboard-1774709123702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/20286049/interior_dashboard-1774709123702.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2352%252F18832352%252Finterior_rear_seats-1774778207461.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2352/18832352/interior_rear_seats-1774778207461.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7824%252F20447824%252Finterior_rear_seats-1774520357513.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7824/20447824/interior_rear_seats-1774520357513.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3443%252F18663443%252Finterior_rear_seats-1774551400122.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3443/18663443/interior_rear_seats-1774551400122.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0670%252F20490670%252Finterior_boot-1774712028018.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0670/20490670/interior_boot-1774712028018.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7568%252F20127568%252Finterior_boot-1774451561399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7568/20127568/interior_boot-1774451561399.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F20286049%252Finstrument_cluster-1774709149805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/20286049/instrument_cluster-1774709149805.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2352%252F18832352%252Finterior_dashboard-1774778269557.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2352/18832352/interior_dashboard-1774778269557.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7824%252F20447824%252Finterior_dashboard-1774520393898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7824/20447824/interior_dashboard-1774520393898.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3443%252F18663443%252Finterior_dashboard-1774551564030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3443/18663443/interior_dashboard-1774551564030.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0670%252F20490670%252Fdocs_service_history-1774714608840.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1d2266e63d33f276781e5abb0523f14b%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0670/20490670/docs_service_history-1774714608840.jpg?ixlib=js-3.8.0&auto=format&s=1d2266e63d33f276781e5abb0523f14b not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7568%252F20127568%252Fdocs_service_history-1774782126095.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dba0ec2afd3e9183f377a35123948405a%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7568/20127568/docs_service_history-1774782126095.jpg?ixlib=js-3.8.0&auto=format&s=ba0ec2afd3e9183f377a35123948405a not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F20286049%252Finterior_boot-1774709162052.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/20286049/interior_boot-1774709162052.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2352%252F18832352%252Finstrument_cluster-1774780751976.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2352/18832352/instrument_cluster-1774780751976.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7824%252F20447824%252Finstrument_cluster-1774519978121.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7824/20447824/instrument_cluster-1774519978121.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3443%252F18663443%252Finstrument_cluster-1774551470016.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3443/18663443/instrument_cluster-1774551470016.jpg not downloaded yet
2026-03-29 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_front_driver-1774620041755.jpg> (referer: None)
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0670%252F20490670%252Fdocs_service_history-1774714636345.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddeb0d386857660c2b3f13607e1661f1d%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0670/20490670/docs_service_history-1774714636345.jpg?ixlib=js-3.8.0&auto=format&s=deb0d386857660c2b3f13607e1661f1d not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7568%252F20127568%252Fdocs_service_history-1774452109610.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D649e1826c4d05711b59e6f7fab39136c%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7568/20127568/docs_service_history-1774452109610.jpg?ixlib=js-3.8.0&auto=format&s=649e1826c4d05711b59e6f7fab39136c not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F20286049%252Fdamage_scratches-1774708594159.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/20286049/damage_scratches-1774708594159.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2352%252F18832352%252Finterior_boot-1774778276544.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2352/18832352/interior_boot-1774778276544.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7824%252F20447824%252Finterior_boot-1774520073418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7824/20447824/interior_boot-1774520073418.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3443%252F18663443%252Finterior_boot-1774551209964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3443/18663443/interior_boot-1774551209964.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2352%252F18832352%252Fdocs_service_history-1774779986242.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D48e6b0d6f8230eb78f9d2c2bb6ee6106%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2352/18832352/docs_service_history-1774779986242.jpg?ixlib=js-3.8.0&auto=format&s=48e6b0d6f8230eb78f9d2c2bb6ee6106 not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7824%252F20447824%252Fwheels_front_driver-1774519605891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7824/20447824/wheels_front_driver-1774519605891.jpg not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3443%252F18663443%252Fwheels_front_driver-1774550981547.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3443/18663443/wheels_front_driver-1774550981547.jpg not downloaded yet
2026-03-29 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4629/20464629/exterior_front_passenger-1774693188457.jpg> (referer: None)
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0b2010>
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2830%252F19952830%252Fexterior_front_driver-1774620041755.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_front_driver-1774620041755.jpg saved to cache
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e577470-f9f8-5720-833b-da55b593b054
2026-03-29 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_rear_driver-1774620059950.jpg> (referer: None)
2026-03-29 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4629/20464629/exterior_rear_passenger-1774693164142.jpg> (referer: None)
2026-03-29 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_front_passenger-1774620087162.jpg> (referer: None)
2026-03-29 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4629/20464629/interior_front_seats-1774693517302.jpg> (referer: None)
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c755e50>
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e/2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4629%252F20464629%252Fexterior_front_passenger-1774693188457.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4629/20464629/exterior_front_passenger-1774693188457.jpg saved to cache
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e
2026-03-29 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=252&page=7&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c79d910>
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2830%252F19952830%252Fexterior_rear_driver-1774620059950.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_rear_driver-1774620059950.jpg saved to cache
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e577470-f9f8-5720-833b-da55b593b054
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2f5e50>
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e/2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4629%252F20464629%252Fexterior_rear_passenger-1774693164142.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4629/20464629/exterior_rear_passenger-1774693164142.jpg saved to cache
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db6a990>
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2830%252F19952830%252Fexterior_front_passenger-1774620087162.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_front_passenger-1774620087162.jpg saved to cache
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e577470-f9f8-5720-833b-da55b593b054
2026-03-29 20:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e577470-f9f8-5720-833b-da55b593b054, skipping ID generation
2026-03-29 20:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e577470-f9f8-5720-833b-da55b593b054 with scrape type 1
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e577470-f9f8-5720-833b-da55b593b054 sending to next pipeline
2026-03-29 20:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1e577470-f9f8-5720-833b-da55b593b054, identifier: 19952830
2026-03-29 20:06:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce8fa50>
2026-03-29 20:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e/2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4629%252F20464629%252Finterior_front_seats-1774693517302.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4629/20464629/interior_front_seats-1774693517302.jpg saved to cache
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2afcf4f3-d0f5-5e63-9c1c-f1fdc6d17d8e
2026-03-29 20:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1e577470-f9f8-5720-833b-da55b593b054 with identifier: 19952830
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1e577470-f9f8-5720-833b-da55b593b054 with identifier: 19952830
2026-03-29 20:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1e577470-f9f8-5720-833b-da55b593b054 with identifier: 19952830 to the API
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_front_passenger-1774620087162.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '1e577470-f9f8-5720-833b-da55b593b054',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'M900 MNY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19952830',
'listing': 'auction',
'location': 'Greater London Edgware',
'make': 'Smart',
'model': 'fortwo',
'odometer': 50000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 976572,
'Height': 2142,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_front_driver-1774620041755.jpg',
'Width': 2856},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1534757,
'Height': 2612,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_rear_driver-1774620059950.jpg',
'Width': 3483},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2079832,
'Height': 2982,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_front_passenger-1774620087162.jpg',
'Width': 3976},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1214228,
'Height': 2460,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2830/19952830/exterior_rear_passenger-1774620077887.jpg',
'Width': 3280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3535504,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2830/19952830/interior_front_seats-1774620335483.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4300387,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2830/19952830/interior_dashboard-1774620395360.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3923251,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2830/19952830/interior_boot-1774620382477.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1718192,
'Height': 1826,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2830/19952830/docs_service_history-1774620645382.jpg?ixlib=js-3.8.0&auto=format&s=50eac9b2fe51c03e1cd454b8cb3a6776',
'Width': 2564},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348426,
'Height': 1646,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/2830/19952830/docs_service_history-1774701063464.jpg?ixlib=js-3.8.0&auto=format&s=8a93fd9e30923563d897e6b26297cece',
'Width': 2195},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e577470-f9f8-5720-833b-da55b593b054/1e577470-f9f8-5720-833b-da55b593b054_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345997,
'Height': 1654,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/2830/19952830/docs_service_history-1774701063056.jpg?ixlib=js-3.8.0&auto=format&s=170d7e2e0711e9bdc950f8ee3cfad6e4',
'Width': 2205}],
'price': 4494,
'price_includes_vat': False,
'registration_date': '2013-05-26',
'seats_number': None,
'seller_name': None,
'title': 'Smart Fortwo Brabus Xclusive A',
'transmission': 'automatic',
'trim': 'Fortwo Brabus Xclusive A',
'vin': 'WME4514332K685977',
'year': 2013}
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719952830%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [motorway.uk] INFO: Saving data for 19952830: {'created_time': 1774814767.918251, 'last_price_update_time': 1774814767.918263, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19952830') HTTP/1.1" 204 0
2026-03-29 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2352/18832352/docs_service_history-1774779986242.jpg?ixlib=js-3.8.0&auto=format&s=48e6b0d6f8230eb78f9d2c2bb6ee6106> (referer: None)
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 20471425
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 20460179
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 20486036
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 20484858
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 20485204
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 20487941
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 20364057
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 20486965
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 20137059
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 20074064
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 20211024
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720211024%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [motorway.uk] INFO: Scrape type for 20211024: 1
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 15623720
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 3788757
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273788757%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [motorway.uk] INFO: Scrape type for 3788757: 1
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 20490856
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490856%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [motorway.uk] INFO: Scrape type for 20490856: 1
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 3629062
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 17539370
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 19374986
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 8230018
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 20417498
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 20493011
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 19185609
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719185609%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [motorway.uk] INFO: Scrape type for 19185609: 1
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 20459030
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 19077638
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719077638%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [motorway.uk] INFO: Scrape type for 19077638: 1
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c75dd10>
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a9cc52-84ce-57f2-b289-5a209e195aa5/c6a9cc52-84ce-57f2-b289-5a209e195aa5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2352%252F18832352%252Fdocs_service_history-1774779986242.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D48e6b0d6f8230eb78f9d2c2bb6ee6106') HTTP/1.1" 204 0
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2352/18832352/docs_service_history-1774779986242.jpg?ixlib=js-3.8.0&auto=format&s=48e6b0d6f8230eb78f9d2c2bb6ee6106 saved to cache
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6a9cc52-84ce-57f2-b289-5a209e195aa5
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3443/18663443/instrument_cluster-1774551470016.jpg> (referer: None)
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 11018452
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 20107109
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 19998396
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 20254074
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 20487479
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 20436997
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 12193651
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 12187861
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 13059915
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 16021572
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 20368083
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720368083%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [motorway.uk] INFO: Scrape type for 20368083: 1
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 20499187
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499187%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [motorway.uk] INFO: Scrape type for 20499187: 1
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7824/20447824/wheels_front_driver-1774519605891.jpg> (referer: None)
2026-03-29 20:06:08 [motorway.uk] INFO: Found listing with ID: 11654403
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3443/18663443/wheels_front_driver-1774550981547.jpg> (referer: None)
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20372589.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d301ed0>
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fed97f66-d218-5c4b-8f4b-bb24e241aceb/fed97f66-d218-5c4b-8f4b-bb24e241aceb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3443%252F18663443%252Finstrument_cluster-1774551470016.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3443/18663443/instrument_cluster-1774551470016.jpg saved to cache
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fed97f66-d218-5c4b-8f4b-bb24e241aceb
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18322763.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20260509.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485001.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0b6f50>
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b/a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7824%252F20447824%252Fwheels_front_driver-1774519605891.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7824/20447824/wheels_front_driver-1774519605891.jpg saved to cache
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce8ee10>
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fed97f66-d218-5c4b-8f4b-bb24e241aceb/fed97f66-d218-5c4b-8f4b-bb24e241aceb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3443%252F18663443%252Fwheels_front_driver-1774550981547.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3443/18663443/wheels_front_driver-1774550981547.jpg saved to cache
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fed97f66-d218-5c4b-8f4b-bb24e241aceb
2026-03-29 20:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dca530e-49ed-53ab-98d9-22b256fd4813 with identifier: 20372589
2026-03-29 20:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dca530e-49ed-53ab-98d9-22b256fd4813 with scrape type 1
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1dca530e-49ed-53ab-98d9-22b256fd4813
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2589%252F20372589%252Fexterior_front_driver-1774772616113.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2589/20372589/exterior_front_driver-1774772616113.jpg not downloaded yet
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2589%252F20372589%252Fexterior_rear_driver-1774771959388.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2589/20372589/exterior_rear_driver-1774771959388.jpg not downloaded yet
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20158404.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2589%252F20372589%252Fexterior_front_passenger-1774772277173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2589/20372589/exterior_front_passenger-1774772277173.jpg not downloaded yet
2026-03-29 20:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2293d788-5617-5b9e-9b3e-19e5d5f9520a with identifier: 18322763
2026-03-29 20:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2293d788-5617-5b9e-9b3e-19e5d5f9520a with scrape type 2
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2293d788-5617-5b9e-9b3e-19e5d5f9520a with scrape type 2
2026-03-29 20:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2293d788-5617-5b9e-9b3e-19e5d5f9520a, identifier: 18322763
2026-03-29 20:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 581e8de5-b04a-5086-a100-01898fcf7c3f with identifier: 20260509
2026-03-29 20:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 581e8de5-b04a-5086-a100-01898fcf7c3f with scrape type 1
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 581e8de5-b04a-5086-a100-01898fcf7c3f
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F20260509%252Fexterior_front_driver-1774015116390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_front_driver-1774015116390.jpg not downloaded yet
2026-03-29 20:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b314d3e-c26b-5f2a-82df-40dab0c16fa0 with identifier: 20485001
2026-03-29 20:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0 with scrape type 1
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5001%252F20485001%252Fexterior_front_driver-1774693044580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_front_driver-1774693044580.jpg not downloaded yet
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2589%252F20372589%252Fexterior_rear_passenger-1774771982420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2589/20372589/exterior_rear_passenger-1774771982420.jpg not downloaded yet
2026-03-29 20:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2293d788-5617-5b9e-9b3e-19e5d5f9520a with identifier: 18322763
2026-03-29 20:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2293d788-5617-5b9e-9b3e-19e5d5f9520a with identifier: 18322763
2026-03-29 20:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2293d788-5617-5b9e-9b3e-19e5d5f9520a with identifier: 18322763 to the API
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18322763.json>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2293d788-5617-5b9e-9b3e-19e5d5f9520a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YS18 WCE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18322763',
'listing': 'auction',
'location': 'Milton Keynes Milton Keynes',
'make': 'Vauxhall',
'model': 'Zafira',
'odometer': 45368,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 6500,
'price_includes_vat': False,
'registration_date': '2018-06-29',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Zafira Tourer SRI NAV Turbo',
'transmission': 'manual',
'trim': 'Tourer SRI NAV Turbo',
'vin': 'W0VPD9EC2J1153040',
'year': 2018}
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718322763%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [motorway.uk] INFO: Saving data for 18322763: {'auction_closing_time': 1774884600.0, 'created_time': 1774555691.755172, 'last_price_update_time': 1774814769.38072}
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18322763') HTTP/1.1" 204 0
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F20260509%252Fexterior_rear_driver-1774015133287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_rear_driver-1774015133287.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5001%252F20485001%252Fexterior_rear_driver-1774693053470.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_rear_driver-1774693053470.jpg not downloaded yet
2026-03-29 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20468920.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20459750.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2589%252F20372589%252Finterior_front_seats-1774722457944.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2589/20372589/interior_front_seats-1774722457944.jpg not downloaded yet
2026-03-29 20:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9384f570-0a6f-5529-b6db-f87e678ea572 with identifier: 20158404
2026-03-29 20:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9384f570-0a6f-5529-b6db-f87e678ea572 with scrape type 1
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9384f570-0a6f-5529-b6db-f87e678ea572
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F20158404%252Fexterior_front_driver-1773062176386.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_front_driver-1773062176386.jpeg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F20260509%252Fexterior_front_passenger-1774015147969.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_front_passenger-1774015147969.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5001%252F20485001%252Fexterior_front_passenger-1774693054432.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_front_passenger-1774693054432.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2589%252F20372589%252Finterior_rear_seats-1774112349311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2589/20372589/interior_rear_seats-1774112349311.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F20158404%252Fexterior_rear_driver-1773062242022.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_rear_driver-1773062242022.jpeg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F20260509%252Fexterior_rear_passenger-1774015177369.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_rear_passenger-1774015177369.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5001%252F20485001%252Fexterior_rear_passenger-1774693045894.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_rear_passenger-1774693045894.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2589%252F20372589%252Finterior_dashboard-1774771607322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2589/20372589/interior_dashboard-1774771607322.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F20158404%252Fexterior_front_passenger-1773062192837.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_front_passenger-1773062192837.jpeg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0509%252F20260509%252Finterior_front_seats-1774015492773.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0509/20260509/interior_front_seats-1774015492773.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5001%252F20485001%252Finterior_front_seats-1774693924945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5001/20485001/interior_front_seats-1774693924945.jpg not downloaded yet
2026-03-29 20:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa4a2d4a-4f4f-5712-a84a-cff1d2032df5 with identifier: 20468920
2026-03-29 20:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5 with scrape type 1
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8920%252F20468920%252Fexterior_front_driver-1774606748819.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8920/20468920/exterior_front_driver-1774606748819.jpg not downloaded yet
2026-03-29 20:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b7a7af5-f600-5d8a-b3de-e69b71bc5077 with identifier: 20459750
2026-03-29 20:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077 with scrape type 1
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9750%252F20459750%252Fexterior_front_driver-1774703376342.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9750/20459750/exterior_front_driver-1774703376342.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2589%252F20372589%252Finstrument_cluster-1774112352534.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2589/20372589/instrument_cluster-1774112352534.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F20158404%252Fexterior_rear_passenger-1773062229806.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_rear_passenger-1773062229806.jpeg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0509%252F20260509%252Finterior_rear_seats-1774015503705.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0509/20260509/interior_rear_seats-1774015503705.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5001%252F20485001%252Finterior_dashboard-1774693938135.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5001/20485001/interior_dashboard-1774693938135.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8920%252F20468920%252Fexterior_rear_driver-1774606771382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8920/20468920/exterior_rear_driver-1774606771382.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9750%252F20459750%252Fexterior_rear_driver-1774706219940.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9750/20459750/exterior_rear_driver-1774706219940.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2589%252F20372589%252Finterior_boot-1774112343928.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2589/20372589/interior_boot-1774112343928.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8404%252F20158404%252Finterior_front_seats-1773062417573.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8404/20158404/interior_front_seats-1773062417573.jpeg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F20260509%252Finterior_dashboard-1774015519516.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/20260509/interior_dashboard-1774015519516.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5001%252F20485001%252Finstrument_cluster-1774693761110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5001/20485001/instrument_cluster-1774693761110.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8920%252F20468920%252Fexterior_front_passenger-1774606802306.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8920/20468920/exterior_front_passenger-1774606802306.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9750%252F20459750%252Fexterior_front_passenger-1774703375193.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9750/20459750/exterior_front_passenger-1774703375193.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2589%252F20372589%252Fdocs_service_history-1774260565899-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D284a4342c0791cda7bf4ada444ce9258%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2589/20372589/docs_service_history-1774260565899-1.jpeg?ixlib=js-3.8.0&auto=format&s=284a4342c0791cda7bf4ada444ce9258 not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8404%252F20158404%252Finterior_rear_seats-1773062276928.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8404/20158404/interior_rear_seats-1773062276928.jpeg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0509%252F20260509%252Finstrument_cluster-1774694834820.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0509/20260509/instrument_cluster-1774694834820.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5001%252F20485001%252Finterior_boot-1774693922234.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5001/20485001/interior_boot-1774693922234.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8920%252F20468920%252Fexterior_rear_passenger-1774781880270.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8920/20468920/exterior_rear_passenger-1774781880270.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9750%252F20459750%252Fexterior_rear_passenger-1774703376128.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9750/20459750/exterior_rear_passenger-1774703376128.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F20158404%252Finterior_dashboard-1773062321759.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/20158404/interior_dashboard-1773062321759.jpeg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0509%252F20260509%252Finterior_boot-1774015551537.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0509/20260509/interior_boot-1774015551537.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5001%252F20485001%252Fdocs_service_history-1774694085202.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc820e15148f8dec53a930b3bef9b742e%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5001/20485001/docs_service_history-1774694085202.jpg?ixlib=js-3.8.0&auto=format&s=c820e15148f8dec53a930b3bef9b742e not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8920%252F20468920%252Finterior_front_seats-1774607323008.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8920/20468920/interior_front_seats-1774607323008.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9750%252F20459750%252Finterior_front_seats-1774703950204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9750/20459750/interior_front_seats-1774703950204.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F20158404%252Finstrument_cluster-1773062389265.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/20158404/instrument_cluster-1773062389265.jpeg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0509%252F20260509%252Fdocs_service_history-1774015659880.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D21ea7dcb37c7f64cde8e79cd2eb486fa%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0509/20260509/docs_service_history-1774015659880.jpg?ixlib=js-3.8.0&auto=format&s=21ea7dcb37c7f64cde8e79cd2eb486fa not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5001%252F20485001%252Fdocs_service_history-1774694114598.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D787a0658177c11cc70c58c6d97d65b46%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5001/20485001/docs_service_history-1774694114598.jpg?ixlib=js-3.8.0&auto=format&s=787a0658177c11cc70c58c6d97d65b46 not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8920%252F20468920%252Finterior_rear_seats-1774781680913.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8920/20468920/interior_rear_seats-1774781680913.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9750%252F20459750%252Finterior_rear_seats-1774703876966.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9750/20459750/interior_rear_seats-1774703876966.jpg not downloaded yet
2026-03-29 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487615.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8404%252F20158404%252Finterior_boot-1773062294962.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8404/20158404/interior_boot-1773062294962.jpeg not downloaded yet
2026-03-29 20:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19452010.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8920%252F20468920%252Finterior_dashboard-1774781713943.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8920/20468920/interior_dashboard-1774781713943.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9750%252F20459750%252Finterior_dashboard-1774706232064.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9750/20459750/interior_dashboard-1774706232064.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8404%252F20158404%252Fdocs_service_history-1773657246693.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9e13eb07365a2eb2cb67905c9bd4323c%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8404/20158404/docs_service_history-1773657246693.jpeg?ixlib=js-3.8.0&auto=format&s=9e13eb07365a2eb2cb67905c9bd4323c not downloaded yet
2026-03-29 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=288&page=8&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8920%252F20468920%252Finterior_boot-1774607395773.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8920/20468920/interior_boot-1774607395773.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9750%252F20459750%252Finstrument_cluster-1774703943471.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9750/20459750/instrument_cluster-1774703943471.jpg not downloaded yet
2026-03-29 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_front_driver-1774693044580.jpg> (referer: None)
2026-03-29 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3443/18663443/interior_boot-1774551209964.jpg> (referer: None)
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8920%252F20468920%252Fdocs_service_history-1774607649681.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db8a9287a08e8373c293e93dfaaaa893b%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8920/20468920/docs_service_history-1774607649681.jpg?ixlib=js-3.8.0&auto=format&s=b8a9287a08e8373c293e93dfaaaa893b not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9750%252F20459750%252Finterior_boot-1774703877853.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9750/20459750/interior_boot-1774703877853.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8920%252F20468920%252Fdamage_scratches-1774606898554.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8920/20468920/damage_scratches-1774606898554.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9750%252F20459750%252Fdocs_service_history-1774704110632.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D621135dab85628272e834bdce7c49691%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9750/20459750/docs_service_history-1774704110632.jpg?ixlib=js-3.8.0&auto=format&s=621135dab85628272e834bdce7c49691 not downloaded yet
2026-03-29 20:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05321a24-38b3-566c-83a5-58c40ff1251b with identifier: 20487615
2026-03-29 20:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05321a24-38b3-566c-83a5-58c40ff1251b with scrape type 1
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05321a24-38b3-566c-83a5-58c40ff1251b
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7615%252F20487615%252Fexterior_front_driver-1774701462495.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7615/20487615/exterior_front_driver-1774701462495.jpeg not downloaded yet
2026-03-29 20:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2656af1-48dc-5851-b52a-26d35f6a380c with identifier: 19452010
2026-03-29 20:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2656af1-48dc-5851-b52a-26d35f6a380c with scrape type 1
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2656af1-48dc-5851-b52a-26d35f6a380c
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Fexterior_front_driver-1774704502101.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_front_driver-1774704502101.jpeg not downloaded yet
2026-03-29 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6049/20286049/damage_scratches-1774708594159.jpg> (referer: None)
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7615%252F20487615%252Fexterior_rear_driver-1774701510522.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7615/20487615/exterior_rear_driver-1774701510522.jpeg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Fexterior_rear_driver-1774704538531.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_rear_driver-1774704538531.jpeg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7615%252F20487615%252F20487615-exterior_front_passenger-modified-1774703593607.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7615/20487615/20487615-exterior_front_passenger-modified-1774703593607.jpeg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Fexterior_front_passenger-1774704518414.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_front_passenger-1774704518414.jpeg not downloaded yet
2026-03-29 20:06:10 [motorway.uk] INFO: Found listing with ID: 20470032
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720470032%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [motorway.uk] INFO: Scrape type for 20470032: 1
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0db010>
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5001%252F20485001%252Fexterior_front_driver-1774693044580.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_front_driver-1774693044580.jpg saved to cache
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0
2026-03-29 20:06:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce23cd0>
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fed97f66-d218-5c4b-8f4b-bb24e241aceb/fed97f66-d218-5c4b-8f4b-bb24e241aceb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3443%252F18663443%252Finterior_boot-1774551209964.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3443/18663443/interior_boot-1774551209964.jpg saved to cache
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fed97f66-d218-5c4b-8f4b-bb24e241aceb
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7615%252F20487615%252F20487615-exterior_rear_passenger-modified-1774703603053.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7615/20487615/20487615-exterior_rear_passenger-modified-1774703603053.jpeg not downloaded yet
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Fexterior_rear_passenger-1774704529772.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_rear_passenger-1774704529772.jpeg not downloaded yet
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 19734640
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719734640%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 19734640: 1
2026-03-29 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2589/20372589/exterior_rear_driver-1774771959388.jpg> (referer: None)
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7615%252F20487615%252Finterior_front_seats-1774701650151.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7615/20487615/interior_front_seats-1774701650151.jpeg not downloaded yet
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2010%252F19452010%252Finterior_front_seats-1774704565874.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2010/19452010/interior_front_seats-1774704565874.jpeg not downloaded yet
2026-03-29 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2589/20372589/exterior_rear_passenger-1774771982420.jpg> (referer: None)
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20455021
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20237507
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20489983
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489983%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 20489983: 1
2026-03-29 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7824/20447824/interior_boot-1774520073418.jpg> (referer: None)
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7615%252F20487615%252Finterior_rear_seats-1774701667172.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7615/20487615/interior_rear_seats-1774701667172.jpeg not downloaded yet
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2010%252F19452010%252Finterior_rear_seats-1774704631398.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2010/19452010/interior_rear_seats-1774704631398.jpeg not downloaded yet
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d72dc50>
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040161ab-964b-5100-877d-b6ed73aba9d3/040161ab-964b-5100-877d-b6ed73aba9d3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F20286049%252Fdamage_scratches-1774708594159.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/20286049/damage_scratches-1774708594159.jpg saved to cache
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 040161ab-964b-5100-877d-b6ed73aba9d3
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20393410
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720393410%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 20393410: 1
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7615%252F20487615%252F20487615-interior_dashboard-modified-1774703578690.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7615/20487615/20487615-interior_dashboard-modified-1774703578690.jpeg not downloaded yet
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Finterior_dashboard-1774704689555.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/interior_dashboard-1774704689555.jpeg not downloaded yet
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 19840923
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719840923%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 19840923: 1
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7615%252F20487615%252Finterior_boot-1774701703525.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7615/20487615/interior_boot-1774701703525.jpeg not downloaded yet
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Finstrument_cluster-1774704724878.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/instrument_cluster-1774704724878.jpeg not downloaded yet
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20462094
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 16271814
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 16318590
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20487406
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 19679688
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 16422959
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716422959%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 16422959: 1
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d09e0d0>
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2589%252F20372589%252Fexterior_rear_driver-1774771959388.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2589/20372589/exterior_rear_driver-1774771959388.jpg saved to cache
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1dca530e-49ed-53ab-98d9-22b256fd4813
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc11450>
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2589%252F20372589%252Fexterior_rear_passenger-1774771982420.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2589/20372589/exterior_rear_passenger-1774771982420.jpg saved to cache
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1dca530e-49ed-53ab-98d9-22b256fd4813
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c76fd10>
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b/a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7824%252F20447824%252Finterior_boot-1774520073418.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7824/20447824/interior_boot-1774520073418.jpg saved to cache
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7615%252F20487615%252Fdocs_service_history-1774702287594.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2af7faa8cd37ff386a1b39847120cd44%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7615/20487615/docs_service_history-1774702287594.jpeg?ixlib=js-3.8.0&auto=format&s=2af7faa8cd37ff386a1b39847120cd44 not downloaded yet
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2010%252F19452010%252Finterior_boot-1774704705169.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2010/19452010/interior_boot-1774704705169.jpeg not downloaded yet
2026-03-29 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20499187.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20496326
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 14326949
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714326949%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 14326949: 1
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7615%252F20487615%252Fdocs_service_history-1774702319504.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7055e7e9c8047699dcb3013747216479%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7615/20487615/docs_service_history-1774702319504.jpeg?ixlib=js-3.8.0&auto=format&s=7055e7e9c8047699dcb3013747216479 not downloaded yet
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Fwheels_front_driver-1774704731313.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/wheels_front_driver-1774704731313.jpeg not downloaded yet
2026-03-29 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19077638.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20457094
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20453358
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 19940066
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 13623460
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 19930182
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 19899454
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 19785042
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 18874288
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20490925
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490925%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 20490925: 1
2026-03-29 20:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 8725249
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20487634
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20485866
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485866%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 20485866: 1
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20387201
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 18839860
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718839860%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 18839860: 1
2026-03-29 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2352/18832352/interior_boot-1774778276544.jpg> (referer: None)
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 17987243
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 14223294
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20439498
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20130616
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 19164973
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 19699947
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719699947%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 19699947: 1
2026-03-29 20:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f3b8e4c-0c02-5501-adb2-dc1084ff567f with identifier: 20499187
2026-03-29 20:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f with scrape type 1
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9187%252F20499187%252Fexterior_front_driver-1774770977210.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9187/20499187/exterior_front_driver-1774770977210.jpg not downloaded yet
2026-03-29 20:06:12 [motorway.uk] INFO: Found listing with ID: 20316056
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9187%252F20499187%252Fexterior_rear_driver-1774773882719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9187/20499187/exterior_rear_driver-1774773882719.jpg not downloaded yet
2026-03-29 20:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c with identifier: 19077638
2026-03-29 20:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c with scrape type 1
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7638%252F19077638%252Fexterior_front_driver-1774697138862.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_front_driver-1774697138862.jpg not downloaded yet
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9750/20459750/interior_dashboard-1774706232064.jpg> (referer: None)
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9187%252F20499187%252Fexterior_front_passenger-1774773901238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9187/20499187/exterior_front_passenger-1774773901238.jpg not downloaded yet
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7638%252F19077638%252Fexterior_rear_driver-1774697174506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_rear_driver-1774697174506.jpg not downloaded yet
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9187%252F20499187%252Fexterior_rear_passenger-1774771022491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9187/20499187/exterior_rear_passenger-1774771022491.jpg not downloaded yet
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7638%252F19077638%252Fexterior_front_passenger-1774697169162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_front_passenger-1774697169162.jpg not downloaded yet
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19185609.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8404/20158404/docs_service_history-1773657246693.jpeg?ixlib=js-3.8.0&auto=format&s=9e13eb07365a2eb2cb67905c9bd4323c> (referer: None)
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9187%252F20499187%252Finterior_front_seats-1774771433482.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9187/20499187/interior_front_seats-1774771433482.jpg not downloaded yet
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7638%252F19077638%252Fexterior_rear_passenger-1774697172394.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_rear_passenger-1774697172394.jpg not downloaded yet
2026-03-29 20:06:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dea9590>
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a9cc52-84ce-57f2-b289-5a209e195aa5/c6a9cc52-84ce-57f2-b289-5a209e195aa5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2352%252F18832352%252Finterior_boot-1774778276544.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2352/18832352/interior_boot-1774778276544.jpg saved to cache
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6a9cc52-84ce-57f2-b289-5a209e195aa5
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9187%252F20499187%252Finterior_rear_seats-1774771463673.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9187/20499187/interior_rear_seats-1774771463673.jpg not downloaded yet
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7638%252F19077638%252Finterior_front_seats-1774697412725.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7638/19077638/interior_front_seats-1774697412725.jpg not downloaded yet
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20368083.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9750/20459750/interior_rear_seats-1774703876966.jpg> (referer: None)
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9187%252F20499187%252Finterior_dashboard-1774784455438.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9187/20499187/interior_dashboard-1774784455438.jpg not downloaded yet
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7638%252F19077638%252Finterior_rear_seats-1774697424122.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7638/19077638/interior_rear_seats-1774697424122.jpg not downloaded yet
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d3f2010>
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9750%252F20459750%252Finterior_dashboard-1774706232064.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9750/20459750/interior_dashboard-1774706232064.jpg saved to cache
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077
2026-03-29 20:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63fe8396-f096-59f8-8c96-5d4b4dee4d1e with identifier: 19185609
2026-03-29 20:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e with scrape type 1
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5609%252F19185609%252Fexterior_front_driver-1774447215061.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_front_driver-1774447215061.jpeg not downloaded yet
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4eb4d0>
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8404%252F20158404%252Fdocs_service_history-1773657246693.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9e13eb07365a2eb2cb67905c9bd4323c') HTTP/1.1" 204 0
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8404/20158404/docs_service_history-1773657246693.jpeg?ixlib=js-3.8.0&auto=format&s=9e13eb07365a2eb2cb67905c9bd4323c saved to cache
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9384f570-0a6f-5529-b6db-f87e678ea572
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9187%252F20499187%252Finstrument_cluster-1774784247948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9187/20499187/instrument_cluster-1774784247948.jpg not downloaded yet
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7638%252F19077638%252Finterior_dashboard-1774702343981.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7638/19077638/interior_dashboard-1774702343981.jpg not downloaded yet
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5609%252F19185609%252Fexterior_rear_driver-1774447277002.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_rear_driver-1774447277002.jpeg not downloaded yet
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9187%252F20499187%252Finterior_boot-1774771523863.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9187/20499187/interior_boot-1774771523863.jpg not downloaded yet
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7638%252F19077638%252Finstrument_cluster-1774702368987.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7638/19077638/instrument_cluster-1774702368987.jpg not downloaded yet
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490856.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8920/20468920/interior_rear_seats-1774781680913.jpg> (referer: None)
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5609%252F19185609%252Fexterior_front_passenger-1774447227280.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_front_passenger-1774447227280.jpeg not downloaded yet
2026-03-29 20:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75da13d5-2bc3-5198-824f-3fd629678864 with identifier: 20368083
2026-03-29 20:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75da13d5-2bc3-5198-824f-3fd629678864 with scrape type 1
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75da13d5-2bc3-5198-824f-3fd629678864
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8083%252F20368083%252Fexterior_front_driver-1774699170305.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_front_driver-1774699170305.jpg not downloaded yet
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cec8c10>
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9750%252F20459750%252Finterior_rear_seats-1774703876966.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9750/20459750/interior_rear_seats-1774703876966.jpg saved to cache
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9187%252F20499187%252Fdocs_service_history-1774784230214.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D72c121ab75cd721db61ae7c140a40ac0%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9187/20499187/docs_service_history-1774784230214.jpg?ixlib=js-3.8.0&auto=format&s=72c121ab75cd721db61ae7c140a40ac0 not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7638%252F19077638%252Finterior_boot-1774697514104.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7638/19077638/interior_boot-1774697514104.jpg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5609%252F19185609%252Fexterior_rear_passenger-1774447267281.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_rear_passenger-1774447267281.jpeg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8083%252F20368083%252Fexterior_rear_driver-1774699167415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_rear_driver-1774699167415.jpg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7638%252F19077638%252Fwheels_front_driver-1774697202903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7638/19077638/wheels_front_driver-1774697202903.jpg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5609%252F19185609%252Finterior_front_seats-1774447679071.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5609/19185609/interior_front_seats-1774447679071.jpeg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8083%252F20368083%252Fexterior_front_passenger-1774699167934.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_front_passenger-1774699167934.jpg not downloaded yet
2026-03-29 20:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da51e94-1669-5c0f-94f5-ee473531088c with identifier: 20490856
2026-03-29 20:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da51e94-1669-5c0f-94f5-ee473531088c with scrape type 1
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6da51e94-1669-5c0f-94f5-ee473531088c
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0856%252F20490856%252Fexterior_front_driver-1774711515585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_front_driver-1774711515585.jpg not downloaded yet
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4cfad0>
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8920%252F20468920%252Finterior_rear_seats-1774781680913.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8920/20468920/interior_rear_seats-1774781680913.jpg saved to cache
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5609%252F19185609%252Finterior_rear_seats-1774447499784.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5609/19185609/interior_rear_seats-1774447499784.jpeg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8083%252F20368083%252Fexterior_rear_passenger-1774699173453.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_rear_passenger-1774699173453.jpg not downloaded yet
2026-03-29 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7615/20487615/docs_service_history-1774702287594.jpeg?ixlib=js-3.8.0&auto=format&s=2af7faa8cd37ff386a1b39847120cd44> (referer: None)
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0856%252F20490856%252Fexterior_rear_driver-1774711416403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_rear_driver-1774711416403.jpg not downloaded yet
2026-03-29 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9187/20499187/instrument_cluster-1774784247948.jpg> (referer: None)
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5609%252F19185609%252Finterior_dashboard-1774447611427.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5609/19185609/interior_dashboard-1774447611427.jpeg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8083%252F20368083%252Finterior_front_seats-1774699444371.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8083/20368083/interior_front_seats-1774699444371.jpg not downloaded yet
2026-03-29 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3788757.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0856%252F20490856%252Fexterior_front_passenger-1774711420296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_front_passenger-1774711420296.jpg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5609%252F19185609%252F19185609-instrument_cluster-modified-1774452495283.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5609/19185609/19185609-instrument_cluster-modified-1774452495283.jpeg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8083%252F20368083%252Finterior_rear_seats-1774699458709.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8083/20368083/interior_rear_seats-1774699458709.jpg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0856%252F20490856%252Fexterior_rear_passenger-1774711422770.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_rear_passenger-1774711422770.jpg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5609%252F19185609%252Finterior_boot-1774447645720.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5609/19185609/interior_boot-1774447645720.jpeg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8083%252F20368083%252Finterior_dashboard-1774699502597.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8083/20368083/interior_dashboard-1774699502597.jpg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0856%252F20490856%252Finterior_front_seats-1774713532139.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0856/20490856/interior_front_seats-1774713532139.jpg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5609%252F19185609%252F19185609-docs_service_history-default-1774623043465.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da07ad3f923698700df0ad66a9599761e%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5609/19185609/19185609-docs_service_history-default-1774623043465.jpeg?ixlib=js-3.8.0&auto=format&s=a07ad3f923698700df0ad66a9599761e not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8083%252F20368083%252Finstrument_cluster-1774699486898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8083/20368083/instrument_cluster-1774699486898.jpg not downloaded yet
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f40ca90>
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7615%252F20487615%252Fdocs_service_history-1774702287594.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2af7faa8cd37ff386a1b39847120cd44') HTTP/1.1" 204 0
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7615/20487615/docs_service_history-1774702287594.jpeg?ixlib=js-3.8.0&auto=format&s=2af7faa8cd37ff386a1b39847120cd44 saved to cache
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05321a24-38b3-566c-83a5-58c40ff1251b
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d693090>
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9187%252F20499187%252Finstrument_cluster-1774784247948.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9187/20499187/instrument_cluster-1774784247948.jpg saved to cache
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0856%252F20490856%252Finterior_rear_seats-1774713478483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0856/20490856/interior_rear_seats-1774713478483.jpg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8083%252F20368083%252Finterior_boot-1774699454555.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8083/20368083/interior_boot-1774699454555.jpg not downloaded yet
2026-03-29 20:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36e3fc75-be3d-51d6-8532-de6518729a07 with identifier: 3788757
2026-03-29 20:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36e3fc75-be3d-51d6-8532-de6518729a07 with scrape type 1
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36e3fc75-be3d-51d6-8532-de6518729a07
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8757%252F3788757%252Fexterior_front_driver-1772979804382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_front_driver-1772979804382.jpg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0856%252F20490856%252Finterior_dashboard-1774715187001.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0856/20490856/interior_dashboard-1774715187001.jpg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8083%252F20368083%252Fdocs_service_history-1774699655501.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd0baa1c4cec6692ed7e61d4f32024420%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8083/20368083/docs_service_history-1774699655501.jpg?ixlib=js-3.8.0&auto=format&s=d0baa1c4cec6692ed7e61d4f32024420 not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8757%252F3788757%252Fexterior_rear_driver-1772979820012.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_rear_driver-1772979820012.jpg not downloaded yet
2026-03-29 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_front_driver-1774447215061.jpeg> (referer: None)
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0856%252F20490856%252Finterior_boot-1774713487156.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0856/20490856/interior_boot-1774713487156.jpg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8757%252F3788757%252Fexterior_front_passenger-1772979842275.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_front_passenger-1772979842275.jpg not downloaded yet
2026-03-29 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19840923.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0856%252F20490856%252Fdocs_service_history-1774713913000.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dac1597112003ae406a8e59d32acf4c77%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0856/20490856/docs_service_history-1774713913000.jpg?ixlib=js-3.8.0&auto=format&s=ac1597112003ae406a8e59d32acf4c77 not downloaded yet
2026-03-29 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14326949.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8757%252F3788757%252Fexterior_rear_passenger-1772979830307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_rear_passenger-1772979830307.jpg not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0856%252F20490856%252Fdocs_service_history-1774713962453.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1716d8f953b22e6623680b250643a724%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0856/20490856/docs_service_history-1774713962453.jpg?ixlib=js-3.8.0&auto=format&s=1716d8f953b22e6623680b250643a724 not downloaded yet
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8757%252F3788757%252Finterior_front_seats-1772979867345.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8757/3788757/interior_front_seats-1772979867345.jpg not downloaded yet
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce97dd0>
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5609%252F19185609%252Fexterior_front_driver-1774447215061.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_front_driver-1774447215061.jpeg saved to cache
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_front_passenger-1774699167934.jpg> (referer: None)
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8757%252F3788757%252Finterior_rear_seats-1772978836573.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8757/3788757/interior_rear_seats-1772978836573.jpg not downloaded yet
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_rear_driver-1774711416403.jpg> (referer: None)
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8757%252F3788757%252Finterior_dashboard-1772979916992.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8757/3788757/interior_dashboard-1772979916992.jpg not downloaded yet
2026-03-29 20:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b52b6e7-c25d-59ce-a933-f867b4cb65e5 with identifier: 19840923
2026-03-29 20:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5 with scrape type 1
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0923%252F19840923%252Fexterior_front_driver-1774693121906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_front_driver-1774693121906.jpg not downloaded yet
2026-03-29 20:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799482ba-48b7-5a56-8b9f-29ae5ee026bf with identifier: 14326949
2026-03-29 20:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf with scrape type 1
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6949%252F14326949%252Fexterior_front_driver-1774693292141.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6949/14326949/exterior_front_driver-1774693292141.jpg not downloaded yet
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8757%252F3788757%252Finterior_boot-1772978851172.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8757/3788757/interior_boot-1772978851172.jpg not downloaded yet
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0923%252F19840923%252Fexterior_rear_driver-1774693080903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_rear_driver-1774693080903.jpg not downloaded yet
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6949%252F14326949%252Fexterior_rear_driver-1774714714948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6949/14326949/exterior_rear_driver-1774714714948.jpg not downloaded yet
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2010/19452010/instrument_cluster-1774704724878.jpeg> (referer: None)
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8757%252F3788757%252Fdocs_service_history-1772979406707.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc04da6e58354d5d69edbbdc6c6a5df94%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8757/3788757/docs_service_history-1772979406707.jpg?ixlib=js-3.8.0&auto=format&s=c04da6e58354d5d69edbbdc6c6a5df94 not downloaded yet
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0923%252F19840923%252Fexterior_front_passenger-1774693603815.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_front_passenger-1774693603815.jpg not downloaded yet
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6949%252F14326949%252Fexterior_front_passenger-1774693335242.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6949/14326949/exterior_front_passenger-1774693335242.jpg not downloaded yet
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f49d1d0>
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8083%252F20368083%252Fexterior_front_passenger-1774699167934.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_front_passenger-1774699167934.jpg saved to cache
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75da13d5-2bc3-5198-824f-3fd629678864
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8757%252F3788757%252Fdocs_service_history-1774527464778.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D13d0f8b6b70a9772f6611e999da26f68%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8757/3788757/docs_service_history-1774527464778.jpg?ixlib=js-3.8.0&auto=format&s=13d0f8b6b70a9772f6611e999da26f68 not downloaded yet
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0923%252F19840923%252Fexterior_rear_passenger-1774693529323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_rear_passenger-1774693529323.jpg not downloaded yet
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6949%252F14326949%252Fexterior_rear_passenger-1774693323244.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6949/14326949/exterior_rear_passenger-1774693323244.jpg not downloaded yet
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16422959.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de55910>
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0856%252F20490856%252Fexterior_rear_driver-1774711416403.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_rear_driver-1774711416403.jpg saved to cache
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6da51e94-1669-5c0f-94f5-ee473531088c
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_rear_passenger-1774699173453.jpg> (referer: None)
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0923%252F19840923%252Finterior_front_seats-1773412396570.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0923/19840923/interior_front_seats-1773412396570.jpg not downloaded yet
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6949%252F14326949%252Finterior_front_seats-1774693863203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6949/14326949/interior_front_seats-1774693863203.jpg not downloaded yet
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18839860.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:14 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:14 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:14 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00%0W\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xf2\x93\x00%%\xc5\x00\x00\x00\x00'
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f43e9d0>
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Finstrument_cluster-1774704724878.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/instrument_cluster-1774704724878.jpeg saved to cache
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2656af1-48dc-5851-b52a-26d35f6a380c
2026-03-29 20:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8 with identifier: 16422959
2026-03-29 20:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8 with scrape type 1
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2959%252F16422959%252F16422959-exterior_front_driver-default-1774622676475.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_front_driver-default-1774622676475.jpg not downloaded yet
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0923%252F19840923%252Finterior_rear_seats-1773412406883.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0923/19840923/interior_rear_seats-1773412406883.jpg not downloaded yet
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6949%252F14326949%252Finterior_rear_seats-1774693871776.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6949/14326949/interior_rear_seats-1774693871776.jpg not downloaded yet
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2959%252F16422959%252F16422959-exterior_rear_driver-default-1774622664429.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_rear_driver-default-1774622664429.jpg not downloaded yet
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0923%252F19840923%252Finterior_dashboard-1774697143833.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0923/19840923/interior_dashboard-1774697143833.jpg not downloaded yet
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6949%252F14326949%252Finterior_dashboard-1774714739670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6949/14326949/interior_dashboard-1774714739670.jpg not downloaded yet
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f492610>
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8083%252F20368083%252Fexterior_rear_passenger-1774699173453.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_rear_passenger-1774699173453.jpg saved to cache
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75da13d5-2bc3-5198-824f-3fd629678864
2026-03-29 20:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa718542-c1ad-58a3-aabb-52273d4419ce with identifier: 18839860
2026-03-29 20:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa718542-c1ad-58a3-aabb-52273d4419ce with scrape type 1
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa718542-c1ad-58a3-aabb-52273d4419ce
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9860%252F18839860%252Fexterior_front_driver-1774450237400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_front_driver-1774450237400.jpg not downloaded yet
2026-03-29 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7638/19077638/interior_dashboard-1774702343981.jpg> (referer: None)
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2959%252F16422959%252F16422959-exterior_front_passenger-default-1774622691966.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_front_passenger-default-1774622691966.jpg not downloaded yet
2026-03-29 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9187/20499187/interior_dashboard-1774784455438.jpg> (referer: None)
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0923%252F19840923%252Finstrument_cluster-1773412495407.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0923/19840923/instrument_cluster-1773412495407.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6949%252F14326949%252Finstrument_cluster-1774714776462.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6949/14326949/instrument_cluster-1774714776462.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9860%252F18839860%252Fexterior_rear_driver-1774450228520.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_rear_driver-1774450228520.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2959%252F16422959%252F16422959-exterior_rear_passenger-default-1774622671888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_rear_passenger-default-1774622671888.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0923%252F19840923%252Finterior_boot-1773412458134.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0923/19840923/interior_boot-1773412458134.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6949%252F14326949%252Finterior_boot-1774714752467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6949/14326949/interior_boot-1774714752467.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9860%252F18839860%252Fexterior_front_passenger-1774450343697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_front_passenger-1774450343697.jpg not downloaded yet
2026-03-29 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_front_passenger-1772979842275.jpg> (referer: None)
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2959%252F16422959%252F16422959-interior_front_seats-default-1774622618875.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2959/16422959/16422959-interior_front_seats-default-1774622618875.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0923%252F19840923%252Fdocs_service_history-1773412666988.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59ce847504eb3f72ef10ea164834369c%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0923/19840923/docs_service_history-1773412666988.jpg?ixlib=js-3.8.0&auto=format&s=59ce847504eb3f72ef10ea164834369c not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6949%252F14326949%252Fdocs_service_history-1774694230247.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6d6e181800c624293f64ab86c50c5e8a%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6949/14326949/docs_service_history-1774694230247.jpg?ixlib=js-3.8.0&auto=format&s=6d6e181800c624293f64ab86c50c5e8a not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9860%252F18839860%252Fexterior_rear_passenger-1774450230202.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_rear_passenger-1774450230202.jpg not downloaded yet
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f43d250>
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7638%252F19077638%252Finterior_dashboard-1774702343981.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7638/19077638/interior_dashboard-1774702343981.jpg saved to cache
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2959%252F16422959%252F16422959-interior_rear_seats-default-1774622624686.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2959/16422959/16422959-interior_rear_seats-default-1774622624686.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9860%252F18839860%252Finterior_front_seats-1774450455691.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9860/18839860/interior_front_seats-1774450455691.jpg not downloaded yet
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4ec3d0>
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9187%252F20499187%252Finterior_dashboard-1774784455438.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9187/20499187/interior_dashboard-1774784455438.jpg saved to cache
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2959%252F16422959%252F16422959-interior_dashboard-default-1774622714591.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-interior_dashboard-default-1774622714591.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9860%252F18839860%252Finterior_rear_seats-1774450571474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9860/18839860/interior_rear_seats-1774450571474.jpg not downloaded yet
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4ddd90>
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8757%252F3788757%252Fexterior_front_passenger-1772979842275.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_front_passenger-1772979842275.jpg saved to cache
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36e3fc75-be3d-51d6-8532-de6518729a07
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2959%252F16422959%252F16422959-instrument_cluster-modified-1758443582157.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2959/16422959/16422959-instrument_cluster-modified-1758443582157.jpeg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9860%252F18839860%252Finterior_dashboard-1774450622756.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9860/18839860/interior_dashboard-1774450622756.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2959%252F16422959%252F16422959-interior_boot-default-1774622628036.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2959/16422959/16422959-interior_boot-default-1774622628036.jpg not downloaded yet
2026-03-29 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7638/19077638/interior_rear_seats-1774697424122.jpg> (referer: None)
2026-03-29 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5609/19185609/interior_front_seats-1774447679071.jpeg> (referer: None)
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9860%252F18839860%252Finstrument_cluster-1774450631142.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9860/18839860/instrument_cluster-1774450631142.jpg not downloaded yet
2026-03-29 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2010/19452010/interior_boot-1774704705169.jpeg> (referer: None)
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2959%252F16422959%252F16422959-damage_scratches-default-1758444925425.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2959/16422959/16422959-damage_scratches-default-1758444925425.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9860%252F18839860%252Finterior_boot-1774450649456.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9860/18839860/interior_boot-1774450649456.jpg not downloaded yet
2026-03-29 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7615/20487615/interior_boot-1774701703525.jpeg> (referer: None)
2026-03-29 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0856/20490856/interior_dashboard-1774715187001.jpg> (referer: None)
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9860%252F18839860%252Fdocs_service_history-1774522306683-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1c33b20b98308fc3bb733207413455b9%27 HTTP/1.1" 200 None
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9860/18839860/docs_service_history-1774522306683-2.jpeg?ixlib=js-3.8.0&auto=format&s=1c33b20b98308fc3bb733207413455b9 not downloaded yet
2026-03-29 20:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5609/19185609/interior_rear_seats-1774447499784.jpeg> (referer: None)
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0969d0>
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7638%252F19077638%252Finterior_rear_seats-1774697424122.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7638/19077638/interior_rear_seats-1774697424122.jpg saved to cache
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00%\xd4\xdc\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xf9+\x00%\xca\xca\x00\x00\x00\x00'
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f385ad0>
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5609%252F19185609%252Finterior_front_seats-1774447679071.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5609/19185609/interior_front_seats-1774447679071.jpeg saved to cache
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00<K\x14\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xd4\xca\x00<@\x82\x00\x00\x00\x00'
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddab790>
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2010%252F19452010%252Finterior_boot-1774704705169.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2010/19452010/interior_boot-1774704705169.jpeg saved to cache
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2656af1-48dc-5851-b52a-26d35f6a380c
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00?.\x1a\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x9c\xae\x00?$\x08\x00\x00\x00\x00'
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4b1410>
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7615%252F20487615%252Finterior_boot-1774701703525.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7615/20487615/interior_boot-1774701703525.jpeg saved to cache
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05321a24-38b3-566c-83a5-58c40ff1251b
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f44a1d0>
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0856%252F20490856%252Finterior_dashboard-1774715187001.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0856/20490856/interior_dashboard-1774715187001.jpg saved to cache
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6da51e94-1669-5c0f-94f5-ee473531088c
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:16 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00-=+\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x94W\x00-3\x19\x00\x00\x00\x00'
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0b7ad0>
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5609%252F19185609%252Finterior_rear_seats-1774447499784.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5609/19185609/interior_rear_seats-1774447499784.jpeg saved to cache
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e
2026-03-29 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0923/19840923/interior_rear_seats-1773412406883.jpg> (referer: None)
2026-03-29 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9860/18839860/interior_front_seats-1774450455691.jpg> (referer: None)
2026-03-29 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6949/14326949/interior_front_seats-1774693863203.jpg> (referer: None)
2026-03-29 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6949/14326949/interior_rear_seats-1774693871776.jpg> (referer: None)
2026-03-29 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_front_driver-default-1774622676475.jpg> (referer: None)
2026-03-29 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-interior_dashboard-default-1774622714591.jpg> (referer: None)
2026-03-29 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8757/3788757/interior_front_seats-1772979867345.jpg> (referer: None)
2026-03-29 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2959/16422959/16422959-interior_rear_seats-default-1774622624686.jpg> (referer: None)
2026-03-29 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8757/3788757/interior_rear_seats-1772978836573.jpg> (referer: None)
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f26c090>
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0923%252F19840923%252Finterior_rear_seats-1773412406883.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0923/19840923/interior_rear_seats-1773412406883.jpg saved to cache
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5
2026-03-29 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9860/18839860/docs_service_history-1774522306683-2.jpeg?ixlib=js-3.8.0&auto=format&s=1c33b20b98308fc3bb733207413455b9> (referer: None)
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f26be90>
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9860%252F18839860%252Finterior_front_seats-1774450455691.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9860/18839860/interior_front_seats-1774450455691.jpg saved to cache
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa718542-c1ad-58a3-aabb-52273d4419ce
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddfb490>
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6949%252F14326949%252Finterior_front_seats-1774693863203.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6949/14326949/interior_front_seats-1774693863203.jpg saved to cache
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc705d0>
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6949%252F14326949%252Finterior_rear_seats-1774693871776.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6949/14326949/interior_rear_seats-1774693871776.jpg saved to cache
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8b04d0>
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2959%252F16422959%252F16422959-exterior_front_driver-default-1774622676475.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_front_driver-default-1774622676475.jpg saved to cache
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc71790>
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2959%252F16422959%252F16422959-interior_dashboard-default-1774622714591.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-interior_dashboard-default-1774622714591.jpg saved to cache
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S911B\x00'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S911BXXS8EZA1\x00'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:08 14:24:16\x00'
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e13ca10>
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8757%252F3788757%252Finterior_front_seats-1772979867345.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8757/3788757/interior_front_seats-1772979867345.jpg saved to cache
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36e3fc75-be3d-51d6-8532-de6518729a07
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c766050>
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2959%252F16422959%252F16422959-interior_rear_seats-default-1774622624686.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2959/16422959/16422959-interior_rear_seats-default-1774622624686.jpg saved to cache
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S911B\x00'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S911BXXS8EZA1\x00'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:08 14:06:17\x00'
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddf9d10>
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8757%252F3788757%252Finterior_rear_seats-1772978836573.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8757/3788757/interior_rear_seats-1772978836573.jpg saved to cache
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36e3fc75-be3d-51d6-8532-de6518729a07
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d582950>
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9860%252F18839860%252Fdocs_service_history-1774522306683-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1c33b20b98308fc3bb733207413455b9') HTTP/1.1" 204 0
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9860/18839860/docs_service_history-1774522306683-2.jpeg?ixlib=js-3.8.0&auto=format&s=1c33b20b98308fc3bb733207413455b9 saved to cache
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa718542-c1ad-58a3-aabb-52273d4419ce
2026-03-29 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2959/16422959/16422959-damage_scratches-default-1758444925425.jpg> (referer: None)
2026-03-29 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9860/18839860/interior_boot-1774450649456.jpg> (referer: None)
2026-03-29 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9860/18839860/interior_rear_seats-1774450571474.jpg> (referer: None)
2026-03-29 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9860/18839860/instrument_cluster-1774450631142.jpg> (referer: None)
2026-03-29 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9860/18839860/interior_dashboard-1774450622756.jpg> (referer: None)
2026-03-29 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2959/16422959/16422959-instrument_cluster-modified-1758443582157.jpeg> (referer: None)
2026-03-29 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2959/16422959/16422959-interior_boot-default-1774622628036.jpg> (referer: None)
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d982510>
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2959%252F16422959%252F16422959-damage_scratches-default-1758444925425.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2959/16422959/16422959-damage_scratches-default-1758444925425.jpg saved to cache
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5c5510>
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9860%252F18839860%252Finterior_boot-1774450649456.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9860/18839860/interior_boot-1774450649456.jpg saved to cache
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa718542-c1ad-58a3-aabb-52273d4419ce
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d582ed0>
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9860%252F18839860%252Finterior_rear_seats-1774450571474.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9860/18839860/interior_rear_seats-1774450571474.jpg saved to cache
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa718542-c1ad-58a3-aabb-52273d4419ce
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d980e90>
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9860%252F18839860%252Finstrument_cluster-1774450631142.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9860/18839860/instrument_cluster-1774450631142.jpg saved to cache
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa718542-c1ad-58a3-aabb-52273d4419ce
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5cf3d0>
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9860%252F18839860%252Finterior_dashboard-1774450622756.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9860/18839860/interior_dashboard-1774450622756.jpg saved to cache
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa718542-c1ad-58a3-aabb-52273d4419ce
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00j\xf2\x10\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\xc0C\x00j\xe8\x0c\x00\x00\x00\x00'
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5c5c50>
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2959%252F16422959%252F16422959-instrument_cluster-modified-1758443582157.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2959/16422959/16422959-instrument_cluster-modified-1758443582157.jpeg saved to cache
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f281a50>
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2959%252F16422959%252F16422959-interior_boot-default-1774622628036.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2959/16422959/16422959-interior_boot-default-1774622628036.jpg saved to cache
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6949/14326949/instrument_cluster-1774714776462.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0856/20490856/interior_boot-1774713487156.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6949/14326949/docs_service_history-1774694230247.jpg?ixlib=js-3.8.0&auto=format&s=6d6e181800c624293f64ab86c50c5e8a> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0923/19840923/docs_service_history-1773412666988.jpg?ixlib=js-3.8.0&auto=format&s=59ce847504eb3f72ef10ea164834369c> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_rear_passenger-1774450230202.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_front_passenger-1774450343697.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_rear_driver-1774450228520.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0923/19840923/instrument_cluster-1773412495407.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6949/14326949/interior_boot-1774714752467.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0923/19840923/interior_boot-1773412458134.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_rear_passenger-default-1774622671888.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2959/16422959/16422959-interior_front_seats-default-1774622618875.jpg> (referer: None)
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f38da90>
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6949%252F14326949%252Finstrument_cluster-1774714776462.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6949/14326949/instrument_cluster-1774714776462.jpg saved to cache
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S938B\x00'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S938BXXS8BZB5\x00'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:28 15:57:44\x00'
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd571d0>
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0856%252F20490856%252Finterior_boot-1774713487156.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0856/20490856/interior_boot-1774713487156.jpg saved to cache
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6da51e94-1669-5c0f-94f5-ee473531088c
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ceaaa90>
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6949%252F14326949%252Fdocs_service_history-1774694230247.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6d6e181800c624293f64ab86c50c5e8a') HTTP/1.1" 204 0
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6949/14326949/docs_service_history-1774694230247.jpg?ixlib=js-3.8.0&auto=format&s=6d6e181800c624293f64ab86c50c5e8a saved to cache
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c907ad0>
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0923%252F19840923%252Fdocs_service_history-1773412666988.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59ce847504eb3f72ef10ea164834369c') HTTP/1.1" 204 0
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0923/19840923/docs_service_history-1773412666988.jpg?ixlib=js-3.8.0&auto=format&s=59ce847504eb3f72ef10ea164834369c saved to cache
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c905fd0>
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9860%252F18839860%252Fexterior_rear_passenger-1774450230202.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_rear_passenger-1774450230202.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa718542-c1ad-58a3-aabb-52273d4419ce
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2ea1d0>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9860%252F18839860%252Fexterior_front_passenger-1774450343697.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_front_passenger-1774450343697.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa718542-c1ad-58a3-aabb-52273d4419ce
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6df150>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9860%252F18839860%252Fexterior_rear_driver-1774450228520.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_rear_driver-1774450228520.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa718542-c1ad-58a3-aabb-52273d4419ce
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c905250>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0923%252F19840923%252Finstrument_cluster-1773412495407.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0923/19840923/instrument_cluster-1773412495407.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0b1210>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6949%252F14326949%252Finterior_boot-1774714752467.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6949/14326949/interior_boot-1774714752467.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2ea310>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0923%252F19840923%252Finterior_boot-1773412458134.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0923/19840923/interior_boot-1773412458134.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6dc390>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2959%252F16422959%252F16422959-exterior_rear_passenger-default-1774622671888.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_rear_passenger-default-1774622671888.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f355fea50>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2959%252F16422959%252F16422959-interior_front_seats-default-1774622618875.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2959/16422959/16422959-interior_front_seats-default-1774622618875.jpg saved to cache
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8
2026-03-29 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_front_driver-1774450237400.jpg> (referer: None)
2026-03-29 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0923/19840923/interior_dashboard-1774697143833.jpg> (referer: None)
2026-03-29 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6949/14326949/interior_dashboard-1774714739670.jpg> (referer: None)
2026-03-29 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_front_passenger-default-1774622691966.jpg> (referer: None)
2026-03-29 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_rear_driver-default-1774622664429.jpg> (referer: None)
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d099590>
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9860%252F18839860%252Fexterior_front_driver-1774450237400.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_front_driver-1774450237400.jpg saved to cache
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa718542-c1ad-58a3-aabb-52273d4419ce
2026-03-29 20:06:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa718542-c1ad-58a3-aabb-52273d4419ce, skipping ID generation
2026-03-29 20:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa718542-c1ad-58a3-aabb-52273d4419ce with scrape type 1
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa718542-c1ad-58a3-aabb-52273d4419ce sending to next pipeline
2026-03-29 20:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: aa718542-c1ad-58a3-aabb-52273d4419ce, identifier: 18839860
2026-03-29 20:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: aa718542-c1ad-58a3-aabb-52273d4419ce with identifier: 18839860
2026-03-29 20:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: aa718542-c1ad-58a3-aabb-52273d4419ce with identifier: 18839860
2026-03-29 20:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: aa718542-c1ad-58a3-aabb-52273d4419ce with identifier: 18839860 to the API
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_front_driver-1774450237400.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'aa718542-c1ad-58a3-aabb-52273d4419ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH71 VWO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18839860',
'listing': 'auction',
'location': 'Nottinghamshire Retford',
'make': 'Volvo',
'model': 'V60',
'odometer': 67500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1606319,
'Height': 2606,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_front_driver-1774450237400.jpg',
'Width': 3475},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1312057,
'Height': 2642,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_rear_driver-1774450228520.jpg',
'Width': 3522},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1234528,
'Height': 2528,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_front_passenger-1774450343697.jpg',
'Width': 3370},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1137948,
'Height': 2805,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9860/18839860/exterior_rear_passenger-1774450230202.jpg',
'Width': 3740},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2697346,
'Height': 3456,
'OriginUrl': 'https://motorway-photos.imgix.net/9860/18839860/interior_front_seats-1774450455691.jpg',
'Width': 4608},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2163332,
'Height': 3456,
'OriginUrl': 'https://motorway-photos.imgix.net/9860/18839860/interior_rear_seats-1774450571474.jpg',
'Width': 4608},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1847222,
'Height': 3456,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9860/18839860/interior_dashboard-1774450622756.jpg',
'Width': 4608},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1502529,
'Height': 3456,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9860/18839860/instrument_cluster-1774450631142.jpg',
'Width': 4608},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1778247,
'Height': 3456,
'OriginUrl': 'https://motorway-photos.imgix.net/9860/18839860/interior_boot-1774450649456.jpg',
'Width': 4608},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa718542-c1ad-58a3-aabb-52273d4419ce/aa718542-c1ad-58a3-aabb-52273d4419ce_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100669,
'Height': 1262,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9860/18839860/docs_service_history-1774522306683-2.jpeg?ixlib=js-3.8.0&auto=format&s=1c33b20b98308fc3bb733207413455b9',
'Width': 892}],
'price': 16407,
'price_includes_vat': False,
'registration_date': '2021-09-24',
'seats_number': None,
'seller_name': None,
'title': 'Volvo V60 Inscription T6 Rchrg AWD A',
'transmission': 'automatic',
'trim': 'Inscription T6 Rchrg AWD A',
'vin': 'YV1ZWBFVDN1470817',
'year': 2021}
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718839860%27 HTTP/1.1" 200 None
2026-03-29 20:06:22 [motorway.uk] INFO: Saving data for 18839860: {'created_time': 1774814782.891615, 'last_price_update_time': 1774814782.891627, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18839860') HTTP/1.1" 204 0
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc59010>
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0923%252F19840923%252Finterior_dashboard-1774697143833.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0923/19840923/interior_dashboard-1774697143833.jpg saved to cache
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5812d0>
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6949%252F14326949%252Finterior_dashboard-1774714739670.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6949/14326949/interior_dashboard-1774714739670.jpg saved to cache
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f44ad50>
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2959%252F16422959%252F16422959-exterior_front_passenger-default-1774622691966.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_front_passenger-default-1774622691966.jpg saved to cache
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f266c10>
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2959%252F16422959%252F16422959-exterior_rear_driver-default-1774622664429.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_rear_driver-default-1774622664429.jpg saved to cache
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8
2026-03-29 20:06:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8, skipping ID generation
2026-03-29 20:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8 with scrape type 1
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8 sending to next pipeline
2026-03-29 20:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8, identifier: 16422959
2026-03-29 20:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8 with identifier: 16422959
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2026-03-29 20:06:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8 with identifier: 16422959
2026-03-29 20:06:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8 with identifier: 16422959 to the API
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_rear_driver-default-1774622664429.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS25 WVK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16422959',
'listing': 'auction',
'location': 'Greater London Pinner',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 19000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5155830,
'Height': 5760,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_front_driver-default-1774622676475.jpg',
'Width': 7680},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5057704,
'Height': 5453,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_rear_driver-default-1774622664429.jpg',
'Width': 7271},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4302040,
'Height': 5193,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_front_passenger-default-1774622691966.jpg',
'Width': 6924},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4036533,
'Height': 5099,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-exterior_rear_passenger-default-1774622671888.jpg',
'Width': 6798},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7577097,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/2959/16422959/16422959-interior_front_seats-default-1774622618875.jpg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7185333,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/2959/16422959/16422959-interior_rear_seats-default-1774622624686.jpg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6246743,
'Height': 6082,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2959/16422959/16422959-interior_dashboard-default-1774622714591.jpg',
'Width': 8109},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2215796,
'Height': 3432,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2959/16422959/16422959-instrument_cluster-modified-1758443582157.jpeg',
'Width': 4576},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7091711,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/2959/16422959/16422959-interior_boot-default-1774622628036.jpg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8/7d1c305d-9ca5-502c-bb85-a5d29b7e4ca8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232459,
'Height': 1429,
'OriginUrl': 'https://motorway-photos.imgix.net/2959/16422959/16422959-damage_scratches-default-1758444925425.jpg',
'Width': 1905}],
'price': 31093,
'price_includes_vat': False,
'registration_date': '2025-06-15',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Kodiaq SE L TSI e-TEC MHEV S-A',
'transmission': 'automatic',
'trim': 'SE L TSI e-TEC MHEV S-A',
'vin': 'TMBKB7PS4ST089740',
'year': 2025}
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716422959%27 HTTP/1.1" 200 None
2026-03-29 20:06:24 [motorway.uk] INFO: Saving data for 16422959: {'created_time': 1774814784.305965, 'last_price_update_time': 1774814784.305976, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16422959') HTTP/1.1" 204 0
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8757/3788757/docs_service_history-1772979406707.jpg?ixlib=js-3.8.0&auto=format&s=c04da6e58354d5d69edbbdc6c6a5df94> (referer: None)
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_front_driver-1774693121906.jpg> (referer: None)
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8757/3788757/docs_service_history-1774527464778.jpg?ixlib=js-3.8.0&auto=format&s=13d0f8b6b70a9772f6611e999da26f68> (referer: None)
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6949/14326949/exterior_front_driver-1774693292141.jpg> (referer: None)
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_rear_driver-1774693080903.jpg> (referer: None)
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6949/14326949/exterior_rear_driver-1774714714948.jpg> (referer: None)
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6949/14326949/exterior_rear_passenger-1774693323244.jpg> (referer: None)
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6949/14326949/exterior_front_passenger-1774693335242.jpg> (referer: None)
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_front_passenger-1774693603815.jpg> (referer: None)
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_rear_passenger-1774693529323.jpg> (referer: None)
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0923/19840923/interior_front_seats-1773412396570.jpg> (referer: None)
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8757/3788757/interior_boot-1772978851172.jpg> (referer: None)
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d580c50>
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8757%252F3788757%252Fdocs_service_history-1772979406707.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc04da6e58354d5d69edbbdc6c6a5df94') HTTP/1.1" 204 0
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8757/3788757/docs_service_history-1772979406707.jpg?ixlib=js-3.8.0&auto=format&s=c04da6e58354d5d69edbbdc6c6a5df94 saved to cache
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36e3fc75-be3d-51d6-8532-de6518729a07
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8757/3788757/interior_dashboard-1772979916992.jpg> (referer: None)
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0f7590>
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0923%252F19840923%252Fexterior_front_driver-1774693121906.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_front_driver-1774693121906.jpg saved to cache
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2ebc90>
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8757%252F3788757%252Fdocs_service_history-1774527464778.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D13d0f8b6b70a9772f6611e999da26f68') HTTP/1.1" 204 0
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8757/3788757/docs_service_history-1774527464778.jpg?ixlib=js-3.8.0&auto=format&s=13d0f8b6b70a9772f6611e999da26f68 saved to cache
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36e3fc75-be3d-51d6-8532-de6518729a07
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0f7c10>
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6949%252F14326949%252Fexterior_front_driver-1774693292141.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6949/14326949/exterior_front_driver-1774693292141.jpg saved to cache
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f268610>
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0923%252F19840923%252Fexterior_rear_driver-1774693080903.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_rear_driver-1774693080903.jpg saved to cache
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f269dd0>
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6949%252F14326949%252Fexterior_rear_driver-1774714714948.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6949/14326949/exterior_rear_driver-1774714714948.jpg saved to cache
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daad690>
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6949%252F14326949%252Fexterior_rear_passenger-1774693323244.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6949/14326949/exterior_rear_passenger-1774693323244.jpg saved to cache
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f266890>
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6949%252F14326949%252Fexterior_front_passenger-1774693335242.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6949/14326949/exterior_front_passenger-1774693335242.jpg saved to cache
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf
2026-03-29 20:06:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 799482ba-48b7-5a56-8b9f-29ae5ee026bf, skipping ID generation
2026-03-29 20:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf with scrape type 1
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 799482ba-48b7-5a56-8b9f-29ae5ee026bf sending to next pipeline
2026-03-29 20:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 799482ba-48b7-5a56-8b9f-29ae5ee026bf, identifier: 14326949
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f44bad0>
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0923%252F19840923%252Fexterior_front_passenger-1774693603815.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_front_passenger-1774693603815.jpg saved to cache
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f26b4d0>
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0923%252F19840923%252Fexterior_rear_passenger-1774693529323.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_rear_passenger-1774693529323.jpg saved to cache
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5
2026-03-29 20:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dcf9010>
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0923%252F19840923%252Finterior_front_seats-1773412396570.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0923/19840923/interior_front_seats-1773412396570.jpg saved to cache
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5
2026-03-29 20:06:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b52b6e7-c25d-59ce-a933-f867b4cb65e5, skipping ID generation
2026-03-29 20:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5 with scrape type 1
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b52b6e7-c25d-59ce-a933-f867b4cb65e5 sending to next pipeline
2026-03-29 20:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9b52b6e7-c25d-59ce-a933-f867b4cb65e5, identifier: 19840923
2026-03-29 20:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 799482ba-48b7-5a56-8b9f-29ae5ee026bf with identifier: 14326949
2026-03-29 20:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 799482ba-48b7-5a56-8b9f-29ae5ee026bf with identifier: 14326949
2026-03-29 20:06:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 799482ba-48b7-5a56-8b9f-29ae5ee026bf with identifier: 14326949 to the API
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6949/14326949/exterior_front_passenger-1774693335242.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '799482ba-48b7-5a56-8b9f-29ae5ee026bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WK68 WSY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14326949',
'listing': 'auction',
'location': 'West Midlands Birmingham',
'make': 'SEAT',
'model': 'Arona',
'odometer': 55000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1611997,
'Height': 2586,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6949/14326949/exterior_front_driver-1774693292141.jpg',
'Width': 3448},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1835916,
'Height': 2372,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6949/14326949/exterior_rear_driver-1774714714948.jpg',
'Width': 3163},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1950133,
'Height': 2740,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6949/14326949/exterior_front_passenger-1774693335242.jpg',
'Width': 3653},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1930626,
'Height': 2750,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6949/14326949/exterior_rear_passenger-1774693323244.jpg',
'Width': 3666},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3446703,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6949/14326949/interior_front_seats-1774693863203.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3481187,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6949/14326949/interior_rear_seats-1774693871776.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2625618,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6949/14326949/interior_dashboard-1774714739670.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400192,
'Height': 1147,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6949/14326949/instrument_cluster-1774714776462.jpg',
'Width': 1529},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3518071,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6949/14326949/interior_boot-1774714752467.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799482ba-48b7-5a56-8b9f-29ae5ee026bf/799482ba-48b7-5a56-8b9f-29ae5ee026bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 665020,
'Height': 1909,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6949/14326949/docs_service_history-1774694230247.jpg?ixlib=js-3.8.0&auto=format&s=6d6e181800c624293f64ab86c50c5e8a',
'Width': 3775}],
'price': 9437,
'price_includes_vat': False,
'registration_date': '2018-11-22',
'seats_number': None,
'seller_name': None,
'title': 'SEAT Arona Xcellence LUX TDI Auto',
'transmission': 'automatic',
'trim': 'Xcellence LUX TDI Auto',
'vin': 'VSSZZZKJZKR044411',
'year': 2018}
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714326949%27 HTTP/1.1" 200 None
2026-03-29 20:06:26 [motorway.uk] INFO: Saving data for 14326949: {'created_time': 1774814786.423065, 'last_price_update_time': 1774814786.423076, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14326949') HTTP/1.1" 204 0
2026-03-29 20:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9b52b6e7-c25d-59ce-a933-f867b4cb65e5 with identifier: 19840923
2026-03-29 20:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9b52b6e7-c25d-59ce-a933-f867b4cb65e5 with identifier: 19840923
2026-03-29 20:06:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9b52b6e7-c25d-59ce-a933-f867b4cb65e5 with identifier: 19840923 to the API
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0923/19840923/interior_front_seats-1773412396570.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '9b52b6e7-c25d-59ce-a933-f867b4cb65e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'R100 ACX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19840923',
'listing': 'auction',
'location': 'Greater London London',
'make': 'BMW',
'model': 'X6',
'odometer': 62000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1207941,
'Height': 2206,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_front_driver-1774693121906.jpg',
'Width': 2941},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1751138,
'Height': 2369,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_rear_driver-1774693080903.jpg',
'Width': 3158},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2170201,
'Height': 2545,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_front_passenger-1774693603815.jpg',
'Width': 3393},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2340488,
'Height': 2668,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0923/19840923/exterior_rear_passenger-1774693529323.jpg',
'Width': 3557},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2532480,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0923/19840923/interior_front_seats-1773412396570.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2265628,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0923/19840923/interior_rear_seats-1773412406883.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2325806,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0923/19840923/interior_dashboard-1774697143833.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2311995,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0923/19840923/instrument_cluster-1773412495407.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3536011,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0923/19840923/interior_boot-1773412458134.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b52b6e7-c25d-59ce-a933-f867b4cb65e5/9b52b6e7-c25d-59ce-a933-f867b4cb65e5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2195858,
'Height': 1086,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0923/19840923/docs_service_history-1773412666988.jpg?ixlib=js-3.8.0&auto=format&s=59ce847504eb3f72ef10ea164834369c',
'Width': 2754}],
'price': 19931,
'price_includes_vat': False,
'registration_date': '2017-06-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW X6 M50D Auto',
'transmission': 'automatic',
'trim': 'M50D Auto',
'vin': 'WBAKV620700R77126',
'year': 2017}
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719840923%27 HTTP/1.1" 200 None
2026-03-29 20:06:26 [motorway.uk] INFO: Saving data for 19840923: {'created_time': 1774814786.822584, 'last_price_update_time': 1774814786.822606, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19840923') HTTP/1.1" 204 0
2026-03-29 20:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S911B\x00'
2026-03-29 20:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S911BXXS8EZA1\x00'
2026-03-29 20:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:26 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:08 14:07:05\x00'
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dcf9790>
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8757%252F3788757%252Finterior_boot-1772978851172.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8757/3788757/interior_boot-1772978851172.jpg saved to cache
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36e3fc75-be3d-51d6-8532-de6518729a07
2026-03-29 20:06:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:06:27 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S911B\x00'
2026-03-29 20:06:27 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:06:27 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S911BXXS8EZA1\x00'
2026-03-29 20:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:06:27 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:06:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:27 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:08 14:24:36\x00'
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e106350>
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8757%252F3788757%252Finterior_dashboard-1772979916992.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8757/3788757/interior_dashboard-1772979916992.jpg saved to cache
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36e3fc75-be3d-51d6-8532-de6518729a07
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_rear_passenger-1772979830307.jpg> (referer: None)
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_front_driver-1772979804382.jpg> (referer: None)
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_rear_driver-1772979820012.jpg> (referer: None)
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8083/20368083/docs_service_history-1774699655501.jpg?ixlib=js-3.8.0&auto=format&s=d0baa1c4cec6692ed7e61d4f32024420> (referer: None)
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8083/20368083/interior_boot-1774699454555.jpg> (referer: None)
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0856/20490856/docs_service_history-1774713913000.jpg?ixlib=js-3.8.0&auto=format&s=ac1597112003ae406a8e59d32acf4c77> (referer: None)
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0856/20490856/docs_service_history-1774713962453.jpg?ixlib=js-3.8.0&auto=format&s=1716d8f953b22e6623680b250643a724> (referer: None)
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5609/19185609/19185609-docs_service_history-default-1774623043465.jpeg?ixlib=js-3.8.0&auto=format&s=a07ad3f923698700df0ad66a9599761e> (referer: None)
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e104c90>
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8757%252F3788757%252Fexterior_rear_passenger-1772979830307.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_rear_passenger-1772979830307.jpg saved to cache
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36e3fc75-be3d-51d6-8532-de6518729a07
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce8e290>
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8757%252F3788757%252Fexterior_front_driver-1772979804382.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_front_driver-1772979804382.jpg saved to cache
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36e3fc75-be3d-51d6-8532-de6518729a07
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f4311bdd0>
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8757%252F3788757%252Fexterior_rear_driver-1772979820012.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_rear_driver-1772979820012.jpg saved to cache
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36e3fc75-be3d-51d6-8532-de6518729a07
2026-03-29 20:06:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36e3fc75-be3d-51d6-8532-de6518729a07, skipping ID generation
2026-03-29 20:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36e3fc75-be3d-51d6-8532-de6518729a07 with scrape type 1
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36e3fc75-be3d-51d6-8532-de6518729a07 sending to next pipeline
2026-03-29 20:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 36e3fc75-be3d-51d6-8532-de6518729a07, identifier: 3788757
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2e9dd0>
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8083%252F20368083%252Fdocs_service_history-1774699655501.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd0baa1c4cec6692ed7e61d4f32024420') HTTP/1.1" 204 0
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8083/20368083/docs_service_history-1774699655501.jpg?ixlib=js-3.8.0&auto=format&s=d0baa1c4cec6692ed7e61d4f32024420 saved to cache
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75da13d5-2bc3-5198-824f-3fd629678864
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd86810>
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8083%252F20368083%252Finterior_boot-1774699454555.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8083/20368083/interior_boot-1774699454555.jpg saved to cache
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75da13d5-2bc3-5198-824f-3fd629678864
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S938B\x00'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S938BXXS8BZB5\x00'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:28 16:05:06\x00'
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dcf87d0>
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0856%252F20490856%252Fdocs_service_history-1774713913000.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dac1597112003ae406a8e59d32acf4c77') HTTP/1.1" 204 0
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0856/20490856/docs_service_history-1774713913000.jpg?ixlib=js-3.8.0&auto=format&s=ac1597112003ae406a8e59d32acf4c77 saved to cache
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6da51e94-1669-5c0f-94f5-ee473531088c
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S938B\x00'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S938BXXS8BZB5\x00'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:28 16:05:54\x00'
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e13d1d0>
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0856%252F20490856%252Fdocs_service_history-1774713962453.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1716d8f953b22e6623680b250643a724') HTTP/1.1" 204 0
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0856/20490856/docs_service_history-1774713962453.jpg?ixlib=js-3.8.0&auto=format&s=1716d8f953b22e6623680b250643a724 saved to cache
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6da51e94-1669-5c0f-94f5-ee473531088c
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x01Z&\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x8e+\x00\x01;\xa3\x00\x00\x00\x00'
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e13e150>
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5609%252F19185609%252F19185609-docs_service_history-default-1774623043465.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da07ad3f923698700df0ad66a9599761e') HTTP/1.1" 204 0
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5609/19185609/19185609-docs_service_history-default-1774623043465.jpeg?ixlib=js-3.8.0&auto=format&s=a07ad3f923698700df0ad66a9599761e saved to cache
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e
2026-03-29 20:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 36e3fc75-be3d-51d6-8532-de6518729a07 with identifier: 3788757
2026-03-29 20:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 36e3fc75-be3d-51d6-8532-de6518729a07 with identifier: 3788757
2026-03-29 20:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 36e3fc75-be3d-51d6-8532-de6518729a07 with identifier: 3788757 to the API
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_rear_driver-1772979820012.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '36e3fc75-be3d-51d6-8532-de6518729a07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FN19 YSM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3788757',
'listing': 'auction',
'location': 'Kent Sittingbourne',
'make': 'Lexus',
'model': 'NX 300',
'odometer': 67347,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1036814,
'Height': 2115,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_front_driver-1772979804382.jpg',
'Width': 2820},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1143084,
'Height': 2089,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_rear_driver-1772979820012.jpg',
'Width': 2785},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 948856,
'Height': 2283,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_front_passenger-1772979842275.jpg',
'Width': 3044},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 968617,
'Height': 1929,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8757/3788757/exterior_rear_passenger-1772979830307.jpg',
'Width': 2572},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8240018,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8757/3788757/interior_front_seats-1772979867345.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8741129,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8757/3788757/interior_rear_seats-1772978836573.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7597642,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8757/3788757/interior_dashboard-1772979916992.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7640340,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8757/3788757/interior_boot-1772978851172.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630131,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8757/3788757/docs_service_history-1772979406707.jpg?ixlib=js-3.8.0&auto=format&s=c04da6e58354d5d69edbbdc6c6a5df94',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e3fc75-be3d-51d6-8532-de6518729a07/36e3fc75-be3d-51d6-8532-de6518729a07_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1270754,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8757/3788757/docs_service_history-1774527464778.jpg?ixlib=js-3.8.0&auto=format&s=13d0f8b6b70a9772f6611e999da26f68',
'Width': 3000}],
'price': 17345,
'price_includes_vat': False,
'registration_date': '2019-03-27',
'seats_number': None,
'seller_name': None,
'title': 'Lexus NX 300H F Sport CVT',
'transmission': 'automatic',
'trim': 'H F Sport CVT',
'vin': 'JTJBJRBZ702112222',
'year': 2019}
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273788757%27 HTTP/1.1" 200 None
2026-03-29 20:06:28 [motorway.uk] INFO: Saving data for 3788757: {'created_time': 1774814788.868327, 'last_price_update_time': 1774814788.868362, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3788757') HTTP/1.1" 204 0
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5609/19185609/19185609-instrument_cluster-modified-1774452495283.jpeg> (referer: None)
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_front_driver-1774711515585.jpg> (referer: None)
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_rear_passenger-1774711422770.jpg> (referer: None)
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_front_passenger-1774711420296.jpg> (referer: None)
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8083/20368083/interior_front_seats-1774699444371.jpg> (referer: None)
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8083/20368083/instrument_cluster-1774699486898.jpg> (referer: None)
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8083/20368083/interior_rear_seats-1774699458709.jpg> (referer: None)
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8083/20368083/interior_dashboard-1774699502597.jpg> (referer: None)
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5609/19185609/interior_dashboard-1774447611427.jpeg> (referer: None)
2026-03-29 20:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0856/20490856/interior_rear_seats-1774713478483.jpg> (referer: None)
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6ead10>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5609%252F19185609%252F19185609-instrument_cluster-modified-1774452495283.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5609/19185609/19185609-instrument_cluster-modified-1774452495283.jpeg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e
2026-03-29 20:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9187/20499187/docs_service_history-1774784230214.jpg?ixlib=js-3.8.0&auto=format&s=72c121ab75cd721db61ae7c140a40ac0> (referer: None)
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da847d0>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0856%252F20490856%252Fexterior_front_driver-1774711515585.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_front_driver-1774711515585.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6da51e94-1669-5c0f-94f5-ee473531088c
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9b25d0>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0856%252F20490856%252Fexterior_rear_passenger-1774711422770.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_rear_passenger-1774711422770.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6da51e94-1669-5c0f-94f5-ee473531088c
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd54410>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0856%252F20490856%252Fexterior_front_passenger-1774711420296.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_front_passenger-1774711420296.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6da51e94-1669-5c0f-94f5-ee473531088c
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9b3d10>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8083%252F20368083%252Finterior_front_seats-1774699444371.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8083/20368083/interior_front_seats-1774699444371.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75da13d5-2bc3-5198-824f-3fd629678864
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f293590>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8083%252F20368083%252Finstrument_cluster-1774699486898.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8083/20368083/instrument_cluster-1774699486898.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75da13d5-2bc3-5198-824f-3fd629678864
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2e8110>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8083%252F20368083%252Finterior_rear_seats-1774699458709.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8083/20368083/interior_rear_seats-1774699458709.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75da13d5-2bc3-5198-824f-3fd629678864
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d09a050>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8083%252F20368083%252Finterior_dashboard-1774699502597.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8083/20368083/interior_dashboard-1774699502597.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75da13d5-2bc3-5198-824f-3fd629678864
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00%\x1a \x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02H\xbd\x00%\x10\x0e\x00\x00\x00\x00'
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9b2910>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5609%252F19185609%252Finterior_dashboard-1774447611427.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5609/19185609/interior_dashboard-1774447611427.jpeg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S938B\x00'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S938BXXS8BZB5\x00'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:28 15:57:15\x00'
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1bd250>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0856%252F20490856%252Finterior_rear_seats-1774713478483.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0856/20490856/interior_rear_seats-1774713478483.jpg saved to cache
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6da51e94-1669-5c0f-94f5-ee473531088c
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce37fd0>
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9187%252F20499187%252Fdocs_service_history-1774784230214.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D72c121ab75cd721db61ae7c140a40ac0') HTTP/1.1" 204 0
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9187/20499187/docs_service_history-1774784230214.jpg?ixlib=js-3.8.0&auto=format&s=72c121ab75cd721db61ae7c140a40ac0 saved to cache
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f
2026-03-29 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_front_driver-1774699170305.jpg> (referer: None)
2026-03-29 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5609/19185609/interior_boot-1774447645720.jpeg> (referer: None)
2026-03-29 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_rear_driver-1774699167415.jpg> (referer: None)
2026-03-29 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_rear_passenger-1774447267281.jpeg> (referer: None)
2026-03-29 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_front_passenger-1774447227280.jpeg> (referer: None)
2026-03-29 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7638/19077638/wheels_front_driver-1774697202903.jpg> (referer: None)
2026-03-29 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0856/20490856/interior_front_seats-1774713532139.jpg> (referer: None)
2026-03-29 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7638/19077638/instrument_cluster-1774702368987.jpg> (referer: None)
2026-03-29 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9187/20499187/interior_boot-1774771523863.jpg> (referer: None)
2026-03-29 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7638/19077638/interior_boot-1774697514104.jpg> (referer: None)
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce7efd0>
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8083%252F20368083%252Fexterior_front_driver-1774699170305.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_front_driver-1774699170305.jpg saved to cache
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75da13d5-2bc3-5198-824f-3fd629678864
2026-03-29 20:06:30 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:30 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:30 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x006&\x9d\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02zd\x006\x1c\x8b\x00\x00\x00\x00'
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2e8050>
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5609%252F19185609%252Finterior_boot-1774447645720.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5609/19185609/interior_boot-1774447645720.jpeg saved to cache
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6f9a50>
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8083%252F20368083%252Fexterior_rear_driver-1774699167415.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_rear_driver-1774699167415.jpg saved to cache
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75da13d5-2bc3-5198-824f-3fd629678864
2026-03-29 20:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75da13d5-2bc3-5198-824f-3fd629678864, skipping ID generation
2026-03-29 20:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75da13d5-2bc3-5198-824f-3fd629678864 with scrape type 1
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75da13d5-2bc3-5198-824f-3fd629678864 sending to next pipeline
2026-03-29 20:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 75da13d5-2bc3-5198-824f-3fd629678864, identifier: 20368083
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dcf9f10>
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5609%252F19185609%252Fexterior_rear_passenger-1774447267281.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_rear_passenger-1774447267281.jpeg saved to cache
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cea8050>
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5609%252F19185609%252Fexterior_front_passenger-1774447227280.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_front_passenger-1774447227280.jpeg saved to cache
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca64110>
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7638%252F19077638%252Fwheels_front_driver-1774697202903.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7638/19077638/wheels_front_driver-1774697202903.jpg saved to cache
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S938B\x00'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S938BXXS8BZB5\x00'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:28 15:58:33\x00'
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddd4c90>
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0856%252F20490856%252Finterior_front_seats-1774713532139.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0856/20490856/interior_front_seats-1774713532139.jpg saved to cache
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6da51e94-1669-5c0f-94f5-ee473531088c
2026-03-29 20:06:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6da51e94-1669-5c0f-94f5-ee473531088c, skipping ID generation
2026-03-29 20:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da51e94-1669-5c0f-94f5-ee473531088c with scrape type 1
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6da51e94-1669-5c0f-94f5-ee473531088c sending to next pipeline
2026-03-29 20:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6da51e94-1669-5c0f-94f5-ee473531088c, identifier: 20490856
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d55f1d0>
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7638%252F19077638%252Finstrument_cluster-1774702368987.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7638/19077638/instrument_cluster-1774702368987.jpg saved to cache
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c907950>
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9187%252F20499187%252Finterior_boot-1774771523863.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9187/20499187/interior_boot-1774771523863.jpg saved to cache
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2ebb50>
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7638%252F19077638%252Finterior_boot-1774697514104.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7638/19077638/interior_boot-1774697514104.jpg saved to cache
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c
2026-03-29 20:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 75da13d5-2bc3-5198-824f-3fd629678864 with identifier: 20368083
2026-03-29 20:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 75da13d5-2bc3-5198-824f-3fd629678864 with identifier: 20368083
2026-03-29 20:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 75da13d5-2bc3-5198-824f-3fd629678864 with identifier: 20368083 to the API
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_rear_driver-1774699167415.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '75da13d5-2bc3-5198-824f-3fd629678864',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YM19 NXV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20368083',
'listing': 'auction',
'location': 'South Yorkshire Sheffield',
'make': 'Suzuki',
'model': 'Celerio',
'odometer': 28000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 904705,
'Height': 2060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_front_driver-1774699170305.jpg',
'Width': 2747},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1118645,
'Height': 2273,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_rear_driver-1774699167415.jpg',
'Width': 3031},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705440,
'Height': 2071,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_front_passenger-1774699167934.jpg',
'Width': 2761},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1323271,
'Height': 2367,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8083/20368083/exterior_rear_passenger-1774699173453.jpg',
'Width': 3156},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1492058,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8083/20368083/interior_front_seats-1774699444371.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2325659,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8083/20368083/interior_rear_seats-1774699458709.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2218495,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8083/20368083/interior_dashboard-1774699502597.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1609877,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8083/20368083/instrument_cluster-1774699486898.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2878252,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8083/20368083/interior_boot-1774699454555.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75da13d5-2bc3-5198-824f-3fd629678864/75da13d5-2bc3-5198-824f-3fd629678864_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1468813,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8083/20368083/docs_service_history-1774699655501.jpg?ixlib=js-3.8.0&auto=format&s=d0baa1c4cec6692ed7e61d4f32024420',
'Width': 3840}],
'price': 5389,
'price_includes_vat': False,
'registration_date': '2019-03-26',
'seats_number': None,
'seller_name': None,
'title': 'Suzuki Celerio SZ3 Dualjet',
'transmission': 'manual',
'trim': 'SZ3 Dualjet',
'vin': 'MMSLFE62S00116114',
'year': 2019}
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720368083%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [motorway.uk] INFO: Saving data for 20368083: {'created_time': 1774814792.355828, 'last_price_update_time': 1774814792.355841, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20368083') HTTP/1.1" 204 0
2026-03-29 20:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6da51e94-1669-5c0f-94f5-ee473531088c with identifier: 20490856
2026-03-29 20:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6da51e94-1669-5c0f-94f5-ee473531088c with identifier: 20490856
2026-03-29 20:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6da51e94-1669-5c0f-94f5-ee473531088c with identifier: 20490856 to the API
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0856/20490856/interior_front_seats-1774713532139.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6da51e94-1669-5c0f-94f5-ee473531088c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'OXZ 7473',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20490856',
'listing': 'auction',
'location': 'Central Bedfordshire Leighton Buzzard',
'make': 'Peugeot',
'model': '2008',
'odometer': 33183,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 926886,
'Height': 2004,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_front_driver-1774711515585.jpg',
'Width': 2672},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 813407,
'Height': 2059,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_rear_driver-1774711416403.jpg',
'Width': 2745},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866823,
'Height': 1854,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_front_passenger-1774711420296.jpg',
'Width': 2472},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 704268,
'Height': 1869,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0856/20490856/exterior_rear_passenger-1774711422770.jpg',
'Width': 2492},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8852552,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/0856/20490856/interior_front_seats-1774713532139.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8475722,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/0856/20490856/interior_rear_seats-1774713478483.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2059878,
'Height': 4080,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0856/20490856/interior_dashboard-1774715187001.jpg',
'Width': 5440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7720994,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/0856/20490856/interior_boot-1774713487156.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5596250,
'Height': 3060,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0856/20490856/docs_service_history-1774713913000.jpg?ixlib=js-3.8.0&auto=format&s=ac1597112003ae406a8e59d32acf4c77',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da51e94-1669-5c0f-94f5-ee473531088c/6da51e94-1669-5c0f-94f5-ee473531088c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6020372,
'Height': 3060,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0856/20490856/docs_service_history-1774713962453.jpg?ixlib=js-3.8.0&auto=format&s=1716d8f953b22e6623680b250643a724',
'Width': 4080}],
'price': 11071,
'price_includes_vat': False,
'registration_date': '2020-10-30',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 2008 Allure Premium Ptech SS A',
'transmission': 'automatic',
'trim': 'Allure Premium Ptech SS A',
'vin': 'VR3USHNSSLJ867068',
'year': 2020}
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490856%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [motorway.uk] INFO: Saving data for 20490856: {'created_time': 1774814793.142811, 'last_price_update_time': 1774814793.142823, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20490856') HTTP/1.1" 204 0
2026-03-29 20:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_rear_passenger-1774697172394.jpg> (referer: None)
2026-03-29 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_rear_driver-1774447277002.jpeg> (referer: None)
2026-03-29 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_front_passenger-1774697169162.jpg> (referer: None)
2026-03-29 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_rear_driver-1774697174506.jpg> (referer: None)
2026-03-29 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9187/20499187/exterior_rear_passenger-1774771022491.jpg> (referer: None)
2026-03-29 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9187/20499187/interior_rear_seats-1774771463673.jpg> (referer: None)
2026-03-29 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7638/19077638/interior_front_seats-1774697412725.jpg> (referer: None)
2026-03-29 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9187/20499187/interior_front_seats-1774771433482.jpg> (referer: None)
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f37f8d0>
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7638%252F19077638%252Fexterior_rear_passenger-1774697172394.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_rear_passenger-1774697172394.jpg saved to cache
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d3f2a10>
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5609%252F19185609%252Fexterior_rear_driver-1774447277002.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_rear_driver-1774447277002.jpeg saved to cache
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e
2026-03-29 20:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63fe8396-f096-59f8-8c96-5d4b4dee4d1e, skipping ID generation
2026-03-29 20:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e with scrape type 1
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63fe8396-f096-59f8-8c96-5d4b4dee4d1e sending to next pipeline
2026-03-29 20:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 63fe8396-f096-59f8-8c96-5d4b4dee4d1e, identifier: 19185609
2026-03-29 20:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 63fe8396-f096-59f8-8c96-5d4b4dee4d1e with identifier: 19185609
2026-03-29 20:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 63fe8396-f096-59f8-8c96-5d4b4dee4d1e with identifier: 19185609
2026-03-29 20:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 63fe8396-f096-59f8-8c96-5d4b4dee4d1e with identifier: 19185609 to the API
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_rear_driver-1774447277002.jpeg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '63fe8396-f096-59f8-8c96-5d4b4dee4d1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WDL 344',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19185609',
'listing': 'auction',
'location': 'Merseyside Southport',
'make': 'Mazda',
'model': 'Other Mazda',
'odometer': 5050,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1100587,
'Height': 2329,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_front_driver-1774447215061.jpeg',
'Width': 3105},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1104539,
'Height': 2334,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_rear_driver-1774447277002.jpeg',
'Width': 3112},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1303359,
'Height': 2374,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_front_passenger-1774447227280.jpeg',
'Width': 3165},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1142691,
'Height': 2396,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5609/19185609/exterior_rear_passenger-1774447267281.jpeg',
'Width': 3195},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2608647,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5609/19185609/interior_front_seats-1774447679071.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3133826,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5609/19185609/interior_rear_seats-1774447499784.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2581213,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5609/19185609/interior_dashboard-1774447611427.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458068,
'Height': 1829,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5609/19185609/19185609-instrument_cluster-modified-1774452495283.jpeg',
'Width': 2439},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3711233,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5609/19185609/interior_boot-1774447645720.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fe8396-f096-59f8-8c96-5d4b4dee4d1e/63fe8396-f096-59f8-8c96-5d4b4dee4d1e_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 125009,
'Height': 480,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5609/19185609/19185609-docs_service_history-default-1774623043465.jpeg?ixlib=js-3.8.0&auto=format&s=a07ad3f923698700df0ad66a9599761e',
'Width': 640}],
'price': 29200,
'price_includes_vat': False,
'registration_date': '2024-04-01',
'seats_number': None,
'seller_name': None,
'title': 'Mazda CX-60 Takumi PHEV Auto',
'transmission': 'automatic',
'trim': 'CX-60 Takumi PHEV Auto',
'vin': 'JMZKH0HB501151835',
'year': 2024}
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719185609%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [motorway.uk] INFO: Saving data for 19185609: {'created_time': 1774814793.992928, 'last_price_update_time': 1774814793.992942, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19185609') HTTP/1.1" 204 0
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f37e950>
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7638%252F19077638%252Fexterior_front_passenger-1774697169162.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_front_passenger-1774697169162.jpg saved to cache
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce8e290>
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7638%252F19077638%252Fexterior_rear_driver-1774697174506.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_rear_driver-1774697174506.jpg saved to cache
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f3573aa90>
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9187%252F20499187%252Fexterior_rear_passenger-1774771022491.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9187/20499187/exterior_rear_passenger-1774771022491.jpg saved to cache
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d107810>
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9187%252F20499187%252Finterior_rear_seats-1774771463673.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9187/20499187/interior_rear_seats-1774771463673.jpg saved to cache
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d55ced0>
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7638%252F19077638%252Finterior_front_seats-1774697412725.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7638/19077638/interior_front_seats-1774697412725.jpg saved to cache
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d75cfd0>
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9187%252F20499187%252Finterior_front_seats-1774771433482.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9187/20499187/interior_front_seats-1774771433482.jpg saved to cache
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9187/20499187/exterior_rear_driver-1774773882719.jpg> (referer: None)
2026-03-29 20:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_front_driver-1774697138862.jpg> (referer: None)
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7615/20487615/docs_service_history-1774702319504.jpeg?ixlib=js-3.8.0&auto=format&s=7055e7e9c8047699dcb3013747216479> (referer: None)
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9187/20499187/exterior_front_driver-1774770977210.jpg> (referer: None)
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9187/20499187/exterior_front_passenger-1774773901238.jpg> (referer: None)
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2010/19452010/wheels_front_driver-1774704731313.jpeg> (referer: None)
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e121050>
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9187%252F20499187%252Fexterior_rear_driver-1774773882719.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9187/20499187/exterior_rear_driver-1774773882719.jpg saved to cache
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd48690>
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7638%252F19077638%252Fexterior_front_driver-1774697138862.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_front_driver-1774697138862.jpg saved to cache
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c
2026-03-29 20:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c, skipping ID generation
2026-03-29 20:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c with scrape type 1
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c sending to next pipeline
2026-03-29 20:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c, identifier: 19077638
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e106110>
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7615%252F20487615%252Fdocs_service_history-1774702319504.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7055e7e9c8047699dcb3013747216479') HTTP/1.1" 204 0
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7615/20487615/docs_service_history-1774702319504.jpeg?ixlib=js-3.8.0&auto=format&s=7055e7e9c8047699dcb3013747216479 saved to cache
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05321a24-38b3-566c-83a5-58c40ff1251b
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db7d810>
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9187%252F20499187%252Fexterior_front_driver-1774770977210.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9187/20499187/exterior_front_driver-1774770977210.jpg saved to cache
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1f2490>
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9187%252F20499187%252Fexterior_front_passenger-1774773901238.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9187/20499187/exterior_front_passenger-1774773901238.jpg saved to cache
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f
2026-03-29 20:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f3b8e4c-0c02-5501-adb2-dc1084ff567f, skipping ID generation
2026-03-29 20:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f with scrape type 1
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f3b8e4c-0c02-5501-adb2-dc1084ff567f sending to next pipeline
2026-03-29 20:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2f3b8e4c-0c02-5501-adb2-dc1084ff567f, identifier: 20499187
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f355faad0>
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Fwheels_front_driver-1774704731313.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/wheels_front_driver-1774704731313.jpeg saved to cache
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2656af1-48dc-5851-b52a-26d35f6a380c
2026-03-29 20:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c with identifier: 19077638
2026-03-29 20:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c with identifier: 19077638
2026-03-29 20:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c with identifier: 19077638 to the API
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_front_driver-1774697138862.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FJ73 YJB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19077638',
'listing': 'auction',
'location': 'Nottinghamshire Nottingham',
'make': 'Jaguar',
'model': 'Other Jaguar',
'odometer': 13851,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1853965,
'Height': 2457,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_front_driver-1774697138862.jpg',
'Width': 3276},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1508708,
'Height': 2479,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_rear_driver-1774697174506.jpg',
'Width': 3305},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1637315,
'Height': 2268,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_front_passenger-1774697169162.jpg',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1136469,
'Height': 2090,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7638/19077638/exterior_rear_passenger-1774697172394.jpg',
'Width': 2787},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3413640,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7638/19077638/interior_front_seats-1774697412725.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3147490,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7638/19077638/interior_rear_seats-1774697424122.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2294514,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7638/19077638/interior_dashboard-1774702343981.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1801731,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7638/19077638/instrument_cluster-1774702368987.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4285344,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7638/19077638/interior_boot-1774697514104.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c/a1295a1e-fc4e-5d46-a17d-3fbd5deb6f9c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1400925,
'Height': 2559,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7638/19077638/wheels_front_driver-1774697202903.jpg',
'Width': 3412}],
'price': 33150,
'price_includes_vat': False,
'registration_date': '2024-01-25',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar Fpace Rdyn HSE BLK D MHEV Awda',
'transmission': 'automatic',
'trim': 'Fpace Rdyn HSE BLK D MHEV Awda',
'vin': 'SADCA2AN2RA738524',
'year': 2024}
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719077638%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [motorway.uk] INFO: Saving data for 19077638: {'created_time': 1774814796.129022, 'last_price_update_time': 1774814796.129034, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19077638') HTTP/1.1" 204 0
2026-03-29 20:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2f3b8e4c-0c02-5501-adb2-dc1084ff567f with identifier: 20499187
2026-03-29 20:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2f3b8e4c-0c02-5501-adb2-dc1084ff567f with identifier: 20499187
2026-03-29 20:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2f3b8e4c-0c02-5501-adb2-dc1084ff567f with identifier: 20499187 to the API
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/9187/20499187/exterior_front_passenger-1774773901238.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '2f3b8e4c-0c02-5501-adb2-dc1084ff567f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CX68 WOC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20499187',
'listing': 'auction',
'location': 'Wokingham Wokingham',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 32810,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1727936,
'Height': 2716,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9187/20499187/exterior_front_driver-1774770977210.jpg',
'Width': 3621},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2388278,
'Height': 2718,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9187/20499187/exterior_rear_driver-1774773882719.jpg',
'Width': 3624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2166714,
'Height': 2638,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9187/20499187/exterior_front_passenger-1774773901238.jpg',
'Width': 3517},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1542511,
'Height': 2524,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9187/20499187/exterior_rear_passenger-1774771022491.jpg',
'Width': 3365},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3744878,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9187/20499187/interior_front_seats-1774771433482.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2775688,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9187/20499187/interior_rear_seats-1774771463673.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2635350,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9187/20499187/interior_dashboard-1774784455438.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391679,
'Height': 1070,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9187/20499187/instrument_cluster-1774784247948.jpg',
'Width': 1427},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3289312,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9187/20499187/interior_boot-1774771523863.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f3b8e4c-0c02-5501-adb2-dc1084ff567f/2f3b8e4c-0c02-5501-adb2-dc1084ff567f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275469,
'Height': 1212,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9187/20499187/docs_service_history-1774784230214.jpg?ixlib=js-3.8.0&auto=format&s=72c121ab75cd721db61ae7c140a40ac0',
'Width': 1617}],
'price': 9818,
'price_includes_vat': False,
'registration_date': '2018-10-31',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Yaris Excel VVT-i HEV CVT',
'transmission': 'automatic',
'trim': 'Excel VVT-i HEV CVT',
'vin': 'VNKKD3D300A520963',
'year': 2018}
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499187%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [motorway.uk] INFO: Saving data for 20499187: {'created_time': 1774814796.540731, 'last_price_update_time': 1774814796.540742, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20499187') HTTP/1.1" 204 0
2026-03-29 20:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=324&page=9&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7615/20487615/20487615-interior_dashboard-modified-1774703578690.jpeg> (referer: None)
2026-03-29 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2010/19452010/interior_rear_seats-1774704631398.jpeg> (referer: None)
2026-03-29 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2010/19452010/interior_front_seats-1774704565874.jpeg> (referer: None)
2026-03-29 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7615/20487615/interior_rear_seats-1774701667172.jpeg> (referer: None)
2026-03-29 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2010/19452010/interior_dashboard-1774704689555.jpeg> (referer: None)
2026-03-29 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7615/20487615/interior_front_seats-1774701650151.jpeg> (referer: None)
2026-03-29 20:06:36 [motorway.uk] INFO: Found listing with ID: 20418717
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720418717%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [motorway.uk] INFO: Scrape type for 20418717: 1
2026-03-29 20:06:36 [motorway.uk] INFO: Found listing with ID: 20488067
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488067%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [motorway.uk] INFO: Scrape type for 20488067: 1
2026-03-29 20:06:36 [motorway.uk] INFO: Found listing with ID: 20395274
2026-03-29 20:06:36 [motorway.uk] INFO: Found listing with ID: 20486896
2026-03-29 20:06:36 [motorway.uk] INFO: Found listing with ID: 20440824
2026-03-29 20:06:36 [motorway.uk] INFO: Found listing with ID: 20375069
2026-03-29 20:06:36 [motorway.uk] INFO: Found listing with ID: 20346137
2026-03-29 20:06:36 [motorway.uk] INFO: Found listing with ID: 18144090
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718144090%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [motorway.uk] INFO: Scrape type for 18144090: 2
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d099590>
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7615%252F20487615%252F20487615-interior_dashboard-modified-1774703578690.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7615/20487615/20487615-interior_dashboard-modified-1774703578690.jpeg saved to cache
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05321a24-38b3-566c-83a5-58c40ff1251b
2026-03-29 20:06:36 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:36 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:36 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00&\x90\x8d\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x077\x00&\x85\xfb\x00\x00\x00\x00'
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c904750>
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2010%252F19452010%252Finterior_rear_seats-1774704631398.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2010/19452010/interior_rear_seats-1774704631398.jpeg saved to cache
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2656af1-48dc-5851-b52a-26d35f6a380c
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b"\x00\x03\x00\x00\x00'\xad\xa5\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x0e\xea\x00'\xa3\x13\x00\x00\x00\x00"
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6cf650>
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2010%252F19452010%252Finterior_front_seats-1774704565874.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2010/19452010/interior_front_seats-1774704565874.jpeg saved to cache
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2656af1-48dc-5851-b52a-26d35f6a380c
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00,\xd3\xee\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x15\xcc\x00,\xc9\xdc\x00\x00\x00\x00'
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c904c50>
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7615%252F20487615%252Finterior_rear_seats-1774701667172.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7615/20487615/interior_rear_seats-1774701667172.jpeg saved to cache
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05321a24-38b3-566c-83a5-58c40ff1251b
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00.\x8cb\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02v\xf3\x00.\x81\xd0\x00\x00\x00\x00'
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddd7350>
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Finterior_dashboard-1774704689555.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/interior_dashboard-1774704689555.jpeg saved to cache
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2656af1-48dc-5851-b52a-26d35f6a380c
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x002\xfel\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02W\x99\x002\xf4Z\x00\x00\x00\x00'
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5f9ad0>
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7615%252F20487615%252Finterior_front_seats-1774701650151.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7615/20487615/interior_front_seats-1774701650151.jpeg saved to cache
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05321a24-38b3-566c-83a5-58c40ff1251b
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20494274
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 17611268
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717611268%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [motorway.uk] INFO: Scrape type for 17611268: 1
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490925.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485866.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20483899
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20483826
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20469913
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20459015
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20471501
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 16772824
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716772824%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [motorway.uk] INFO: Scrape type for 16772824: 1
2026-03-29 20:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20121550
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720121550%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [motorway.uk] INFO: Scrape type for 20121550: 1
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 17470157
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 19824525
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719824525%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [motorway.uk] INFO: Scrape type for 19824525: 1
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20370017
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20382041
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20428604
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720428604%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [motorway.uk] INFO: Scrape type for 20428604: 1
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20185351
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 14545909
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20188633
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 17103119
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 19976195
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20476001
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20489379
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 14248545
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20489087
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 9706336
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20235497
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 19465246
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 20474206
2026-03-29 20:06:37 [motorway.uk] INFO: Found listing with ID: 17699246
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_front_passenger-1774704518414.jpeg> (referer: None)
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7615/20487615/20487615-exterior_rear_passenger-modified-1774703603053.jpeg> (referer: None)
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_rear_passenger-1774704529772.jpeg> (referer: None)
2026-03-29 20:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 841cfa0d-5f95-5dbb-b002-a8d69b53c838 with identifier: 20490925
2026-03-29 20:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838 with scrape type 1
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0925%252F20490925%252Fexterior_front_driver-1774713245993.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0925/20490925/exterior_front_driver-1774713245993.jpg not downloaded yet
2026-03-29 20:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1275d5fa-c434-584e-b0bb-e3c27b674a35 with identifier: 20485866
2026-03-29 20:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1275d5fa-c434-584e-b0bb-e3c27b674a35 with scrape type 1
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1275d5fa-c434-584e-b0bb-e3c27b674a35
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5866%252F20485866%252Fexterior_front_driver-1774696061172.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_front_driver-1774696061172.jpg not downloaded yet
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7615/20487615/20487615-exterior_front_passenger-modified-1774703593607.jpeg> (referer: None)
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0925%252F20490925%252Fexterior_rear_driver-1774717492989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0925/20490925/exterior_rear_driver-1774717492989.jpg not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5866%252F20485866%252Fexterior_rear_driver-1774696070222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_rear_driver-1774696070222.jpg not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0925%252F20490925%252Fexterior_front_passenger-1774717506875.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0925/20490925/exterior_front_passenger-1774717506875.jpg not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5866%252F20485866%252Fexterior_front_passenger-1774696086212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_front_passenger-1774696086212.jpg not downloaded yet
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19699947.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0925%252F20490925%252Fexterior_rear_passenger-1774717538143.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0925/20490925/exterior_rear_passenger-1774717538143.jpg not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5866%252F20485866%252Fexterior_rear_passenger-1774696079804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_rear_passenger-1774696079804.jpg not downloaded yet
2026-03-29 20:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd84610>
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Fexterior_front_passenger-1774704518414.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_front_passenger-1774704518414.jpeg saved to cache
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2656af1-48dc-5851-b52a-26d35f6a380c
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d65a1d0>
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7615%252F20487615%252F20487615-exterior_rear_passenger-modified-1774703603053.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7615/20487615/20487615-exterior_rear_passenger-modified-1774703603053.jpeg saved to cache
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05321a24-38b3-566c-83a5-58c40ff1251b
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35731910>
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Fexterior_rear_passenger-1774704529772.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_rear_passenger-1774704529772.jpeg saved to cache
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2656af1-48dc-5851-b52a-26d35f6a380c
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0925%252F20490925%252Finterior_front_seats-1774713561921.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0925/20490925/interior_front_seats-1774713561921.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5866%252F20485866%252Finterior_front_seats-1774696346531.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5866/20485866/interior_front_seats-1774696346531.jpg not downloaded yet
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d658190>
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7615%252F20487615%252F20487615-exterior_front_passenger-modified-1774703593607.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7615/20487615/20487615-exterior_front_passenger-modified-1774703593607.jpeg saved to cache
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05321a24-38b3-566c-83a5-58c40ff1251b
2026-03-29 20:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a with identifier: 19699947
2026-03-29 20:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a with scrape type 1
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9947%252F19699947%252Fexterior_front_driver-1774711219887.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9947/19699947/exterior_front_driver-1774711219887.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0925%252F20490925%252Finterior_rear_seats-1774713575642.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0925/20490925/interior_rear_seats-1774713575642.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5866%252F20485866%252Finterior_rear_seats-1774696402850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5866/20485866/interior_rear_seats-1774696402850.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9947%252F19699947%252Fexterior_rear_driver-1774714174312.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9947/19699947/exterior_rear_driver-1774714174312.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0925%252F20490925%252Finterior_dashboard-1774717578241.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0925/20490925/interior_dashboard-1774717578241.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5866%252F20485866%252Finterior_dashboard-1774698144493.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5866/20485866/interior_dashboard-1774698144493.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9947%252F19699947%252Fexterior_front_passenger-1774714244212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9947/19699947/exterior_front_passenger-1774714244212.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0925%252F20490925%252Finstrument_cluster-1774713660235.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0925/20490925/instrument_cluster-1774713660235.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5866%252F20485866%252Finterior_boot-1774696376397.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5866/20485866/interior_boot-1774696376397.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9947%252F19699947%252Fexterior_rear_passenger-1774711226382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9947/19699947/exterior_rear_passenger-1774711226382.jpg not downloaded yet
2026-03-29 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489983.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0925%252F20490925%252Finterior_boot-1774713610182.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0925/20490925/interior_boot-1774713610182.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5866%252F20485866%252Fdocs_service_history-1774696672305.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dff4d4fb18c684a244f599b53805744df%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5866/20485866/docs_service_history-1774696672305.jpg?ixlib=js-3.8.0&auto=format&s=ff4d4fb18c684a244f599b53805744df not downloaded yet
2026-03-29 20:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9947%252F19699947%252Finterior_front_seats-1774712414662.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9947/19699947/interior_front_seats-1774712414662.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0925%252F20490925%252Fdamage_scratches-1774713327155.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0925/20490925/damage_scratches-1774713327155.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5866%252F20485866%252Fdocs_service_history-1774696875150.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbf4242cf2559714e788b2212fa4723b3%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5866/20485866/docs_service_history-1774696875150.jpg?ixlib=js-3.8.0&auto=format&s=bf4242cf2559714e788b2212fa4723b3 not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9947%252F19699947%252Finterior_rear_seats-1774712420836.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9947/19699947/interior_rear_seats-1774712420836.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9947%252F19699947%252Finterior_dashboard-1774714292998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9947/19699947/interior_dashboard-1774714292998.jpg not downloaded yet
2026-03-29 20:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23cf65ad-1d5c-5679-ad18-438901afa0cd with identifier: 20489983
2026-03-29 20:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23cf65ad-1d5c-5679-ad18-438901afa0cd with scrape type 1
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23cf65ad-1d5c-5679-ad18-438901afa0cd
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9983%252F20489983%252Fexterior_front_driver-1774709702173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_front_driver-1774709702173.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9947%252F19699947%252Finterior_boot-1774712417362.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9947/19699947/interior_boot-1774712417362.jpg not downloaded yet
2026-03-29 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7615/20487615/exterior_rear_driver-1774701510522.jpeg> (referer: None)
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9983%252F20489983%252Fexterior_rear_driver-1774709699382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_rear_driver-1774709699382.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9947%252F19699947%252Fdocs_service_history-1774713872859.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd4b96881aff4bb41f83ebcfaa1e6802e%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9947/19699947/docs_service_history-1774713872859.jpg?ixlib=js-3.8.0&auto=format&s=d4b96881aff4bb41f83ebcfaa1e6802e not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9983%252F20489983%252Fexterior_front_passenger-1774709759096.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_front_passenger-1774709759096.jpg not downloaded yet
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9947%252F19699947%252Fwheels_front_driver-1774711571249.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9947/19699947/wheels_front_driver-1774711571249.jpg not downloaded yet
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9983%252F20489983%252Fexterior_rear_passenger-1774709710772.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_rear_passenger-1774709710772.jpg not downloaded yet
2026-03-29 20:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20393410.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9983%252F20489983%252Finterior_front_seats-1774710330803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9983/20489983/interior_front_seats-1774710330803.jpg not downloaded yet
2026-03-29 20:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_front_driver-1774704502101.jpeg> (referer: None)
2026-03-29 20:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_rear_driver-1774704538531.jpeg> (referer: None)
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9983%252F20489983%252Finterior_rear_seats-1774710518713.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9983/20489983/interior_rear_seats-1774710518713.jpg not downloaded yet
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9983%252F20489983%252Finterior_dashboard-1774710341927.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9983/20489983/interior_dashboard-1774710341927.jpg not downloaded yet
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cadbc90>
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7615%252F20487615%252Fexterior_rear_driver-1774701510522.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7615/20487615/exterior_rear_driver-1774701510522.jpeg saved to cache
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05321a24-38b3-566c-83a5-58c40ff1251b
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9983%252F20489983%252Finstrument_cluster-1774710396989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9983/20489983/instrument_cluster-1774710396989.jpg not downloaded yet
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9983%252F20489983%252Finterior_boot-1774710419173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9983/20489983/interior_boot-1774710419173.jpg not downloaded yet
2026-03-29 20:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2a5bc6d-0126-534d-9a94-d983ce3ab7f2 with identifier: 20393410
2026-03-29 20:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2 with scrape type 1
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3410%252F20393410%252Fexterior_front_driver-1774286164534.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_front_driver-1774286164534.jpg not downloaded yet
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db6ee50>
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Fexterior_front_driver-1774704502101.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_front_driver-1774704502101.jpeg saved to cache
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2656af1-48dc-5851-b52a-26d35f6a380c
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0b2750>
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2010%252F19452010%252Fexterior_rear_driver-1774704538531.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_rear_driver-1774704538531.jpeg saved to cache
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2656af1-48dc-5851-b52a-26d35f6a380c
2026-03-29 20:06:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2656af1-48dc-5851-b52a-26d35f6a380c, skipping ID generation
2026-03-29 20:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2656af1-48dc-5851-b52a-26d35f6a380c with scrape type 1
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2656af1-48dc-5851-b52a-26d35f6a380c sending to next pipeline
2026-03-29 20:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b2656af1-48dc-5851-b52a-26d35f6a380c, identifier: 19452010
2026-03-29 20:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b2656af1-48dc-5851-b52a-26d35f6a380c with identifier: 19452010
2026-03-29 20:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b2656af1-48dc-5851-b52a-26d35f6a380c with identifier: 19452010
2026-03-29 20:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b2656af1-48dc-5851-b52a-26d35f6a380c with identifier: 19452010 to the API
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_rear_driver-1774704538531.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'b2656af1-48dc-5851-b52a-26d35f6a380c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KT74 DSZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19452010',
'listing': 'auction',
'location': 'Northamptonshire Northampton',
'make': 'BMW',
'model': '1 Series',
'odometer': 803,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1846581,
'Height': 2528,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_front_driver-1774704502101.jpeg',
'Width': 3370},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1762618,
'Height': 2568,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_rear_driver-1774704538531.jpeg',
'Width': 3424},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1635965,
'Height': 2679,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_front_passenger-1774704518414.jpeg',
'Width': 3572},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1863719,
'Height': 2650,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2010/19452010/exterior_rear_passenger-1774704529772.jpeg',
'Width': 3533},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2735247,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2010/19452010/interior_front_seats-1774704565874.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2660292,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2010/19452010/interior_rear_seats-1774704631398.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3212117,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2010/19452010/interior_dashboard-1774704689555.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2564842,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2010/19452010/instrument_cluster-1774704724878.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4136926,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2010/19452010/interior_boot-1774704705169.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2656af1-48dc-5851-b52a-26d35f6a380c/b2656af1-48dc-5851-b52a-26d35f6a380c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2223780,
'Height': 2968,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2010/19452010/wheels_front_driver-1774704731313.jpeg',
'Width': 3957}],
'price': 26375,
'price_includes_vat': False,
'registration_date': '2025-01-03',
'seats_number': None,
'seller_name': None,
'title': 'BMW 120 M Sport MHEV Auto',
'transmission': 'automatic',
'trim': '120 M Sport MHEV Auto',
'vin': 'WBA82GE0607S07933',
'year': 2025}
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719452010%27 HTTP/1.1" 200 None
2026-03-29 20:06:40 [motorway.uk] INFO: Saving data for 19452010: {'created_time': 1774814800.138068, 'last_price_update_time': 1774814800.138078, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19452010') HTTP/1.1" 204 0
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9983%252F20489983%252Fdocs_service_history-1774710643227.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0a8a277f85a24c5bd0dc6c6b2f56e53e%27 HTTP/1.1" 200 None
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9983/20489983/docs_service_history-1774710643227.jpg?ixlib=js-3.8.0&auto=format&s=0a8a277f85a24c5bd0dc6c6b2f56e53e not downloaded yet
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3410%252F20393410%252Fexterior_rear_driver-1774286181660.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_rear_driver-1774286181660.jpg not downloaded yet
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9947/19699947/exterior_rear_passenger-1774711226382.jpg> (referer: None)
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3410%252F20393410%252Fexterior_front_passenger-1774286212433.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_front_passenger-1774286212433.jpg not downloaded yet
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_rear_passenger-1774709710772.jpg> (referer: None)
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3410%252F20393410%252Fexterior_rear_passenger-1774286195873.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_rear_passenger-1774286195873.jpg not downloaded yet
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9983/20489983/interior_dashboard-1774710341927.jpg> (referer: None)
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3410%252F20393410%252Finterior_front_seats-1774286544928.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3410/20393410/interior_front_seats-1774286544928.jpg not downloaded yet
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0925/20490925/exterior_rear_passenger-1774717538143.jpg> (referer: None)
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3410%252F20393410%252Finterior_rear_seats-1774286568658.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3410/20393410/interior_rear_seats-1774286568658.jpg not downloaded yet
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3410%252F20393410%252Finterior_dashboard-1774287062202.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3410/20393410/interior_dashboard-1774287062202.jpg not downloaded yet
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_rear_passenger-1774696079804.jpg> (referer: None)
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3410%252F20393410%252Finstrument_cluster-1774287550891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3410/20393410/instrument_cluster-1774287550891.jpg not downloaded yet
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9983/20489983/interior_rear_seats-1774710518713.jpg> (referer: None)
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3410%252F20393410%252Finterior_boot-1774286762469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3410/20393410/interior_boot-1774286762469.jpg not downloaded yet
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5fb4d0>
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9947%252F19699947%252Fexterior_rear_passenger-1774711226382.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9947/19699947/exterior_rear_passenger-1774711226382.jpg saved to cache
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3410%252F20393410%252Fdocs_service_history-1774713312854.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da3465033855235ffb1b71cdabd2752d3%27 HTTP/1.1" 200 None
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3410/20393410/docs_service_history-1774713312854.jpg?ixlib=js-3.8.0&auto=format&s=a3465033855235ffb1b71cdabd2752d3 not downloaded yet
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddb8c50>
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9983%252F20489983%252Fexterior_rear_passenger-1774709710772.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_rear_passenger-1774709710772.jpg saved to cache
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23cf65ad-1d5c-5679-ad18-438901afa0cd
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19734640.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18144090.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc99490>
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9983%252F20489983%252Finterior_dashboard-1774710341927.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9983/20489983/interior_dashboard-1774710341927.jpg saved to cache
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23cf65ad-1d5c-5679-ad18-438901afa0cd
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4aaa90>
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0925%252F20490925%252Fexterior_rear_passenger-1774717538143.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0925/20490925/exterior_rear_passenger-1774717538143.jpg saved to cache
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d63ff10>
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5866%252F20485866%252Fexterior_rear_passenger-1774696079804.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_rear_passenger-1774696079804.jpg saved to cache
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1275d5fa-c434-584e-b0bb-e3c27b674a35
2026-03-29 20:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:06:40 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 15:07:57\x00'
2026-03-29 20:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4aa2d0>
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9983%252F20489983%252Finterior_rear_seats-1774710518713.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9983/20489983/interior_rear_seats-1774710518713.jpg saved to cache
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23cf65ad-1d5c-5679-ad18-438901afa0cd
2026-03-29 20:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73d9b3c1-c9e3-5821-84b5-0300833d0999 with identifier: 19734640
2026-03-29 20:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73d9b3c1-c9e3-5821-84b5-0300833d0999 with scrape type 1
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73d9b3c1-c9e3-5821-84b5-0300833d0999
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4640%252F19734640%252Fexterior_front_driver-1772474636109.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_front_driver-1772474636109.jpeg not downloaded yet
2026-03-29 20:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2455daec-3b80-51e7-a763-d81437ed9320 with identifier: 18144090
2026-03-29 20:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2455daec-3b80-51e7-a763-d81437ed9320 with scrape type 2
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2455daec-3b80-51e7-a763-d81437ed9320 with scrape type 2
2026-03-29 20:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2455daec-3b80-51e7-a763-d81437ed9320, identifier: 18144090
2026-03-29 20:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2455daec-3b80-51e7-a763-d81437ed9320 with identifier: 18144090
2026-03-29 20:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2455daec-3b80-51e7-a763-d81437ed9320 with identifier: 18144090
2026-03-29 20:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2455daec-3b80-51e7-a763-d81437ed9320 with identifier: 18144090 to the API
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18144090.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '2455daec-3b80-51e7-a763-d81437ed9320',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'M23 CBS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18144090',
'listing': 'auction',
'location': 'South Yorkshire Sheffield',
'make': 'Ford',
'model': 'Ranger',
'odometer': 74000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 13500,
'price_includes_vat': False,
'registration_date': '2018-07-23',
'seats_number': None,
'seller_name': None,
'title': 'Ford Ranger Wildtrak 4X4 DCB TDCI A',
'transmission': 'automatic',
'trim': 'Wildtrak 4X4 DCB TDCI A',
'vin': '6FPPXXMJ2PJJ81644',
'year': 2018}
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718144090%27 HTTP/1.1" 200 None
2026-03-29 20:06:41 [motorway.uk] INFO: Saving data for 18144090: {'auction_closing_time': 1774884600.0, 'created_time': 1774469318.56466, 'last_price_update_time': 1774814801.584516}
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18144090') HTTP/1.1" 204 0
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4640%252F19734640%252Fexterior_rear_driver-1772474662518.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_rear_driver-1772474662518.jpeg not downloaded yet
2026-03-29 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0925/20490925/interior_front_seats-1774713561921.jpg> (referer: None)
2026-03-29 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9983/20489983/docs_service_history-1774710643227.jpg?ixlib=js-3.8.0&auto=format&s=0a8a277f85a24c5bd0dc6c6b2f56e53e> (referer: None)
2026-03-29 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17611268.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20418717.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4640%252F19734640%252Fexterior_front_passenger-1772474645088.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_front_passenger-1772474645088.jpeg not downloaded yet
2026-03-29 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488067.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9947/19699947/interior_boot-1774712417362.jpg> (referer: None)
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4640%252F19734640%252Fexterior_rear_passenger-1772474653546.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_rear_passenger-1772474653546.jpeg not downloaded yet
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4640%252F19734640%252Finterior_front_seats-1772474682172.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4640/19734640/interior_front_seats-1772474682172.jpeg not downloaded yet
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4640%252F19734640%252F19734640-interior_rear_seats-modified-1773847278524.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4640/19734640/19734640-interior_rear_seats-modified-1773847278524.jpeg not downloaded yet
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4640%252F19734640%252Finterior_dashboard-1772474736214.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4640/19734640/interior_dashboard-1772474736214.jpeg not downloaded yet
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6cab10>
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0925%252F20490925%252Finterior_front_seats-1774713561921.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0925/20490925/interior_front_seats-1774713561921.jpg saved to cache
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0da250>
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9983%252F20489983%252Fdocs_service_history-1774710643227.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0a8a277f85a24c5bd0dc6c6b2f56e53e') HTTP/1.1" 204 0
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9983/20489983/docs_service_history-1774710643227.jpg?ixlib=js-3.8.0&auto=format&s=0a8a277f85a24c5bd0dc6c6b2f56e53e saved to cache
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23cf65ad-1d5c-5679-ad18-438901afa0cd
2026-03-29 20:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9353593-cd06-5cda-a17c-15b3d023ad43 with identifier: 17611268
2026-03-29 20:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9353593-cd06-5cda-a17c-15b3d023ad43 with scrape type 1
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9353593-cd06-5cda-a17c-15b3d023ad43
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1268%252F17611268%252Fexterior_front_driver-1758388743891.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_front_driver-1758388743891.jpeg not downloaded yet
2026-03-29 20:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9688f9d-3692-575f-bd6e-91e6c0b582e6 with identifier: 20418717
2026-03-29 20:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9688f9d-3692-575f-bd6e-91e6c0b582e6 with scrape type 1
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9688f9d-3692-575f-bd6e-91e6c0b582e6
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8717%252F20418717%252Fexterior_front_driver-1774345658761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_front_driver-1774345658761.jpg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4640%252F19734640%252Finstrument_cluster-1774282765516.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4640/19734640/instrument_cluster-1774282765516.jpeg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1268%252F17611268%252Fexterior_rear_driver-1758388796550.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_rear_driver-1758388796550.jpeg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8717%252F20418717%252Fexterior_rear_driver-1774345675306.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_rear_driver-1774345675306.jpg not downloaded yet
2026-03-29 20:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27 with identifier: 20488067
2026-03-29 20:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27 with scrape type 1
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8067%252F20488067%252Fexterior_front_driver-1774703032999.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_front_driver-1774703032999.jpg not downloaded yet
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d59b1d0>
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9947%252F19699947%252Finterior_boot-1774712417362.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9947/19699947/interior_boot-1774712417362.jpg saved to cache
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4640%252F19734640%252Finterior_boot-1772474744822.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4640/19734640/interior_boot-1772474744822.jpeg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1268%252F17611268%252Fexterior_front_passenger-1758388755166.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_front_passenger-1758388755166.jpeg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8717%252F20418717%252Fexterior_front_passenger-1774345695018.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_front_passenger-1774345695018.jpg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8067%252F20488067%252Fexterior_rear_driver-1774703048486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_rear_driver-1774703048486.jpg not downloaded yet
2026-03-29 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_rear_driver-1774286181660.jpg> (referer: None)
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4640%252F19734640%252Fdocs_service_history-1773738857473.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0655dc735c9cd6d1e7ce81efc4fddd9b%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4640/19734640/docs_service_history-1773738857473.jpeg?ixlib=js-3.8.0&auto=format&s=0655dc735c9cd6d1e7ce81efc4fddd9b not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1268%252F17611268%252Fexterior_rear_passenger-1758388775964.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_rear_passenger-1758388775964.jpeg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8717%252F20418717%252Fexterior_rear_passenger-1774345690231.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_rear_passenger-1774345690231.jpg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8067%252F20488067%252Fexterior_front_passenger-1774703070090.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_front_passenger-1774703070090.jpg not downloaded yet
2026-03-29 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_rear_passenger-1774286195873.jpg> (referer: None)
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1268%252F17611268%252Finterior_front_seats-1758388965998.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1268/17611268/interior_front_seats-1758388965998.jpeg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8717%252F20418717%252Finterior_front_seats-1774346101494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8717/20418717/interior_front_seats-1774346101494.jpg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8067%252F20488067%252Fexterior_rear_passenger-1774703057901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_rear_passenger-1774703057901.jpg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1268%252F17611268%252Finterior_rear_seats-1758389018159.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1268/17611268/interior_rear_seats-1758389018159.jpeg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8717%252F20418717%252Finterior_rear_seats-1774346540907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8717/20418717/interior_rear_seats-1774346540907.jpg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8067%252F20488067%252Finterior_front_seats-1774703413501.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8067/20488067/interior_front_seats-1774703413501.jpg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1268%252F17611268%252Finterior_dashboard-1758389030977.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1268/17611268/interior_dashboard-1758389030977.jpeg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8717%252F20418717%252Finterior_dashboard-1774346143212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8717/20418717/interior_dashboard-1774346143212.jpg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8067%252F20488067%252Finterior_rear_seats-1774703427184.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8067/20488067/interior_rear_seats-1774703427184.jpg not downloaded yet
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d59dc50>
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3410%252F20393410%252Fexterior_rear_driver-1774286181660.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_rear_driver-1774286181660.jpg saved to cache
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc808d0>
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3410%252F20393410%252Fexterior_rear_passenger-1774286195873.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_rear_passenger-1774286195873.jpg saved to cache
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1268%252F17611268%252Finterior_boot-1758389105683.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1268/17611268/interior_boot-1758389105683.jpeg not downloaded yet
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8717%252F20418717%252Finstrument_cluster-1774346212191.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8717/20418717/instrument_cluster-1774346212191.jpg not downloaded yet
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8067%252F20488067%252Finterior_dashboard-1774703447765.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8067/20488067/interior_dashboard-1774703447765.jpg not downloaded yet
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_front_driver-1772474636109.jpeg> (referer: None)
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1268%252F17611268%252Fdocs_service_history-1774693151138.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0a66c0dd8fdd19a44ad7860d5df9bcd2%27 HTTP/1.1" 200 None
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1268/17611268/docs_service_history-1774693151138.jpeg?ixlib=js-3.8.0&auto=format&s=0a66c0dd8fdd19a44ad7860d5df9bcd2 not downloaded yet
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8717%252F20418717%252Finterior_boot-1774346565546.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8717/20418717/interior_boot-1774346565546.jpg not downloaded yet
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8067%252F20488067%252Finstrument_cluster-1774703518361.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8067/20488067/instrument_cluster-1774703518361.jpg not downloaded yet
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5866/20485866/interior_front_seats-1774696346531.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3410/20393410/docs_service_history-1774713312854.jpg?ixlib=js-3.8.0&auto=format&s=a3465033855235ffb1b71cdabd2752d3> (referer: None)
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1268%252F17611268%252Fdocs_service_history-1774693158463.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dda827ac0fdf6eca2a6990d6a82b4ca78%27 HTTP/1.1" 200 None
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1268/17611268/docs_service_history-1774693158463.jpeg?ixlib=js-3.8.0&auto=format&s=da827ac0fdf6eca2a6990d6a82b4ca78 not downloaded yet
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8717%252F20418717%252Fdocs_service_history-1774346301134.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1e4431b6c412293225f088fe666f78a7%27 HTTP/1.1" 200 None
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8717/20418717/docs_service_history-1774346301134.jpg?ixlib=js-3.8.0&auto=format&s=1e4431b6c412293225f088fe666f78a7 not downloaded yet
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8067%252F20488067%252Finterior_boot-1774703459641.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8067/20488067/interior_boot-1774703459641.jpg not downloaded yet
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8067%252F20488067%252Fdamage_missing_trims-1774705051444.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8067/20488067/damage_missing_trims-1774705051444.jpg not downloaded yet
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3410/20393410/instrument_cluster-1774287550891.jpg> (referer: None)
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddab890>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4640%252F19734640%252Fexterior_front_driver-1772474636109.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_front_driver-1772474636109.jpeg saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73d9b3c1-c9e3-5821-84b5-0300833d0999
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35733ed0>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5866%252F20485866%252Finterior_front_seats-1774696346531.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5866/20485866/interior_front_seats-1774696346531.jpg saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1275d5fa-c434-584e-b0bb-e3c27b674a35
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4b9350>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3410%252F20393410%252Fdocs_service_history-1774713312854.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da3465033855235ffb1b71cdabd2752d3') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3410/20393410/docs_service_history-1774713312854.jpg?ixlib=js-3.8.0&auto=format&s=a3465033855235ffb1b71cdabd2752d3 saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce9e090>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3410%252F20393410%252Finstrument_cluster-1774287550891.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3410/20393410/instrument_cluster-1774287550891.jpg saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3410/20393410/interior_dashboard-1774287062202.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_front_driver-1774345658761.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3410/20393410/interior_rear_seats-1774286568658.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3410/20393410/interior_front_seats-1774286544928.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_front_driver-1758388743891.jpeg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_rear_passenger-1774703057901.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3410/20393410/interior_boot-1774286762469.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4640/19734640/interior_dashboard-1772474736214.jpeg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4640/19734640/instrument_cluster-1774282765516.jpeg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4640/19734640/interior_boot-1772474744822.jpeg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8067/20488067/interior_dashboard-1774703447765.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8717/20418717/docs_service_history-1774346301134.jpg?ixlib=js-3.8.0&auto=format&s=1e4431b6c412293225f088fe666f78a7> (referer: None)
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc0a750>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3410%252F20393410%252Finterior_dashboard-1774287062202.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3410/20393410/interior_dashboard-1774287062202.jpg saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8067/20488067/damage_missing_trims-1774705051444.jpg> (referer: None)
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc2d350>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8717%252F20418717%252Fexterior_front_driver-1774345658761.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_front_driver-1774345658761.jpg saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9688f9d-3692-575f-bd6e-91e6c0b582e6
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0e1090>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3410%252F20393410%252Finterior_rear_seats-1774286568658.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3410/20393410/interior_rear_seats-1774286568658.jpg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f306b50>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3410%252F20393410%252Finterior_front_seats-1774286544928.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3410/20393410/interior_front_seats-1774286544928.jpg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f305890>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1268%252F17611268%252Fexterior_front_driver-1758388743891.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_front_driver-1758388743891.jpeg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9353593-cd06-5cda-a17c-15b3d023ad43
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6e8610>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8067%252F20488067%252Fexterior_rear_passenger-1774703057901.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_rear_passenger-1774703057901.jpg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6e88d0>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3410%252F20393410%252Finterior_boot-1774286762469.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3410/20393410/interior_boot-1774286762469.jpg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00#\x16!\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\xe44\x00#\x0b\xa1\x00\x00\x00\x00'
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d981350>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4640%252F19734640%252Finterior_dashboard-1772474736214.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4640/19734640/interior_dashboard-1772474736214.jpeg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73d9b3c1-c9e3-5821-84b5-0300833d0999
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00"\xea\xb8\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xe97\x00"\xdf\xee\x00\x00\x00\x00'
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4ec210>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4640%252F19734640%252Finstrument_cluster-1774282765516.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4640/19734640/instrument_cluster-1774282765516.jpeg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73d9b3c1-c9e3-5821-84b5-0300833d0999
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00#\x07\x18\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02[\xf8\x00"\xfc\x98\x00\x00\x00\x00'
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f307f90>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4640%252F19734640%252Finterior_boot-1772474744822.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4640/19734640/interior_boot-1772474744822.jpeg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73d9b3c1-c9e3-5821-84b5-0300833d0999
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da87410>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8067%252F20488067%252Finterior_dashboard-1774703447765.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8067/20488067/interior_dashboard-1774703447765.jpg saved to cache
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f37e190>
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8717%252F20418717%252Fdocs_service_history-1774346301134.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1e4431b6c412293225f088fe666f78a7') HTTP/1.1" 204 0
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8717/20418717/docs_service_history-1774346301134.jpg?ixlib=js-3.8.0&auto=format&s=1e4431b6c412293225f088fe666f78a7 saved to cache
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9688f9d-3692-575f-bd6e-91e6c0b582e6
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8b0f90>
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8067%252F20488067%252Fdamage_missing_trims-1774705051444.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8067/20488067/damage_missing_trims-1774705051444.jpg saved to cache
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27
2026-03-29 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1268/17611268/docs_service_history-1774693158463.jpeg?ixlib=js-3.8.0&auto=format&s=da827ac0fdf6eca2a6990d6a82b4ca78> (referer: None)
2026-03-29 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8067/20488067/instrument_cluster-1774703518361.jpg> (referer: None)
2026-03-29 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8067/20488067/interior_boot-1774703459641.jpg> (referer: None)
2026-03-29 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8717/20418717/interior_dashboard-1774346143212.jpg> (referer: None)
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d91eed0>
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1268%252F17611268%252Fdocs_service_history-1774693158463.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dda827ac0fdf6eca2a6990d6a82b4ca78') HTTP/1.1" 204 0
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1268/17611268/docs_service_history-1774693158463.jpeg?ixlib=js-3.8.0&auto=format&s=da827ac0fdf6eca2a6990d6a82b4ca78 saved to cache
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9353593-cd06-5cda-a17c-15b3d023ad43
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce2ee50>
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8067%252F20488067%252Finstrument_cluster-1774703518361.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8067/20488067/instrument_cluster-1774703518361.jpg saved to cache
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f457550>
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8067%252F20488067%252Finterior_boot-1774703459641.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8067/20488067/interior_boot-1774703459641.jpg saved to cache
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c907290>
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8717%252F20418717%252Finterior_dashboard-1774346143212.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8717/20418717/interior_dashboard-1774346143212.jpg saved to cache
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9688f9d-3692-575f-bd6e-91e6c0b582e6
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1268/17611268/docs_service_history-1774693151138.jpeg?ixlib=js-3.8.0&auto=format&s=0a66c0dd8fdd19a44ad7860d5df9bcd2> (referer: None)
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_front_passenger-1774703070090.jpg> (referer: None)
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8717/20418717/instrument_cluster-1774346212191.jpg> (referer: None)
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8717/20418717/interior_rear_seats-1774346540907.jpg> (referer: None)
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1268/17611268/interior_rear_seats-1758389018159.jpeg> (referer: None)
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1268/17611268/interior_dashboard-1758389030977.jpeg> (referer: None)
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8717/20418717/interior_front_seats-1774346101494.jpg> (referer: None)
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8067/20488067/interior_front_seats-1774703413501.jpg> (referer: None)
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8067/20488067/interior_rear_seats-1774703427184.jpg> (referer: None)
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f457c10>
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1268%252F17611268%252Fdocs_service_history-1774693151138.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0a66c0dd8fdd19a44ad7860d5df9bcd2') HTTP/1.1" 204 0
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1268/17611268/docs_service_history-1774693151138.jpeg?ixlib=js-3.8.0&auto=format&s=0a66c0dd8fdd19a44ad7860d5df9bcd2 saved to cache
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9353593-cd06-5cda-a17c-15b3d023ad43
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e113950>
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8067%252F20488067%252Fexterior_front_passenger-1774703070090.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_front_passenger-1774703070090.jpg saved to cache
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5cf710>
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8717%252F20418717%252Finstrument_cluster-1774346212191.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8717/20418717/instrument_cluster-1774346212191.jpg saved to cache
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9688f9d-3692-575f-bd6e-91e6c0b582e6
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9983d0>
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8717%252F20418717%252Finterior_rear_seats-1774346540907.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8717/20418717/interior_rear_seats-1774346540907.jpg saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9688f9d-3692-575f-bd6e-91e6c0b582e6
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00/0\x86\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xd6\xbb\x00/&\x82\x00\x00\x00\x00'
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e088ed0>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1268%252F17611268%252Finterior_rear_seats-1758389018159.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1268/17611268/interior_rear_seats-1758389018159.jpeg saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9353593-cd06-5cda-a17c-15b3d023ad43
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x002\xe5c\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xd7\xc8\x002\xdb_\x00\x00\x00\x00'
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5cc190>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1268%252F17611268%252Finterior_dashboard-1758389030977.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1268/17611268/interior_dashboard-1758389030977.jpeg saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9353593-cd06-5cda-a17c-15b3d023ad43
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0898d0>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8717%252F20418717%252Finterior_front_seats-1774346101494.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8717/20418717/interior_front_seats-1774346101494.jpg saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9688f9d-3692-575f-bd6e-91e6c0b582e6
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc153d0>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8067%252F20488067%252Finterior_front_seats-1774703413501.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8067/20488067/interior_front_seats-1774703413501.jpg saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc0b910>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8067%252F20488067%252Finterior_rear_seats-1774703427184.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8067/20488067/interior_rear_seats-1774703427184.jpg saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27
2026-03-29 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4640/19734640/docs_service_history-1773738857473.jpeg?ixlib=js-3.8.0&auto=format&s=0655dc735c9cd6d1e7ce81efc4fddd9b> (referer: None)
2026-03-29 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_rear_passenger-1774345690231.jpg> (referer: None)
2026-03-29 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_rear_passenger-1758388775964.jpeg> (referer: None)
2026-03-29 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1268/17611268/interior_front_seats-1758388965998.jpeg> (referer: None)
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c917d10>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4640%252F19734640%252Fdocs_service_history-1773738857473.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0655dc735c9cd6d1e7ce81efc4fddd9b') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4640/19734640/docs_service_history-1773738857473.jpeg?ixlib=js-3.8.0&auto=format&s=0655dc735c9cd6d1e7ce81efc4fddd9b saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73d9b3c1-c9e3-5821-84b5-0300833d0999
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f355fad10>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8717%252F20418717%252Fexterior_rear_passenger-1774345690231.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_rear_passenger-1774345690231.jpg saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9688f9d-3692-575f-bd6e-91e6c0b582e6
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daf9410>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1268%252F17611268%252Fexterior_rear_passenger-1758388775964.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_rear_passenger-1758388775964.jpeg saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9353593-cd06-5cda-a17c-15b3d023ad43
2026-03-29 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20470032.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x006M\xee\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02H\x8c\x006C\xea\x00\x00\x00\x00'
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daf9450>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1268%252F17611268%252Finterior_front_seats-1758388965998.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1268/17611268/interior_front_seats-1758388965998.jpeg saved to cache
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9353593-cd06-5cda-a17c-15b3d023ad43
2026-03-29 20:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5789ba52-7782-5cf2-a47f-d2bbda0eb490 with identifier: 20470032
2026-03-29 20:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490 with scrape type 1
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0032%252F20470032%252Fexterior_front_driver-1774630353194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_front_driver-1774630353194.jpg not downloaded yet
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0032%252F20470032%252Fexterior_rear_driver-1774630369590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_rear_driver-1774630369590.jpg not downloaded yet
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0032%252F20470032%252Fexterior_front_passenger-1774630396389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_front_passenger-1774630396389.jpg not downloaded yet
2026-03-29 20:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_front_driver-1774703032999.jpg> (referer: None)
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0032%252F20470032%252Fexterior_rear_passenger-1774630379113.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_rear_passenger-1774630379113.jpg not downloaded yet
2026-03-29 20:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_rear_driver-1774345675306.jpg> (referer: None)
2026-03-29 20:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_rear_passenger-1772474653546.jpeg> (referer: None)
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0032%252F20470032%252F20470032-interior_front_seats-modified-1774691242297.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0032/20470032/20470032-interior_front_seats-modified-1774691242297.jpeg not downloaded yet
2026-03-29 20:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_front_passenger-1774345695018.jpg> (referer: None)
2026-03-29 20:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4640/19734640/19734640-interior_rear_seats-modified-1773847278524.jpeg> (referer: None)
2026-03-29 20:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_front_passenger-1772474645088.jpeg> (referer: None)
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0032%252F20470032%252Finterior_rear_seats-1774630745066.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0032/20470032/interior_rear_seats-1774630745066.jpg not downloaded yet
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0032%252F20470032%252Finterior_dashboard-1774630780338.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0032/20470032/interior_dashboard-1774630780338.jpg not downloaded yet
2026-03-29 20:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_rear_driver-1774703048486.jpg> (referer: None)
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0032%252F20470032%252Finterior_boot-1774620130119.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0032/20470032/interior_boot-1774620130119.jpg not downloaded yet
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d3e6150>
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8067%252F20488067%252Fexterior_front_driver-1774703032999.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_front_driver-1774703032999.jpg saved to cache
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0032%252F20470032%252Fdocs_service_history-1774630937095.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9c925833e50a5b2bc3f62b9a19d443e4%27 HTTP/1.1" 200 None
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0032/20470032/docs_service_history-1774630937095.jpg?ixlib=js-3.8.0&auto=format&s=9c925833e50a5b2bc3f62b9a19d443e4 not downloaded yet
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db20650>
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8717%252F20418717%252Fexterior_rear_driver-1774345675306.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_rear_driver-1774345675306.jpg saved to cache
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9688f9d-3692-575f-bd6e-91e6c0b582e6
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3e6ed0>
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4640%252F19734640%252Fexterior_rear_passenger-1772474653546.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_rear_passenger-1772474653546.jpeg saved to cache
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73d9b3c1-c9e3-5821-84b5-0300833d0999
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0032%252F20470032%252Fdocs_service_history-1774691342261-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D05bcaa6707d73975f8eee14f700f72b5%27 HTTP/1.1" 200 None
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0032/20470032/docs_service_history-1774691342261-1.jpeg?ixlib=js-3.8.0&auto=format&s=05bcaa6707d73975f8eee14f700f72b5 not downloaded yet
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d928b50>
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8717%252F20418717%252Fexterior_front_passenger-1774345695018.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_front_passenger-1774345695018.jpg saved to cache
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9688f9d-3692-575f-bd6e-91e6c0b582e6
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d92a190>
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4640%252F19734640%252F19734640-interior_rear_seats-modified-1773847278524.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4640/19734640/19734640-interior_rear_seats-modified-1773847278524.jpeg saved to cache
2026-03-29 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73d9b3c1-c9e3-5821-84b5-0300833d0999
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d664510>
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4640%252F19734640%252Fexterior_front_passenger-1772474645088.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_front_passenger-1772474645088.jpeg saved to cache
2026-03-29 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73d9b3c1-c9e3-5821-84b5-0300833d0999
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d664250>
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8067%252F20488067%252Fexterior_rear_driver-1774703048486.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_rear_driver-1774703048486.jpg saved to cache
2026-03-29 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27
2026-03-29 20:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27, skipping ID generation
2026-03-29 20:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27 with scrape type 1
2026-03-29 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27 sending to next pipeline
2026-03-29 20:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27, identifier: 20488067
2026-03-29 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_front_passenger-1758388755166.jpeg> (referer: None)
2026-03-29 20:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27 with identifier: 20488067
2026-03-29 20:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27 with identifier: 20488067
2026-03-29 20:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27 with identifier: 20488067 to the API
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_rear_driver-1774703048486.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CN17 ZBU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488067',
'listing': 'auction',
'location': 'Essex Chelmsford',
'make': 'Volkswagen',
'model': 'Amarok',
'odometer': 86924,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1748000,
'Height': 2815,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_front_driver-1774703032999.jpg',
'Width': 3753},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1501736,
'Height': 2675,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_rear_driver-1774703048486.jpg',
'Width': 3567},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1681382,
'Height': 2942,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_front_passenger-1774703070090.jpg',
'Width': 3923},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2010861,
'Height': 2992,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8067/20488067/exterior_rear_passenger-1774703057901.jpg',
'Width': 3989},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3673417,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8067/20488067/interior_front_seats-1774703413501.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3157567,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8067/20488067/interior_rear_seats-1774703427184.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2223452,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8067/20488067/interior_dashboard-1774703447765.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2678264,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8067/20488067/instrument_cluster-1774703518361.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4348972,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8067/20488067/interior_boot-1774703459641.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27/a0bc1e4c-bea7-56fd-82a9-f1aacb39ab27_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43845,
'Height': 367,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8067/20488067/damage_missing_trims-1774705051444.jpg',
'Width': 490}],
'price': 10586,
'price_includes_vat': False,
'registration_date': '2017-03-03',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Amarok Highline 4MOTION DC A',
'transmission': 'automatic',
'trim': 'Highline 4MOTION DC A',
'vin': 'WV1ZZZ2HZGA045463',
'year': 2017}
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488067%27 HTTP/1.1" 200 None
2026-03-29 20:06:50 [motorway.uk] INFO: Saving data for 20488067: {'created_time': 1774814810.131035, 'last_price_update_time': 1774814810.131046, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488067') HTTP/1.1" 204 0
2026-03-29 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8717/20418717/interior_boot-1774346565546.jpg> (referer: None)
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d529990>
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1268%252F17611268%252Fexterior_front_passenger-1758388755166.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_front_passenger-1758388755166.jpeg saved to cache
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9353593-cd06-5cda-a17c-15b3d023ad43
2026-03-29 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1268/17611268/interior_boot-1758389105683.jpeg> (referer: None)
2026-03-29 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4640/19734640/interior_front_seats-1772474682172.jpeg> (referer: None)
2026-03-29 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_rear_driver-1758388796550.jpeg> (referer: None)
2026-03-29 20:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce36cd0>
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8717%252F20418717%252Finterior_boot-1774346565546.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8717/20418717/interior_boot-1774346565546.jpg saved to cache
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9688f9d-3692-575f-bd6e-91e6c0b582e6
2026-03-29 20:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9688f9d-3692-575f-bd6e-91e6c0b582e6, skipping ID generation
2026-03-29 20:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9688f9d-3692-575f-bd6e-91e6c0b582e6 with scrape type 1
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9688f9d-3692-575f-bd6e-91e6c0b582e6 sending to next pipeline
2026-03-29 20:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c9688f9d-3692-575f-bd6e-91e6c0b582e6, identifier: 20418717
2026-03-29 20:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c9688f9d-3692-575f-bd6e-91e6c0b582e6 with identifier: 20418717
2026-03-29 20:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c9688f9d-3692-575f-bd6e-91e6c0b582e6 with identifier: 20418717
2026-03-29 20:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c9688f9d-3692-575f-bd6e-91e6c0b582e6 with identifier: 20418717 to the API
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8717/20418717/interior_boot-1774346565546.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'c9688f9d-3692-575f-bd6e-91e6c0b582e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RO72 HYF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20418717',
'listing': 'auction',
'location': 'Buckinghamshire High Wycombe',
'make': 'Toyota',
'model': 'Corolla',
'odometer': 30000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1688792,
'Height': 2503,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_front_driver-1774345658761.jpg',
'Width': 3337},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1518156,
'Height': 2603,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_rear_driver-1774345675306.jpg',
'Width': 3470},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1628895,
'Height': 2646,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_front_passenger-1774345695018.jpg',
'Width': 3528},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1397415,
'Height': 2570,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8717/20418717/exterior_rear_passenger-1774345690231.jpg',
'Width': 3426},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3592286,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8717/20418717/interior_front_seats-1774346101494.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4866677,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8717/20418717/interior_rear_seats-1774346540907.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1952937,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8717/20418717/interior_dashboard-1774346143212.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2861988,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8717/20418717/instrument_cluster-1774346212191.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3631637,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8717/20418717/interior_boot-1774346565546.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9688f9d-3692-575f-bd6e-91e6c0b582e6/c9688f9d-3692-575f-bd6e-91e6c0b582e6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 695505,
'Height': 3066,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8717/20418717/docs_service_history-1774346301134.jpg?ixlib=js-3.8.0&auto=format&s=1e4431b6c412293225f088fe666f78a7',
'Width': 2218}],
'price': 20287,
'price_includes_vat': False,
'registration_date': '2022-11-02',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Corolla GR Sport HEV CVT',
'transmission': 'automatic',
'trim': 'GR Sport HEV CVT',
'vin': 'SB1Z53BE10E108623',
'year': 2022}
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720418717%27 HTTP/1.1" 200 None
2026-03-29 20:06:50 [motorway.uk] INFO: Saving data for 20418717: {'created_time': 1774814810.86849, 'last_price_update_time': 1774814810.868501, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20418717') HTTP/1.1" 204 0
2026-03-29 20:06:50 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:50 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:50 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x005?!\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x039!\x0055\x1d\x00\x00\x00\x00'
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce32f90>
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1268%252F17611268%252Finterior_boot-1758389105683.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1268/17611268/interior_boot-1758389105683.jpeg saved to cache
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9353593-cd06-5cda-a17c-15b3d023ad43
2026-03-29 20:06:51 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:51 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:51 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00" g\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02sx\x00"\x15\xe7\x00\x00\x00\x00'
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5bc150>
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4640%252F19734640%252Finterior_front_seats-1772474682172.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4640/19734640/interior_front_seats-1772474682172.jpeg saved to cache
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73d9b3c1-c9e3-5821-84b5-0300833d0999
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db5d910>
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1268%252F17611268%252Fexterior_rear_driver-1758388796550.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_rear_driver-1758388796550.jpeg saved to cache
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9353593-cd06-5cda-a17c-15b3d023ad43
2026-03-29 20:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9353593-cd06-5cda-a17c-15b3d023ad43, skipping ID generation
2026-03-29 20:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9353593-cd06-5cda-a17c-15b3d023ad43 with scrape type 1
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9353593-cd06-5cda-a17c-15b3d023ad43 sending to next pipeline
2026-03-29 20:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e9353593-cd06-5cda-a17c-15b3d023ad43, identifier: 17611268
2026-03-29 20:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e9353593-cd06-5cda-a17c-15b3d023ad43 with identifier: 17611268
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Green HTTP/1.1" 200 None
2026-03-29 20:06:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e9353593-cd06-5cda-a17c-15b3d023ad43 with identifier: 17611268
2026-03-29 20:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e9353593-cd06-5cda-a17c-15b3d023ad43 with identifier: 17611268 to the API
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_rear_driver-1758388796550.jpeg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e9353593-cd06-5cda-a17c-15b3d023ad43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HF18 MXH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17611268',
'listing': 'auction',
'location': 'Oxfordshire Oxford',
'make': 'Audi',
'model': 'Q3',
'odometer': 66372,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1886184,
'Height': 2543,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_front_driver-1758388743891.jpeg',
'Width': 3390},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2364623,
'Height': 2777,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_rear_driver-1758388796550.jpeg',
'Width': 3703},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1906738,
'Height': 2656,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_front_passenger-1758388755166.jpeg',
'Width': 3541},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2313059,
'Height': 2921,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1268/17611268/exterior_rear_passenger-1758388775964.jpeg',
'Width': 3894},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3708538,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1268/17611268/interior_front_seats-1758388965998.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3213121,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1268/17611268/interior_rear_seats-1758389018159.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3521835,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1268/17611268/interior_dashboard-1758389030977.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3700802,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1268/17611268/interior_boot-1758389105683.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579945,
'Height': 1126,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1268/17611268/docs_service_history-1774693151138.jpeg?ixlib=js-3.8.0&auto=format&s=0a66c0dd8fdd19a44ad7860d5df9bcd2',
'Width': 2000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9353593-cd06-5cda-a17c-15b3d023ad43/e9353593-cd06-5cda-a17c-15b3d023ad43_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1843371,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1268/17611268/docs_service_history-1774693158463.jpeg?ixlib=js-3.8.0&auto=format&s=da827ac0fdf6eca2a6990d6a82b4ca78',
'Width': 3024}],
'price': 13397,
'price_includes_vat': False,
'registration_date': '2018-03-02',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q3 S Line BLK ED TFSI Quat SA',
'transmission': 'automatic',
'trim': 'S Line BLK ED TFSI Quat SA',
'vin': 'WAUZZZ8U7JR052177',
'year': 2018}
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717611268%27 HTTP/1.1" 200 None
2026-03-29 20:06:51 [motorway.uk] INFO: Saving data for 17611268: {'created_time': 1774814811.923377, 'last_price_update_time': 1774814811.923388, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17611268') HTTP/1.1" 204 0
2026-03-29 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_rear_driver-1772474662518.jpeg> (referer: None)
2026-03-29 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_front_passenger-1774630396389.jpg> (referer: None)
2026-03-29 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=360&page=10&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_front_driver-1774286164534.jpg> (referer: None)
2026-03-29 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_front_passenger-1774286212433.jpg> (referer: None)
2026-03-29 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_rear_passenger-1774630379113.jpg> (referer: None)
2026-03-29 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_rear_driver-1774630369590.jpg> (referer: None)
2026-03-29 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0032/20470032/docs_service_history-1774630937095.jpg?ixlib=js-3.8.0&auto=format&s=9c925833e50a5b2bc3f62b9a19d443e4> (referer: None)
2026-03-29 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0032/20470032/docs_service_history-1774691342261-1.jpeg?ixlib=js-3.8.0&auto=format&s=05bcaa6707d73975f8eee14f700f72b5> (referer: None)
2026-03-29 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0032/20470032/interior_boot-1774620130119.jpg> (referer: None)
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f30f810>
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4640%252F19734640%252Fexterior_rear_driver-1772474662518.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_rear_driver-1772474662518.jpeg saved to cache
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73d9b3c1-c9e3-5821-84b5-0300833d0999
2026-03-29 20:06:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73d9b3c1-c9e3-5821-84b5-0300833d0999, skipping ID generation
2026-03-29 20:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73d9b3c1-c9e3-5821-84b5-0300833d0999 with scrape type 1
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73d9b3c1-c9e3-5821-84b5-0300833d0999 sending to next pipeline
2026-03-29 20:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 73d9b3c1-c9e3-5821-84b5-0300833d0999, identifier: 19734640
2026-03-29 20:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 73d9b3c1-c9e3-5821-84b5-0300833d0999 with identifier: 19734640
2026-03-29 20:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 73d9b3c1-c9e3-5821-84b5-0300833d0999 with identifier: 19734640
2026-03-29 20:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 73d9b3c1-c9e3-5821-84b5-0300833d0999 with identifier: 19734640 to the API
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_rear_driver-1772474662518.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '73d9b3c1-c9e3-5821-84b5-0300833d0999',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SA67 XFR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19734640',
'listing': 'auction',
'location': 'Perth and Kinross Perth',
'make': 'Mercedes',
'model': 'GLS Class',
'odometer': 67550,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1281616,
'Height': 2687,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_front_driver-1772474636109.jpeg',
'Width': 3582},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1300528,
'Height': 2495,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_rear_driver-1772474662518.jpeg',
'Width': 3327},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1192826,
'Height': 2579,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_front_passenger-1772474645088.jpeg',
'Width': 3438},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1083249,
'Height': 2544,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4640/19734640/exterior_rear_passenger-1772474653546.jpeg',
'Width': 3392},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2397151,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4640/19734640/interior_front_seats-1772474682172.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1233827,
'Height': 2381,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4640/19734640/19734640-interior_rear_seats-modified-1773847278524.jpeg',
'Width': 3175},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2554453,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4640/19734640/interior_dashboard-1772474736214.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2479087,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4640/19734640/instrument_cluster-1774282765516.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2450192,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4640/19734640/interior_boot-1772474744822.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d9b3c1-c9e3-5821-84b5-0300833d0999/73d9b3c1-c9e3-5821-84b5-0300833d0999_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161937,
'Height': 2194,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4640/19734640/docs_service_history-1773738857473.jpeg?ixlib=js-3.8.0&auto=format&s=0655dc735c9cd6d1e7ce81efc4fddd9b',
'Width': 1320}],
'price': 23556,
'price_includes_vat': False,
'registration_date': '2018-02-12',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLS 350 D AMG Line 4MATIC Auto',
'transmission': 'automatic',
'trim': 'GLS 350 D AMG Line 4MATIC Auto',
'vin': 'WDC1668242A990051',
'year': 2018}
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719734640%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [motorway.uk] INFO: Saving data for 19734640: {'created_time': 1774814812.601533, 'last_price_update_time': 1774814812.601544, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19734640') HTTP/1.1" 204 0
2026-03-29 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_front_passenger-1774709759096.jpg> (referer: None)
2026-03-29 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9983/20489983/instrument_cluster-1774710396989.jpg> (referer: None)
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6d7dd0>
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0032%252F20470032%252Fexterior_front_passenger-1774630396389.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_front_passenger-1774630396389.jpg saved to cache
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 18969142
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718969142%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [motorway.uk] INFO: Scrape type for 18969142: 1
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f37ebd0>
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3410%252F20393410%252Fexterior_front_driver-1774286164534.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_front_driver-1774286164534.jpg saved to cache
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e13e0d0>
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3410%252F20393410%252Fexterior_front_passenger-1774286212433.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_front_passenger-1774286212433.jpg saved to cache
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2
2026-03-29 20:06:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2a5bc6d-0126-534d-9a94-d983ce3ab7f2, skipping ID generation
2026-03-29 20:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2 with scrape type 1
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2a5bc6d-0126-534d-9a94-d983ce3ab7f2 sending to next pipeline
2026-03-29 20:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e2a5bc6d-0126-534d-9a94-d983ce3ab7f2, identifier: 20393410
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7be690>
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0032%252F20470032%252Fexterior_rear_passenger-1774630379113.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_rear_passenger-1774630379113.jpg saved to cache
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce22610>
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0032%252F20470032%252Fexterior_rear_driver-1774630369590.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_rear_driver-1774630369590.jpg saved to cache
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490
2026-03-29 20:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f282710>
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0032%252F20470032%252Fdocs_service_history-1774630937095.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9c925833e50a5b2bc3f62b9a19d443e4') HTTP/1.1" 204 0
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0032/20470032/docs_service_history-1774630937095.jpg?ixlib=js-3.8.0&auto=format&s=9c925833e50a5b2bc3f62b9a19d443e4 saved to cache
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d106b50>
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0032%252F20470032%252Fdocs_service_history-1774691342261-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D05bcaa6707d73975f8eee14f700f72b5') HTTP/1.1" 204 0
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0032/20470032/docs_service_history-1774691342261-1.jpeg?ixlib=js-3.8.0&auto=format&s=05bcaa6707d73975f8eee14f700f72b5 saved to cache
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490
2026-03-29 20:06:53 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:53 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:53 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x02"\xdf\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00xS\x00\x01\xfd\xa8\x00\x00\x00\x00'
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce20d50>
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0032%252F20470032%252Finterior_boot-1774620130119.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0032/20470032/interior_boot-1774620130119.jpg saved to cache
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490
2026-03-29 20:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e2a5bc6d-0126-534d-9a94-d983ce3ab7f2 with identifier: 20393410
2026-03-29 20:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e2a5bc6d-0126-534d-9a94-d983ce3ab7f2 with identifier: 20393410
2026-03-29 20:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e2a5bc6d-0126-534d-9a94-d983ce3ab7f2 with identifier: 20393410 to the API
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_front_passenger-1774286212433.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e2a5bc6d-0126-534d-9a94-d983ce3ab7f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC19 YWJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20393410',
'listing': 'auction',
'location': 'Surrey Weybridge',
'make': 'Audi',
'model': 'A5',
'odometer': 64076,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1739806,
'Height': 2704,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_front_driver-1774286164534.jpg',
'Width': 3605},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1533034,
'Height': 2662,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_rear_driver-1774286181660.jpg',
'Width': 3549},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1612949,
'Height': 2702,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_front_passenger-1774286212433.jpg',
'Width': 3602},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1484977,
'Height': 2733,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3410/20393410/exterior_rear_passenger-1774286195873.jpg',
'Width': 3644},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3426415,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3410/20393410/interior_front_seats-1774286544928.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2219130,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3410/20393410/interior_rear_seats-1774286568658.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1954060,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3410/20393410/interior_dashboard-1774287062202.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1249071,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3410/20393410/instrument_cluster-1774287550891.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2963376,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3410/20393410/interior_boot-1774286762469.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5bc6d-0126-534d-9a94-d983ce3ab7f2/e2a5bc6d-0126-534d-9a94-d983ce3ab7f2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1666490,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3410/20393410/docs_service_history-1774713312854.jpg?ixlib=js-3.8.0&auto=format&s=a3465033855235ffb1b71cdabd2752d3',
'Width': 3024}],
'price': 14143,
'price_includes_vat': False,
'registration_date': '2019-04-18',
'seats_number': None,
'seller_name': None,
'title': 'Audi A5 S Line Black ED 40 TFSI',
'transmission': 'automatic',
'trim': 'S Line Black ED 40 TFSI',
'vin': 'WAUZZZF55KA039701',
'year': 2019}
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720393410%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [motorway.uk] INFO: Saving data for 20393410: {'created_time': 1774814813.773593, 'last_price_update_time': 1774814813.773604, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20393410') HTTP/1.1" 204 0
2026-03-29 20:06:53 [motorway.uk] INFO: Found listing with ID: 19163712
2026-03-29 20:06:53 [motorway.uk] INFO: Found listing with ID: 10452717
2026-03-29 20:06:53 [motorway.uk] INFO: Found listing with ID: 18171472
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718171472%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [motorway.uk] INFO: Scrape type for 18171472: 1
2026-03-29 20:06:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:53 [motorway.uk] INFO: Found listing with ID: 20302141
2026-03-29 20:06:53 [motorway.uk] INFO: Found listing with ID: 20404971
2026-03-29 20:06:53 [motorway.uk] INFO: Found listing with ID: 19535149
2026-03-29 20:06:53 [motorway.uk] INFO: Found listing with ID: 20368231
2026-03-29 20:06:53 [motorway.uk] INFO: Found listing with ID: 19585852
2026-03-29 20:06:53 [motorway.uk] INFO: Found listing with ID: 20303922
2026-03-29 20:06:53 [motorway.uk] INFO: Found listing with ID: 19960180
2026-03-29 20:06:53 [motorway.uk] INFO: Found listing with ID: 17662839
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717662839%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [motorway.uk] INFO: Scrape type for 17662839: 1
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d92a210>
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9983%252F20489983%252Fexterior_front_passenger-1774709759096.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_front_passenger-1774709759096.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23cf65ad-1d5c-5679-ad18-438901afa0cd
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc88510>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9983%252F20489983%252Finstrument_cluster-1774710396989.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9983/20489983/instrument_cluster-1774710396989.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23cf65ad-1d5c-5679-ad18-438901afa0cd
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 20459994
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 19144130
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 20459047
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 18354443
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718354443%27 HTTP/1.1" 200 None
2026-03-29 20:06:54 [motorway.uk] INFO: Scrape type for 18354443: 1
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 20148114
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 12711502
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 19337875
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 10813763
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 18907003
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 15916141
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 20257823
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 20475074
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 15870409
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715870409%27 HTTP/1.1" 200 None
2026-03-29 20:06:54 [motorway.uk] INFO: Scrape type for 15870409: 1
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9947/19699947/wheels_front_driver-1774711571249.jpg> (referer: None)
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 20251970
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 17727943
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717727943%27 HTTP/1.1" 200 None
2026-03-29 20:06:54 [motorway.uk] INFO: Scrape type for 17727943: 1
2026-03-29 20:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 20462595
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 20192465
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720192465%27 HTTP/1.1" 200 None
2026-03-29 20:06:54 [motorway.uk] INFO: Scrape type for 20192465: 1
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9983/20489983/interior_boot-1774710419173.jpg> (referer: None)
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9983/20489983/interior_front_seats-1774710330803.jpg> (referer: None)
2026-03-29 20:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 20063535
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 20333711
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 18068486
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 20437958
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 20459514
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 18787282
2026-03-29 20:06:54 [motorway.uk] INFO: Found listing with ID: 10538324
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_front_driver-1774709702173.jpg> (referer: None)
2026-03-29 20:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_front_driver-1774630353194.jpg> (referer: None)
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0032/20470032/interior_dashboard-1774630780338.jpg> (referer: None)
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0032/20470032/20470032-interior_front_seats-modified-1774691242297.jpeg> (referer: None)
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0032/20470032/interior_rear_seats-1774630745066.jpg> (referer: None)
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9947/19699947/interior_rear_seats-1774712420836.jpg> (referer: None)
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9947/19699947/interior_front_seats-1774712414662.jpg> (referer: None)
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d748550>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9947%252F19699947%252Fwheels_front_driver-1774711571249.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9947/19699947/wheels_front_driver-1774711571249.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 15:06:45\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cac9f50>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9983%252F20489983%252Finterior_boot-1774710419173.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9983/20489983/interior_boot-1774710419173.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23cf65ad-1d5c-5679-ad18-438901afa0cd
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 15:04:43\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5bc550>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9983%252F20489983%252Finterior_front_seats-1774710330803.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9983/20489983/interior_front_seats-1774710330803.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23cf65ad-1d5c-5679-ad18-438901afa0cd
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca23390>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9983%252F20489983%252Fexterior_front_driver-1774709702173.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_front_driver-1774709702173.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23cf65ad-1d5c-5679-ad18-438901afa0cd
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f357320d0>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0032%252F20470032%252Fexterior_front_driver-1774630353194.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_front_driver-1774630353194.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9b1a50>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0032%252F20470032%252Finterior_dashboard-1774630780338.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0032/20470032/interior_dashboard-1774630780338.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9b2d10>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0032%252F20470032%252F20470032-interior_front_seats-modified-1774691242297.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0032/20470032/20470032-interior_front_seats-modified-1774691242297.jpeg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5be250>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0032%252F20470032%252Finterior_rear_seats-1774630745066.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0032/20470032/interior_rear_seats-1774630745066.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490
2026-03-29 20:06:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5789ba52-7782-5cf2-a47f-d2bbda0eb490, skipping ID generation
2026-03-29 20:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490 with scrape type 1
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5789ba52-7782-5cf2-a47f-d2bbda0eb490 sending to next pipeline
2026-03-29 20:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5789ba52-7782-5cf2-a47f-d2bbda0eb490, identifier: 20470032
2026-03-29 20:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5789ba52-7782-5cf2-a47f-d2bbda0eb490 with identifier: 20470032
2026-03-29 20:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5789ba52-7782-5cf2-a47f-d2bbda0eb490 with identifier: 20470032
2026-03-29 20:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5789ba52-7782-5cf2-a47f-d2bbda0eb490 with identifier: 20470032 to the API
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0032/20470032/interior_rear_seats-1774630745066.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '5789ba52-7782-5cf2-a47f-d2bbda0eb490',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LG69 CVE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20470032',
'listing': 'auction',
'location': 'Surrey Ashford',
'make': 'Jaguar',
'model': 'F-PACE',
'odometer': 57000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1998389,
'Height': 2660,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_front_driver-1774630353194.jpg',
'Width': 3547},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1795694,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_rear_driver-1774630369590.jpg',
'Width': 3454},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1277078,
'Height': 2222,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_front_passenger-1774630396389.jpg',
'Width': 2962},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1924530,
'Height': 2721,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0032/20470032/exterior_rear_passenger-1774630379113.jpg',
'Width': 3628},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2831072,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0032/20470032/20470032-interior_front_seats-modified-1774691242297.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3493911,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0032/20470032/interior_rear_seats-1774630745066.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1783744,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0032/20470032/interior_dashboard-1774630780338.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 170802,
'Height': 480,
'OriginUrl': 'https://motorway-photos.imgix.net/0032/20470032/interior_boot-1774620130119.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98797,
'Height': 1264,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0032/20470032/docs_service_history-1774630937095.jpg?ixlib=js-3.8.0&auto=format&s=9c925833e50a5b2bc3f62b9a19d443e4',
'Width': 912},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5789ba52-7782-5cf2-a47f-d2bbda0eb490/5789ba52-7782-5cf2-a47f-d2bbda0eb490_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59125,
'Height': 1263,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0032/20470032/docs_service_history-1774691342261-1.jpeg?ixlib=js-3.8.0&auto=format&s=05bcaa6707d73975f8eee14f700f72b5',
'Width': 892}],
'price': 12753,
'price_includes_vat': False,
'registration_date': '2019-09-11',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar F-PACE R-Sport D Auto',
'transmission': 'automatic',
'trim': 'R-Sport D Auto',
'vin': 'SADCB2AN8LA626962',
'year': 2019}
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720470032%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [motorway.uk] INFO: Saving data for 20470032: {'created_time': 1774814815.527743, 'last_price_update_time': 1774814815.527753, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20470032') HTTP/1.1" 204 0
2026-03-29 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_rear_driver-1774709699382.jpg> (referer: None)
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f3580e210>
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9947%252F19699947%252Finterior_rear_seats-1774712420836.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9947/19699947/interior_rear_seats-1774712420836.jpg saved to cache
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc3d9d0>
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9947%252F19699947%252Finterior_front_seats-1774712414662.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9947/19699947/interior_front_seats-1774712414662.jpg saved to cache
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a
2026-03-29 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9947/19699947/docs_service_history-1774713872859.jpg?ixlib=js-3.8.0&auto=format&s=d4b96881aff4bb41f83ebcfaa1e6802e> (referer: None)
2026-03-29 20:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a2ed0>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9983%252F20489983%252Fexterior_rear_driver-1774709699382.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_rear_driver-1774709699382.jpg saved to cache
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23cf65ad-1d5c-5679-ad18-438901afa0cd
2026-03-29 20:06:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23cf65ad-1d5c-5679-ad18-438901afa0cd, skipping ID generation
2026-03-29 20:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23cf65ad-1d5c-5679-ad18-438901afa0cd with scrape type 1
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23cf65ad-1d5c-5679-ad18-438901afa0cd sending to next pipeline
2026-03-29 20:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 23cf65ad-1d5c-5679-ad18-438901afa0cd, identifier: 20489983
2026-03-29 20:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 23cf65ad-1d5c-5679-ad18-438901afa0cd with identifier: 20489983
2026-03-29 20:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 23cf65ad-1d5c-5679-ad18-438901afa0cd with identifier: 20489983
2026-03-29 20:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 23cf65ad-1d5c-5679-ad18-438901afa0cd with identifier: 20489983 to the API
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_rear_driver-1774709699382.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '23cf65ad-1d5c-5679-ad18-438901afa0cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NK20 BFF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20489983',
'listing': 'auction',
'location': 'Middlesbrough Middlesbrough',
'make': 'Renault',
'model': 'Trafic',
'odometer': 23500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111003,
'Height': 763,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_front_driver-1774709702173.jpg',
'Width': 1017},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195465,
'Height': 838,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_rear_driver-1774709699382.jpg',
'Width': 1117},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189530,
'Height': 800,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_front_passenger-1774709759096.jpg',
'Width': 1066},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247546,
'Height': 962,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9983/20489983/exterior_rear_passenger-1774709710772.jpg',
'Width': 1282},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1077432,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/9983/20489983/interior_front_seats-1774710330803.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 875351,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/9983/20489983/interior_rear_seats-1774710518713.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277990,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9983/20489983/interior_dashboard-1774710341927.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168128,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9983/20489983/instrument_cluster-1774710396989.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1079509,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/9983/20489983/interior_boot-1774710419173.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23cf65ad-1d5c-5679-ad18-438901afa0cd/23cf65ad-1d5c-5679-ad18-438901afa0cd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305435,
'Height': 1080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9983/20489983/docs_service_history-1774710643227.jpg?ixlib=js-3.8.0&auto=format&s=0a8a277f85a24c5bd0dc6c6b2f56e53e',
'Width': 1440}],
'price': 17231,
'price_includes_vat': False,
'registration_date': '2020-03-17',
'seats_number': None,
'seller_name': None,
'title': 'Renault Trafic Business Energy DCI',
'transmission': 'manual',
'trim': 'Business Energy DCI',
'vin': 'WF1JL000864922351',
'year': 2020}
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489983%27 HTTP/1.1" 200 None
2026-03-29 20:06:56 [motorway.uk] INFO: Saving data for 20489983: {'created_time': 1774814816.54139, 'last_price_update_time': 1774814816.541401, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20489983') HTTP/1.1" 204 0
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x048'
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\t$'
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 46 - Data Location: 74 - value: <table: 41 bytes>
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00s'
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d690210>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9947%252F19699947%252Fdocs_service_history-1774713872859.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd4b96881aff4bb41f83ebcfaa1e6802e') HTTP/1.1" 204 0
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9947/19699947/docs_service_history-1774713872859.jpg?ixlib=js-3.8.0&auto=format&s=d4b96881aff4bb41f83ebcfaa1e6802e saved to cache
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a
2026-03-29 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9947/19699947/interior_dashboard-1774714292998.jpg> (referer: None)
2026-03-29 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5866/20485866/docs_service_history-1774696672305.jpg?ixlib=js-3.8.0&auto=format&s=ff4d4fb18c684a244f599b53805744df> (referer: None)
2026-03-29 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5866/20485866/docs_service_history-1774696875150.jpg?ixlib=js-3.8.0&auto=format&s=bf4242cf2559714e788b2212fa4723b3> (referer: None)
2026-03-29 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9947/19699947/exterior_front_passenger-1774714244212.jpg> (referer: None)
2026-03-29 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0925/20490925/damage_scratches-1774713327155.jpg> (referer: None)
2026-03-29 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0925/20490925/instrument_cluster-1774713660235.jpg> (referer: None)
2026-03-29 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0925/20490925/interior_boot-1774713610182.jpg> (referer: None)
2026-03-29 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5866/20485866/interior_boot-1774696376397.jpg> (referer: None)
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2c6f10>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9947%252F19699947%252Finterior_dashboard-1774714292998.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9947/19699947/interior_dashboard-1774714292998.jpg saved to cache
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0ed4d0>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5866%252F20485866%252Fdocs_service_history-1774696672305.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dff4d4fb18c684a244f599b53805744df') HTTP/1.1" 204 0
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5866/20485866/docs_service_history-1774696672305.jpg?ixlib=js-3.8.0&auto=format&s=ff4d4fb18c684a244f599b53805744df saved to cache
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1275d5fa-c434-584e-b0bb-e3c27b674a35
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cac9ed0>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5866%252F20485866%252Fdocs_service_history-1774696875150.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbf4242cf2559714e788b2212fa4723b3') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5866/20485866/docs_service_history-1774696875150.jpg?ixlib=js-3.8.0&auto=format&s=bf4242cf2559714e788b2212fa4723b3 saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1275d5fa-c434-584e-b0bb-e3c27b674a35
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e16ef10>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9947%252F19699947%252Fexterior_front_passenger-1774714244212.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9947/19699947/exterior_front_passenger-1774714244212.jpg saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0eee10>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0925%252F20490925%252Fdamage_scratches-1774713327155.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0925/20490925/damage_scratches-1774713327155.jpg saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35530190>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0925%252F20490925%252Finstrument_cluster-1774713660235.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0925/20490925/instrument_cluster-1774713660235.jpg saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e16fdd0>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0925%252F20490925%252Finterior_boot-1774713610182.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0925/20490925/interior_boot-1774713610182.jpg saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e16d250>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5866%252F20485866%252Finterior_boot-1774696376397.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5866/20485866/interior_boot-1774696376397.jpg saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1275d5fa-c434-584e-b0bb-e3c27b674a35
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9947/19699947/exterior_rear_driver-1774714174312.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0925/20490925/interior_dashboard-1774717578241.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5866/20485866/interior_dashboard-1774698144493.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5866/20485866/interior_rear_seats-1774696402850.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=396&page=11&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9947/19699947/exterior_front_driver-1774711219887.jpg> (referer: None)
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e16e9d0>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9947%252F19699947%252Fexterior_rear_driver-1774714174312.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9947/19699947/exterior_rear_driver-1774714174312.jpg saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5d2150>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0925%252F20490925%252Finterior_dashboard-1774717578241.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0925/20490925/interior_dashboard-1774717578241.jpg saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3eb7d0>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5866%252F20485866%252Finterior_dashboard-1774698144493.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5866/20485866/interior_dashboard-1774698144493.jpg saved to cache
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1275d5fa-c434-584e-b0bb-e3c27b674a35
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3f1890>
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5866%252F20485866%252Finterior_rear_seats-1774696402850.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5866/20485866/interior_rear_seats-1774696402850.jpg saved to cache
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1275d5fa-c434-584e-b0bb-e3c27b674a35
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 18237479
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 20424370
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 10385844
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 20023878
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 20463571
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 19486980
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 7743070
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 11675984
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 11431082
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711431082%27 HTTP/1.1" 200 None
2026-03-29 20:06:58 [motorway.uk] INFO: Scrape type for 11431082: 1
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 20466900
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 20422527
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720422527%27 HTTP/1.1" 200 None
2026-03-29 20:06:58 [motorway.uk] INFO: Scrape type for 20422527: 1
2026-03-29 20:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20192465.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17727943.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18969142.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 20080388
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 12887188
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 20469058
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469058%27 HTTP/1.1" 200 None
2026-03-29 20:06:58 [motorway.uk] INFO: Scrape type for 20469058: 1
2026-03-29 20:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce21a90>
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9947%252F19699947%252Fexterior_front_driver-1774711219887.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9947/19699947/exterior_front_driver-1774711219887.jpg saved to cache
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a
2026-03-29 20:06:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a, skipping ID generation
2026-03-29 20:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a with scrape type 1
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a sending to next pipeline
2026-03-29 20:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a, identifier: 19699947
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 19693972
2026-03-29 20:06:58 [motorway.uk] INFO: Found listing with ID: 19713173
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719713173%27 HTTP/1.1" 200 None
2026-03-29 20:06:58 [motorway.uk] INFO: Scrape type for 19713173: 1
2026-03-29 20:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a with identifier: 19699947
2026-03-29 20:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a with identifier: 19699947
2026-03-29 20:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2f0086a7-0ebb-5a3e-a9ba-df9fe829136a with identifier: 19699947 to the API
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9947/19699947/exterior_front_driver-1774711219887.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '2f0086a7-0ebb-5a3e-a9ba-df9fe829136a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'L33 ANP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19699947',
'listing': 'auction',
'location': 'West Yorkshire Leeds',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 22034,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611693,
'Height': 2464,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9947/19699947/exterior_front_driver-1774711219887.jpg',
'Width': 3285},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1070158,
'Height': 2346,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9947/19699947/exterior_rear_driver-1774714174312.jpg',
'Width': 3128},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 770506,
'Height': 1923,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9947/19699947/exterior_front_passenger-1774714244212.jpg',
'Width': 2564},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501175,
'Height': 2219,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9947/19699947/exterior_rear_passenger-1774711226382.jpg',
'Width': 2958},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2071259,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9947/19699947/interior_front_seats-1774712414662.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3166108,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9947/19699947/interior_rear_seats-1774712420836.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1032024,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9947/19699947/interior_dashboard-1774714292998.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2354502,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9947/19699947/interior_boot-1774712417362.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394986,
'Height': 2340,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9947/19699947/docs_service_history-1774713872859.jpg?ixlib=js-3.8.0&auto=format&s=d4b96881aff4bb41f83ebcfaa1e6802e',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f0086a7-0ebb-5a3e-a9ba-df9fe829136a/2f0086a7-0ebb-5a3e-a9ba-df9fe829136a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 824347,
'Height': 2743,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9947/19699947/wheels_front_driver-1774711571249.jpg',
'Width': 3657}],
'price': 25753,
'price_includes_vat': False,
'registration_date': '2023-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque ED PHEV A',
'transmission': 'automatic',
'trim': 'Evoque ED PHEV A',
'vin': 'SALZA2AT4PH216298',
'year': 2023}
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719699947%27 HTTP/1.1" 200 None
2026-03-29 20:06:58 [motorway.uk] INFO: Saving data for 19699947: {'created_time': 1774814818.997617, 'last_price_update_time': 1774814818.997627, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19699947') HTTP/1.1" 204 0
2026-03-29 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15870409.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 19370782
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719370782%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [motorway.uk] INFO: Scrape type for 19370782: 1
2026-03-29 20:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18354443.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7838271d-3738-595e-b8b5-5210939f51fc with identifier: 20192465
2026-03-29 20:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7838271d-3738-595e-b8b5-5210939f51fc with scrape type 1
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7838271d-3738-595e-b8b5-5210939f51fc
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2465%252F20192465%252Fexterior_front_driver-1773596077010.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2465/20192465/exterior_front_driver-1773596077010.jpg already downloaded
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2465%252F20192465%252Fexterior_rear_driver-1773596198476.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2465/20192465/exterior_rear_driver-1773596198476.jpg already downloaded
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2465%252F20192465%252Fexterior_front_passenger-1773596128294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2465/20192465/exterior_front_passenger-1773596128294.jpg already downloaded
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2465%252F20192465%252Fexterior_rear_passenger-1773596155227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2465/20192465/exterior_rear_passenger-1773596155227.jpg already downloaded
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2465%252F20192465%252Finterior_front_seats-1773597223692.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2465/20192465/interior_front_seats-1773597223692.jpg already downloaded
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2465%252F20192465%252Finterior_rear_seats-1773597039859.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2465/20192465/interior_rear_seats-1773597039859.jpg already downloaded
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2465%252F20192465%252Finterior_dashboard-1773597066552.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2465/20192465/interior_dashboard-1773597066552.jpg already downloaded
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2465%252F20192465%252Finstrument_cluster-1773597118653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2465/20192465/instrument_cluster-1773597118653.jpg already downloaded
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2465%252F20192465%252Finterior_boot-1773597098898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2465/20192465/interior_boot-1773597098898.jpg already downloaded
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2465%252F20192465%252Fdocs_service_history-1773598867056.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd2bbf7cf23d3b251aa3adc47b60305a6%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2465/20192465/docs_service_history-1773598867056.jpg?ixlib=js-3.8.0&auto=format&s=d2bbf7cf23d3b251aa3adc47b60305a6 already downloaded
2026-03-29 20:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7838271d-3738-595e-b8b5-5210939f51fc, identifier: 20192465
2026-03-29 20:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e620fcb-6f0f-5452-aed7-865aaec57fc3 with identifier: 17727943
2026-03-29 20:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3 with scrape type 1
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7943%252F17727943%252Fexterior_front_driver-1774703441932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7943/17727943/exterior_front_driver-1774703441932.jpg not downloaded yet
2026-03-29 20:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e218a88-3582-5e14-a8fe-95834c36b091 with identifier: 18969142
2026-03-29 20:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e218a88-3582-5e14-a8fe-95834c36b091 with scrape type 1
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e218a88-3582-5e14-a8fe-95834c36b091
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9142%252F18969142%252F18969142-exterior_front_driver-modified-1774696008241.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9142/18969142/18969142-exterior_front_driver-modified-1774696008241.jpeg not downloaded yet
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 19687443
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 19280379
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 20156431
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 19905808
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 20454140
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 20386729
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 20000898
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 20501153
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 20416082
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 18349950
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 20300016
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 11716723
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 20488257
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 8670436
2026-03-29 20:06:59 [motorway.uk] INFO: Found listing with ID: 20266056
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720266056%27 HTTP/1.1" 200 None
2026-03-29 20:06:59 [motorway.uk] INFO: Scrape type for 20266056: 1
2026-03-29 20:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7838271d-3738-595e-b8b5-5210939f51fc with identifier: 20192465
2026-03-29 20:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7838271d-3738-595e-b8b5-5210939f51fc with identifier: 20192465
2026-03-29 20:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7838271d-3738-595e-b8b5-5210939f51fc with identifier: 20192465 to the API
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20192465.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7838271d-3738-595e-b8b5-5210939f51fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GD18 ZLK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20192465',
'listing': 'auction',
'location': 'Dorset Dorchester',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 46000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/2465/20192465/exterior_front_driver-1773596077010.jpg',
'https://motorway-photos-redacted.imgix.net/2465/20192465/exterior_rear_driver-1773596198476.jpg',
'https://motorway-photos-redacted.imgix.net/2465/20192465/exterior_front_passenger-1773596128294.jpg',
'https://motorway-photos-redacted.imgix.net/2465/20192465/exterior_rear_passenger-1773596155227.jpg',
'https://motorway-photos.imgix.net/2465/20192465/interior_front_seats-1773597223692.jpg',
'https://motorway-photos.imgix.net/2465/20192465/interior_rear_seats-1773597039859.jpg',
'https://motorway-photos-redacted.imgix.net/2465/20192465/interior_dashboard-1773597066552.jpg',
'https://motorway-photos-redacted.imgix.net/2465/20192465/instrument_cluster-1773597118653.jpg',
'https://motorway-photos.imgix.net/2465/20192465/interior_boot-1773597098898.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/2465/20192465/docs_service_history-1773598867056.jpg?ixlib=js-3.8.0&auto=format&s=d2bbf7cf23d3b251aa3adc47b60305a6'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7838271d-3738-595e-b8b5-5210939f51fc/7838271d-3738-595e-b8b5-5210939f51fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1296271,
'Height': 2326,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2465/20192465/exterior_front_driver-1773596077010.jpg',
'Width': 3101},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7838271d-3738-595e-b8b5-5210939f51fc/7838271d-3738-595e-b8b5-5210939f51fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2043392,
'Height': 2860,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2465/20192465/exterior_rear_driver-1773596198476.jpg',
'Width': 3813},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7838271d-3738-595e-b8b5-5210939f51fc/7838271d-3738-595e-b8b5-5210939f51fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2079291,
'Height': 2966,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2465/20192465/exterior_front_passenger-1773596128294.jpg',
'Width': 3955},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7838271d-3738-595e-b8b5-5210939f51fc/7838271d-3738-595e-b8b5-5210939f51fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2157516,
'Height': 2975,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2465/20192465/exterior_rear_passenger-1773596155227.jpg',
'Width': 3967},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7838271d-3738-595e-b8b5-5210939f51fc/7838271d-3738-595e-b8b5-5210939f51fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2821266,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2465/20192465/interior_front_seats-1773597223692.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7838271d-3738-595e-b8b5-5210939f51fc/7838271d-3738-595e-b8b5-5210939f51fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2703601,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2465/20192465/interior_rear_seats-1773597039859.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7838271d-3738-595e-b8b5-5210939f51fc/7838271d-3738-595e-b8b5-5210939f51fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3210588,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2465/20192465/interior_dashboard-1773597066552.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7838271d-3738-595e-b8b5-5210939f51fc/7838271d-3738-595e-b8b5-5210939f51fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2101478,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2465/20192465/instrument_cluster-1773597118653.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7838271d-3738-595e-b8b5-5210939f51fc/7838271d-3738-595e-b8b5-5210939f51fc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3792210,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2465/20192465/interior_boot-1773597098898.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7838271d-3738-595e-b8b5-5210939f51fc/7838271d-3738-595e-b8b5-5210939f51fc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2343507,
'Height': 5712,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2465/20192465/docs_service_history-1773598867056.jpg?ixlib=js-3.8.0&auto=format&s=d2bbf7cf23d3b251aa3adc47b60305a6',
'Width': 4284}],
'price': 8400,
'price_includes_vat': False,
'registration_date': '2018-06-29',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo SE',
'transmission': 'manual',
'trim': 'SE',
'vin': 'WVWZZZAWZJU033749',
'year': 2018}
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720192465%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [motorway.uk] INFO: Saving data for 20192465: {'created_time': 1774814820.01811, 'last_price_update_time': 1774814820.018124, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20192465') HTTP/1.1" 204 0
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7943%252F17727943%252Fexterior_rear_driver-1774697051095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7943/17727943/exterior_rear_driver-1774697051095.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9142%252F18969142%252Fexterior_rear_driver-1774693044036.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9142/18969142/exterior_rear_driver-1774693044036.jpeg not downloaded yet
2026-03-29 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17662839.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:00 [motorway.uk] INFO: Found listing with ID: 20449935
2026-03-29 20:07:00 [motorway.uk] INFO: Found listing with ID: 20429190
2026-03-29 20:07:00 [motorway.uk] INFO: Found listing with ID: 20031424
2026-03-29 20:07:00 [motorway.uk] INFO: Found listing with ID: 14826836
2026-03-29 20:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18171472.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eba9632d-1757-5c60-9884-b1dd06d767f9 with identifier: 15870409
2026-03-29 20:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eba9632d-1757-5c60-9884-b1dd06d767f9 with scrape type 1
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eba9632d-1757-5c60-9884-b1dd06d767f9
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F15870409%252Fexterior_front_driver-1769605503493.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/15870409/exterior_front_driver-1769605503493.jpeg already downloaded
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F15870409%252Fexterior_rear_driver-1769605577949.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/15870409/exterior_rear_driver-1769605577949.jpeg already downloaded
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F15870409%252Fexterior_front_passenger-1769605574090.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/15870409/exterior_front_passenger-1769605574090.jpeg already downloaded
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F15870409%252Fexterior_rear_passenger-1769605561519.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/15870409/exterior_rear_passenger-1769605561519.jpeg already downloaded
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0409%252F15870409%252F15870409-interior_front_seats-modified-1774783205123.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0409/15870409/15870409-interior_front_seats-modified-1774783205123.jpeg not downloaded yet
2026-03-29 20:07:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfcc4ff3-0923-5380-a331-4b77ed3fa8df with identifier: 18354443
2026-03-29 20:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df with scrape type 1
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4443%252F18354443%252Fexterior_front_driver-1774787484235.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4443/18354443/exterior_front_driver-1774787484235.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7943%252F17727943%252Fexterior_front_passenger-1774697245036.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7943/17727943/exterior_front_passenger-1774697245036.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9142%252F18969142%252F18969142-exterior_front_passenger-modified-1774696022939.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9142/18969142/18969142-exterior_front_passenger-modified-1774696022939.jpeg not downloaded yet
2026-03-29 20:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0409%252F15870409%252Finterior_rear_seats-1769605661735.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0409/15870409/interior_rear_seats-1769605661735.jpeg already downloaded
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0409%252F15870409%252F15870409-interior_dashboard-modified-1769607308705.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0409/15870409/15870409-interior_dashboard-modified-1769607308705.jpeg already downloaded
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0409%252F15870409%252Finterior_boot-1769605716543.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0409/15870409/interior_boot-1769605716543.jpeg already downloaded
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F0409%252F15870409%252Fdocs_service_history-1769606163141.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db40b4f989548734da3b255001ad017f2%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/0409/15870409/docs_service_history-1769606163141.jpeg?ixlib=js-3.8.0&auto=format&s=b40b4f989548734da3b255001ad017f2 already downloaded
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F15870409%252Fwheels_front_driver-1769605742489.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/15870409/wheels_front_driver-1769605742489.jpeg already downloaded
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4443%252F18354443%252Fexterior_rear_driver-1774786837949.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4443/18354443/exterior_rear_driver-1774786837949.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7943%252F17727943%252Fexterior_rear_passenger-1774697182281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7943/17727943/exterior_rear_passenger-1774697182281.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9142%252F18969142%252F18969142-exterior_rear_passenger-modified-1774696032939.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9142/18969142/18969142-exterior_rear_passenger-modified-1774696032939.jpeg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4443%252F18354443%252Fexterior_front_passenger-1774785162691.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4443/18354443/exterior_front_passenger-1774785162691.jpg not downloaded yet
2026-03-29 20:07:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df180df4-bcaf-55f4-b8c6-698f266f966a with identifier: 17662839
2026-03-29 20:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df180df4-bcaf-55f4-b8c6-698f266f966a with scrape type 1
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df180df4-bcaf-55f4-b8c6-698f266f966a
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2839%252F17662839%252Fexterior_front_driver-1774271523894.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_front_driver-1774271523894.jpg not downloaded yet
2026-03-29 20:07:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd2d0829-9904-5e2a-948d-d047f9a67dba with identifier: 18171472
2026-03-29 20:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2d0829-9904-5e2a-948d-d047f9a67dba with scrape type 1
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd2d0829-9904-5e2a-948d-d047f9a67dba
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1472%252F18171472%252Fexterior_front_driver-1774686710603.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_front_driver-1774686710603.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7943%252F17727943%252Finterior_front_seats-1774697589182.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7943/17727943/interior_front_seats-1774697589182.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9142%252F18969142%252Finterior_front_seats-1774693093773.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9142/18969142/interior_front_seats-1774693093773.jpeg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4443%252F18354443%252Fexterior_rear_passenger-1774786878122.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4443/18354443/exterior_rear_passenger-1774786878122.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2839%252F17662839%252Fexterior_rear_driver-1774271630180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_rear_driver-1774271630180.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1472%252F18171472%252Fexterior_rear_driver-1774686890766.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_rear_driver-1774686890766.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7943%252F17727943%252Finterior_rear_seats-1774697564414.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7943/17727943/interior_rear_seats-1774697564414.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9142%252F18969142%252Finterior_rear_seats-1774693187487.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9142/18969142/interior_rear_seats-1774693187487.jpeg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4443%252F18354443%252Finterior_front_seats-1774785420315.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4443/18354443/interior_front_seats-1774785420315.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2839%252F17662839%252Fexterior_front_passenger-1774271613294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_front_passenger-1774271613294.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1472%252F18171472%252Fexterior_front_passenger-1774686832485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_front_passenger-1774686832485.jpg not downloaded yet
2026-03-29 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0925/20490925/exterior_rear_driver-1774717492989.jpg> (referer: None)
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7943%252F17727943%252Finterior_dashboard-1774697716569.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7943/17727943/interior_dashboard-1774697716569.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9142%252F18969142%252F18969142-interior_dashboard-modified-1774696056664.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9142/18969142/18969142-interior_dashboard-modified-1774696056664.jpeg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4443%252F18354443%252Finterior_rear_seats-1774785438962.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4443/18354443/interior_rear_seats-1774785438962.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2839%252F17662839%252Fexterior_rear_passenger-1774271583673.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_rear_passenger-1774271583673.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1472%252F18171472%252Fexterior_rear_passenger-1774686803545.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_rear_passenger-1774686803545.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7943%252F17727943%252Finstrument_cluster-1774697632711.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7943/17727943/instrument_cluster-1774697632711.jpg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9142%252F18969142%252Finstrument_cluster-1774693290035.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9142/18969142/instrument_cluster-1774693290035.jpeg not downloaded yet
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4443%252F18354443%252Finterior_dashboard-1774786905315.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4443/18354443/interior_dashboard-1774786905315.jpg not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2839%252F17662839%252Finterior_front_seats-1774271932606.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2839/17662839/interior_front_seats-1774271932606.jpg not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1472%252F18171472%252Finterior_front_seats-1774687271963.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1472/18171472/interior_front_seats-1774687271963.jpg not downloaded yet
2026-03-29 20:07:01 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (15058731) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9142/18969142/interior_rear_seats-1774693187487.jpeg>.
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7943%252F17727943%252Finterior_boot-1774697648870.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7943/17727943/interior_boot-1774697648870.jpg not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9142%252F18969142%252Finterior_boot-1774693230577.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9142/18969142/interior_boot-1774693230577.jpeg not downloaded yet
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_rear_driver-1774696070222.jpg> (referer: None)
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4443%252F18354443%252Finterior_boot-1774785475074.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4443/18354443/interior_boot-1774785475074.jpg not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2839%252F17662839%252Finterior_rear_seats-1774271989352.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2839/17662839/interior_rear_seats-1774271989352.jpg not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1472%252F18171472%252Finterior_rear_seats-1774687364262.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1472/18171472/interior_rear_seats-1774687364262.jpg not downloaded yet
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d123c90>
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0925%252F20490925%252Fexterior_rear_driver-1774717492989.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0925/20490925/exterior_rear_driver-1774717492989.jpg saved to cache
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7943%252F17727943%252Fdocs_service_history-1774703352494-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9aaa840fd5dcc43f0fbfaa8b60e68c90%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7943/17727943/docs_service_history-1774703352494-1.jpeg?ixlib=js-3.8.0&auto=format&s=9aaa840fd5dcc43f0fbfaa8b60e68c90 not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9142%252F18969142%252Fdocs_service_history-1774694256456.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db6feae8c4805167d3bf9cc551112bbcb%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9142/18969142/docs_service_history-1774694256456.jpeg?ixlib=js-3.8.0&auto=format&s=b6feae8c4805167d3bf9cc551112bbcb not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4443%252F18354443%252Fdocs_service_history-1774785765857.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da21179129951e964d2ccca8d3db1f6f3%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4443/18354443/docs_service_history-1774785765857.jpg?ixlib=js-3.8.0&auto=format&s=a21179129951e964d2ccca8d3db1f6f3 not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2839%252F17662839%252F17662839-interior_dashboard-modified-1774625841171.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2839/17662839/17662839-interior_dashboard-modified-1774625841171.jpeg not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1472%252F18171472%252Finterior_dashboard-1774775810629.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1472/18171472/interior_dashboard-1774775810629.jpg not downloaded yet
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_front_passenger-1774696086212.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0925/20490925/exterior_front_passenger-1774717506875.jpg> (referer: None)
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4443%252F18354443%252Fdamage_missing_trims-1774786573436.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4443/18354443/damage_missing_trims-1774786573436.jpg not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2839%252F17662839%252F17662839-instrument_cluster-modified-1774625855321.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2839/17662839/17662839-instrument_cluster-modified-1774625855321.jpeg not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1472%252F18171472%252Finstrument_cluster-1774687402634.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1472/18171472/instrument_cluster-1774687402634.jpg not downloaded yet
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4b2890>
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5866%252F20485866%252Fexterior_rear_driver-1774696070222.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_rear_driver-1774696070222.jpg saved to cache
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1275d5fa-c434-584e-b0bb-e3c27b674a35
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2839%252F17662839%252Finterior_boot-1774272068510.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2839/17662839/interior_boot-1774272068510.jpg not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1472%252F18171472%252Finterior_boot-1774687362413.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1472/18171472/interior_boot-1774687362413.jpg not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2839%252F17662839%252F17662839-docs_service_history-modified-1757956823228.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3a3a87f539ba30a4177daca2cd2a24f4%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2839/17662839/17662839-docs_service_history-modified-1757956823228.jpeg?ixlib=js-3.8.0&auto=format&s=3a3a87f539ba30a4177daca2cd2a24f4 not downloaded yet
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1472%252F18171472%252Fdocs_service_history-1774687663063.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D691ef46cc0500b621b394fb0ab3ef099%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1472/18171472/docs_service_history-1774687663063.jpg?ixlib=js-3.8.0&auto=format&s=691ef46cc0500b621b394fb0ab3ef099 not downloaded yet
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4b09d0>
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5866%252F20485866%252Fexterior_front_passenger-1774696086212.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_front_passenger-1774696086212.jpg saved to cache
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1275d5fa-c434-584e-b0bb-e3c27b674a35
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cac67d0>
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0925%252F20490925%252Fexterior_front_passenger-1774717506875.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0925/20490925/exterior_front_passenger-1774717506875.jpg saved to cache
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0925/20490925/exterior_front_driver-1774713245993.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_front_driver-1774696061172.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0925/20490925/interior_rear_seats-1774713575642.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4443/18354443/exterior_front_driver-1774787484235.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2839/17662839/17662839-docs_service_history-modified-1757956823228.jpeg?ixlib=js-3.8.0&auto=format&s=3a3a87f539ba30a4177daca2cd2a24f4> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19824525.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dca6490>
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0925%252F20490925%252Fexterior_front_driver-1774713245993.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0925/20490925/exterior_front_driver-1774713245993.jpg saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dca4690>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5866%252F20485866%252Fexterior_front_driver-1774696061172.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_front_driver-1774696061172.jpg saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1275d5fa-c434-584e-b0bb-e3c27b674a35
2026-03-29 20:07:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1275d5fa-c434-584e-b0bb-e3c27b674a35, skipping ID generation
2026-03-29 20:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1275d5fa-c434-584e-b0bb-e3c27b674a35 with scrape type 1
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1275d5fa-c434-584e-b0bb-e3c27b674a35 sending to next pipeline
2026-03-29 20:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1275d5fa-c434-584e-b0bb-e3c27b674a35, identifier: 20485866
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f447b90>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0925%252F20490925%252Finterior_rear_seats-1774713575642.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0925/20490925/interior_rear_seats-1774713575642.jpg saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838
2026-03-29 20:07:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 841cfa0d-5f95-5dbb-b002-a8d69b53c838, skipping ID generation
2026-03-29 20:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838 with scrape type 1
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 841cfa0d-5f95-5dbb-b002-a8d69b53c838 sending to next pipeline
2026-03-29 20:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 841cfa0d-5f95-5dbb-b002-a8d69b53c838, identifier: 20490925
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f40b650>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4443%252F18354443%252Fexterior_front_driver-1774787484235.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4443/18354443/exterior_front_driver-1774787484235.jpg saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e02f710>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2839%252F17662839%252F17662839-docs_service_history-modified-1757956823228.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3a3a87f539ba30a4177daca2cd2a24f4') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2839/17662839/17662839-docs_service_history-modified-1757956823228.jpeg?ixlib=js-3.8.0&auto=format&s=3a3a87f539ba30a4177daca2cd2a24f4 saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df180df4-bcaf-55f4-b8c6-698f266f966a
2026-03-29 20:07:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4 with identifier: 19824525
2026-03-29 20:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4 with scrape type 1
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4525%252F19824525%252Fexterior_front_driver-1771841918533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_front_driver-1771841918533.jpg not downloaded yet
2026-03-29 20:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1275d5fa-c434-584e-b0bb-e3c27b674a35 with identifier: 20485866
2026-03-29 20:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1275d5fa-c434-584e-b0bb-e3c27b674a35 with identifier: 20485866
2026-03-29 20:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1275d5fa-c434-584e-b0bb-e3c27b674a35 with identifier: 20485866 to the API
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_front_driver-1774696061172.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '1275d5fa-c434-584e-b0bb-e3c27b674a35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'J3 RKC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20485866',
'listing': 'auction',
'location': 'Norfolk Dereham',
'make': 'Audi',
'model': 'Q3',
'odometer': 30800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2383479,
'Height': 2844,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_front_driver-1774696061172.jpg',
'Width': 3792},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1601269,
'Height': 2468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_rear_driver-1774696070222.jpg',
'Width': 3290},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1784813,
'Height': 2455,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_front_passenger-1774696086212.jpg',
'Width': 3273},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1887637,
'Height': 2646,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5866/20485866/exterior_rear_passenger-1774696079804.jpg',
'Width': 3528},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4495893,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5866/20485866/interior_front_seats-1774696346531.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4180610,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5866/20485866/interior_rear_seats-1774696402850.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2293296,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5866/20485866/interior_dashboard-1774698144493.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3581963,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5866/20485866/interior_boot-1774696376397.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539125,
'Height': 2532,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5866/20485866/docs_service_history-1774696672305.jpg?ixlib=js-3.8.0&auto=format&s=ff4d4fb18c684a244f599b53805744df',
'Width': 1170},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275d5fa-c434-584e-b0bb-e3c27b674a35/1275d5fa-c434-584e-b0bb-e3c27b674a35_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1526415,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5866/20485866/docs_service_history-1774696875150.jpg?ixlib=js-3.8.0&auto=format&s=bf4242cf2559714e788b2212fa4723b3',
'Width': 3024}],
'price': 27185,
'price_includes_vat': False,
'registration_date': '2023-03-16',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q3 S Line Black ED 35 TDI S-A',
'transmission': 'automatic',
'trim': 'S Line Black ED 35 TDI S-A',
'vin': 'WAUZZZF35P1082778',
'year': 2023}
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485866%27 HTTP/1.1" 200 None
2026-03-29 20:07:03 [motorway.uk] INFO: Saving data for 20485866: {'created_time': 1774814823.309601, 'last_price_update_time': 1774814823.309612, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20485866') HTTP/1.1" 204 0
2026-03-29 20:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 841cfa0d-5f95-5dbb-b002-a8d69b53c838 with identifier: 20490925
2026-03-29 20:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 841cfa0d-5f95-5dbb-b002-a8d69b53c838 with identifier: 20490925
2026-03-29 20:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 841cfa0d-5f95-5dbb-b002-a8d69b53c838 with identifier: 20490925 to the API
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0925/20490925/interior_rear_seats-1774713575642.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '841cfa0d-5f95-5dbb-b002-a8d69b53c838',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM66 DJZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20490925',
'listing': 'auction',
'location': 'Kent Gravesend',
'make': 'Jaguar',
'model': 'XJ Series',
'odometer': 58766,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2105491,
'Height': 2502,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0925/20490925/exterior_front_driver-1774713245993.jpg',
'Width': 3336},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2009575,
'Height': 2390,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0925/20490925/exterior_rear_driver-1774717492989.jpg',
'Width': 3187},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3063207,
'Height': 2722,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0925/20490925/exterior_front_passenger-1774717506875.jpg',
'Width': 3629},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2232933,
'Height': 2642,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0925/20490925/exterior_rear_passenger-1774717538143.jpg',
'Width': 3523},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3371258,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0925/20490925/interior_front_seats-1774713561921.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2782059,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0925/20490925/interior_rear_seats-1774713575642.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2506065,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0925/20490925/interior_dashboard-1774717578241.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2245286,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0925/20490925/instrument_cluster-1774713660235.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2990576,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0925/20490925/interior_boot-1774713610182.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_841cfa0d-5f95-5dbb-b002-a8d69b53c838/841cfa0d-5f95-5dbb-b002-a8d69b53c838_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3640053,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0925/20490925/damage_scratches-1774713327155.jpg',
'Width': 4032}],
'price': 12531,
'price_includes_vat': False,
'registration_date': '2016-12-14',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar XJ Portfolio V6 D Auto',
'transmission': 'automatic',
'trim': 'XJ Portfolio V6 D Auto',
'vin': 'SAJAC1699GNV95128',
'year': 2016}
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490925%27 HTTP/1.1" 200 None
2026-03-29 20:07:03 [motorway.uk] INFO: Saving data for 20490925: {'created_time': 1774814823.717759, 'last_price_update_time': 1774814823.717769, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20490925') HTTP/1.1" 204 0
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4525%252F19824525%252Fexterior_rear_driver-1771841976686.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_rear_driver-1771841976686.jpg not downloaded yet
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4525%252F19824525%252Fexterior_front_passenger-1771841932994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_front_passenger-1771841932994.jpg not downloaded yet
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4525%252F19824525%252Fexterior_rear_passenger-1771841948545.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_rear_passenger-1771841948545.jpg not downloaded yet
2026-03-29 20:07:03 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9142/18969142/interior_rear_seats-1774693187487.jpeg>.
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4525%252F19824525%252Finterior_front_seats-1771842023695.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4525/19824525/interior_front_seats-1771842023695.jpg not downloaded yet
2026-03-29 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1472/18171472/docs_service_history-1774687663063.jpg?ixlib=js-3.8.0&auto=format&s=691ef46cc0500b621b394fb0ab3ef099> (referer: None)
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4525%252F19824525%252F19824525-interior_dashboard-modified-1774703806795.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4525/19824525/19824525-interior_dashboard-modified-1774703806795.jpeg not downloaded yet
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4525%252F19824525%252Finterior_boot-1771842110340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4525/19824525/interior_boot-1771842110340.jpg not downloaded yet
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4525%252F19824525%252Fdocs_service_history-1774702656463.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc8f09474ac67186c5414a82275a00b85%27 HTTP/1.1" 200 None
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4525/19824525/docs_service_history-1774702656463.jpg?ixlib=js-3.8.0&auto=format&s=c8f09474ac67186c5414a82275a00b85 not downloaded yet
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4525%252F19824525%252Fdamage_scratches-1774702148056.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4525/19824525/damage_scratches-1774702148056.jpg not downloaded yet
2026-03-29 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20121550.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dca5a50>
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1472%252F18171472%252Fdocs_service_history-1774687663063.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D691ef46cc0500b621b394fb0ab3ef099') HTTP/1.1" 204 0
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1472/18171472/docs_service_history-1774687663063.jpg?ixlib=js-3.8.0&auto=format&s=691ef46cc0500b621b394fb0ab3ef099 saved to cache
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd2d0829-9904-5e2a-948d-d047f9a67dba
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4525%252F19824525%252Fdamage_scratches-1774702182022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4525/19824525/damage_scratches-1774702182022.jpg not downloaded yet
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_rear_driver-1771841976686.jpg> (referer: None)
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19713173.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11431082.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20428604.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20469058.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20422527.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20266056.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 009bec26-0ff3-5de8-8723-631486c40ab6 with identifier: 20121550
2026-03-29 20:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 009bec26-0ff3-5de8-8723-631486c40ab6 with scrape type 1
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 009bec26-0ff3-5de8-8723-631486c40ab6
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1550%252F20121550%252Fexterior_front_driver-1774693040425.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_front_driver-1774693040425.jpg not downloaded yet
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1472/18171472/interior_boot-1774687362413.jpg> (referer: None)
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2839/17662839/17662839-instrument_cluster-modified-1774625855321.jpeg> (referer: None)
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1550%252F20121550%252Fexterior_rear_driver-1774631522804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_rear_driver-1774631522804.jpg not downloaded yet
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_front_driver-1771841918533.jpg> (referer: None)
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1550%252F20121550%252Fexterior_front_passenger-1774631470294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_front_passenger-1774631470294.jpg not downloaded yet
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2839/17662839/interior_boot-1774272068510.jpg> (referer: None)
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_rear_passenger-1771841948545.jpg> (referer: None)
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1550%252F20121550%252Fexterior_rear_passenger-1774631516467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_rear_passenger-1774631516467.jpg not downloaded yet
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd15ed0>
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4525%252F19824525%252Fexterior_rear_driver-1771841976686.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_rear_driver-1771841976686.jpg saved to cache
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4443/18354443/damage_missing_trims-1774786573436.jpg> (referer: None)
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1550%252F20121550%252Finterior_front_seats-1774631547156.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1550/20121550/interior_front_seats-1774631547156.jpg not downloaded yet
2026-03-29 20:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389 with identifier: 19713173
2026-03-29 20:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389 with scrape type 1
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3173%252F19713173%252Fexterior_front_driver-1770655853175.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_front_driver-1770655853175.jpg not downloaded yet
2026-03-29 20:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acfa67ea-f820-5f0c-ac83-468e8f98d040 with identifier: 11431082
2026-03-29 20:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acfa67ea-f820-5f0c-ac83-468e8f98d040 with scrape type 1
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item acfa67ea-f820-5f0c-ac83-468e8f98d040
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1082%252F11431082%252Fexterior_front_driver-1774698256523.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_front_driver-1774698256523.jpeg not downloaded yet
2026-03-29 20:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2adf565-65cb-58bc-a40e-6be29dd6bc60 with identifier: 20428604
2026-03-29 20:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2adf565-65cb-58bc-a40e-6be29dd6bc60 with scrape type 1
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2adf565-65cb-58bc-a40e-6be29dd6bc60
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8604%252F20428604%252Fexterior_front_driver-1774775341288.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_front_driver-1774775341288.jpg not downloaded yet
2026-03-29 20:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ea8fb52-3813-5811-a6c0-5883af25aba0 with identifier: 20469058
2026-03-29 20:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ea8fb52-3813-5811-a6c0-5883af25aba0 with scrape type 1
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ea8fb52-3813-5811-a6c0-5883af25aba0
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9058%252F20469058%252Fexterior_front_driver-1774706530397.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9058/20469058/exterior_front_driver-1774706530397.jpg not downloaded yet
2026-03-29 20:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d190f5d-f4f1-5d34-b03a-85760f294b0a with identifier: 20422527
2026-03-29 20:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a with scrape type 1
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2527%252F20422527%252Fexterior_front_driver-1774375471959.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_front_driver-1774375471959.jpg not downloaded yet
2026-03-29 20:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4895c87-c5fc-532a-b503-769e2618c966 with identifier: 20266056
2026-03-29 20:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4895c87-c5fc-532a-b503-769e2618c966 with scrape type 1
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4895c87-c5fc-532a-b503-769e2618c966
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20266056%252Fexterior_front_driver-1773497545943.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_front_driver-1773497545943.jpg not downloaded yet
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1550%252F20121550%252Finterior_rear_seats-1774631538713.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1550/20121550/interior_rear_seats-1774631538713.jpg not downloaded yet
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3173%252F19713173%252Fexterior_rear_driver-1770655919068.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_rear_driver-1770655919068.jpg not downloaded yet
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1082%252F11431082%252Fexterior_rear_driver-1774698290662.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_rear_driver-1774698290662.jpeg not downloaded yet
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8604%252F20428604%252Fexterior_rear_driver-1774775430092.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_rear_driver-1774775430092.jpg not downloaded yet
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9058%252F20469058%252Fexterior_rear_driver-1774706567649.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9058/20469058/exterior_rear_driver-1774706567649.jpg not downloaded yet
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2527%252F20422527%252Fexterior_rear_driver-1774375483883.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_rear_driver-1774375483883.jpg not downloaded yet
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20266056%252Fexterior_rear_driver-1773497559775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_rear_driver-1773497559775.jpg not downloaded yet
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1550%252F20121550%252Finterior_dashboard-1774631596252.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1550/20121550/interior_dashboard-1774631596252.jpg not downloaded yet
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4ca590>
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1472%252F18171472%252Finterior_boot-1774687362413.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1472/18171472/interior_boot-1774687362413.jpg saved to cache
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd2d0829-9904-5e2a-948d-d047f9a67dba
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cac4390>
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2839%252F17662839%252F17662839-instrument_cluster-modified-1774625855321.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2839/17662839/17662839-instrument_cluster-modified-1774625855321.jpeg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df180df4-bcaf-55f4-b8c6-698f266f966a
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c54c050>
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4525%252F19824525%252Fexterior_front_driver-1771841918533.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_front_driver-1771841918533.jpg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daf9190>
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2839%252F17662839%252Finterior_boot-1774272068510.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2839/17662839/interior_boot-1774272068510.jpg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df180df4-bcaf-55f4-b8c6-698f266f966a
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c551fd0>
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4525%252F19824525%252Fexterior_rear_passenger-1771841948545.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_rear_passenger-1771841948545.jpg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cbb1a90>
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4443%252F18354443%252Fdamage_missing_trims-1774786573436.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4443/18354443/damage_missing_trims-1774786573436.jpg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3173%252F19713173%252Fexterior_front_passenger-1770655898788.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_front_passenger-1770655898788.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1082%252F11431082%252Fexterior_front_passenger-1774698510448.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_front_passenger-1774698510448.jpeg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8604%252F20428604%252Fexterior_front_passenger-1774775458643.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_front_passenger-1774775458643.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9058%252F20469058%252Fexterior_front_passenger-1774708390294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9058/20469058/exterior_front_passenger-1774708390294.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2527%252F20422527%252Fexterior_front_passenger-1774375508190.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_front_passenger-1774375508190.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20266056%252Fexterior_front_passenger-1773497591494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_front_passenger-1773497591494.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1550%252F20121550%252Finterior_boot-1774631532483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1550/20121550/interior_boot-1774631532483.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3173%252F19713173%252Fexterior_rear_passenger-1770655807900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_rear_passenger-1770655807900.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1082%252F11431082%252Fexterior_rear_passenger-1774698216972.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_rear_passenger-1774698216972.jpeg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8604%252F20428604%252Fexterior_rear_passenger-1774775411263.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_rear_passenger-1774775411263.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9058%252F20469058%252Fexterior_rear_passenger-1774708404588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9058/20469058/exterior_rear_passenger-1774708404588.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2527%252F20422527%252Fexterior_rear_passenger-1774375495495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_rear_passenger-1774375495495.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20266056%252Fexterior_rear_passenger-1773497576608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_rear_passenger-1773497576608.jpg not downloaded yet
2026-03-29 20:07:05 [scrapy.extensions.logstats] INFO: Crawled 95 pages (at 50 pages/min), scraped 41 items (at 25 items/min)
2026-03-29 20:07:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 282MiB
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1550%252F20121550%252Fdocs_service_history-1774631740503.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df2d7fa4f575d38f04b59d5caa263d6a4%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1550/20121550/docs_service_history-1774631740503.jpg?ixlib=js-3.8.0&auto=format&s=f2d7fa4f575d38f04b59d5caa263d6a4 not downloaded yet
2026-03-29 20:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1472/18171472/instrument_cluster-1774687402634.jpg> (referer: None)
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3173%252F19713173%252Finterior_front_seats-1770656252285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3173/19713173/interior_front_seats-1770656252285.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1082%252F11431082%252Finterior_front_seats-1774698548610.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1082/11431082/interior_front_seats-1774698548610.jpeg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8604%252F20428604%252Finterior_front_seats-1774775863373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8604/20428604/interior_front_seats-1774775863373.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9058%252F20469058%252Finterior_front_seats-1774707005250.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9058/20469058/interior_front_seats-1774707005250.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2527%252F20422527%252Finterior_front_seats-1774636117803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2527/20422527/interior_front_seats-1774636117803.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6056%252F20266056%252Finterior_front_seats-1773498036005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6056/20266056/interior_front_seats-1773498036005.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1550%252F20121550%252Fdamage_missing_trims-1774631835531.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1550/20121550/damage_missing_trims-1774631835531.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3173%252F19713173%252Finterior_rear_seats-1770656014449.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3173/19713173/interior_rear_seats-1770656014449.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1082%252F11431082%252Finterior_rear_seats-1774698559992.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1082/11431082/interior_rear_seats-1774698559992.jpeg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8604%252F20428604%252Finterior_dashboard-1774775972194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8604/20428604/interior_dashboard-1774775972194.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9058%252F20469058%252Finterior_rear_seats-1774707093474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9058/20469058/interior_rear_seats-1774707093474.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2527%252F20422527%252Finterior_rear_seats-1774635940993.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2527/20422527/interior_rear_seats-1774635940993.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6056%252F20266056%252Finterior_rear_seats-1773498049521.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6056/20266056/interior_rear_seats-1773498049521.jpg not downloaded yet
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c641590>
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1472%252F18171472%252Finstrument_cluster-1774687402634.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1472/18171472/instrument_cluster-1774687402634.jpg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd2d0829-9904-5e2a-948d-d047f9a67dba
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3173%252F19713173%252Finterior_dashboard-1770718084624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3173/19713173/interior_dashboard-1770718084624.jpg not downloaded yet
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1082%252F11431082%252F11431082-interior_dashboard-modified-1774699998593.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1082/11431082/11431082-interior_dashboard-modified-1774699998593.jpeg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8604%252F20428604%252Finterior_boot-1774775911938.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8604/20428604/interior_boot-1774775911938.jpg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9058%252F20469058%252Finterior_dashboard-1774707881230.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9058/20469058/interior_dashboard-1774707881230.jpg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2527%252F20422527%252Finterior_dashboard-1774690566399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2527/20422527/interior_dashboard-1774690566399.jpg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6056%252F20266056%252Finterior_dashboard-1774775265172.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6056/20266056/interior_dashboard-1774775265172.jpg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3173%252F19713173%252Finstrument_cluster-1770717800883.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3173/19713173/instrument_cluster-1770717800883.jpg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1082%252F11431082%252Finstrument_cluster-1774698677943.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1082/11431082/instrument_cluster-1774698677943.jpeg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8604%252F20428604%252Fdocs_service_history-1774778213553.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dca042f9b7bc068fe967d4892c1082c10%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8604/20428604/docs_service_history-1774778213553.jpg?ixlib=js-3.8.0&auto=format&s=ca042f9b7bc068fe967d4892c1082c10 not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9058%252F20469058%252Finstrument_cluster-1774707091155.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9058/20469058/instrument_cluster-1774707091155.jpg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2527%252F20422527%252Finstrument_cluster-1774636040616.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2527/20422527/instrument_cluster-1774636040616.jpg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6056%252F20266056%252Finstrument_cluster-1774775127905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6056/20266056/instrument_cluster-1774775127905.jpg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3173%252F19713173%252Finterior_boot-1770655193166.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3173/19713173/interior_boot-1770655193166.jpg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1082%252F11431082%252Finterior_boot-1774698473120.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1082/11431082/interior_boot-1774698473120.jpeg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8604%252F20428604%252Fdamage_scratches-1774775535934.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8604/20428604/damage_scratches-1774775535934.jpg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9058%252F20469058%252Finterior_boot-1774707068005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9058/20469058/interior_boot-1774707068005.jpg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2527%252F20422527%252Finterior_boot-1774690579041.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2527/20422527/interior_boot-1774690579041.jpg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6056%252F20266056%252Finterior_boot-1773498082787.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6056/20266056/interior_boot-1773498082787.jpg not downloaded yet
2026-03-29 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_front_passenger-1771841932994.jpg> (referer: None)
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F3173%252F19713173%252Fdocs_service_history-1770659530808.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dad1fce93a24531539ac6155ed53921f1%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/3173/19713173/docs_service_history-1770659530808.jpg?ixlib=js-3.8.0&auto=format&s=ad1fce93a24531539ac6155ed53921f1 not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1082%252F11431082%252Fdocs_service_history-1774698656856.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc1243619d87fbebe08580d9e6b6b456c%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1082/11431082/docs_service_history-1774698656856.jpeg?ixlib=js-3.8.0&auto=format&s=c1243619d87fbebe08580d9e6b6b456c not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8604%252F20428604%252Fdamage_paintwork-1774775580011.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8604/20428604/damage_paintwork-1774775580011.jpg not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9058%252F20469058%252Fdocs_service_history-1774707247270.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4f3b5bd5af4dc25e0c3f9ad54ee98c08%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9058/20469058/docs_service_history-1774707247270.jpg?ixlib=js-3.8.0&auto=format&s=4f3b5bd5af4dc25e0c3f9ad54ee98c08 not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2527%252F20422527%252Fdocs_service_history-1774690294799.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9d2d90762dccce224922e79080b7c702%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2527/20422527/docs_service_history-1774690294799.jpg?ixlib=js-3.8.0&auto=format&s=9d2d90762dccce224922e79080b7c702 not downloaded yet
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6056%252F20266056%252Fdocs_service_history-1773498185258.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db69a70db92884136dd893bd7638402a6%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6056/20266056/docs_service_history-1773498185258.jpg?ixlib=js-3.8.0&auto=format&s=b69a70db92884136dd893bd7638402a6 not downloaded yet
2026-03-29 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4525/19824525/damage_scratches-1774702148056.jpg> (referer: None)
2026-03-29 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4525/19824525/damage_scratches-1774702182022.jpg> (referer: None)
2026-03-29 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4525/19824525/docs_service_history-1774702656463.jpg?ixlib=js-3.8.0&auto=format&s=c8f09474ac67186c5414a82275a00b85> (referer: None)
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c633c90>
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4525%252F19824525%252Fexterior_front_passenger-1771841932994.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_front_passenger-1771841932994.jpg saved to cache
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4
2026-03-29 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1472/18171472/interior_dashboard-1774775810629.jpg> (referer: None)
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4dbe90>
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4525%252F19824525%252Fdamage_scratches-1774702148056.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4525/19824525/damage_scratches-1774702148056.jpg saved to cache
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7603d0>
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4525%252F19824525%252Fdamage_scratches-1774702182022.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4525/19824525/damage_scratches-1774702182022.jpg saved to cache
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ded9290>
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4525%252F19824525%252Fdocs_service_history-1774702656463.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc8f09474ac67186c5414a82275a00b85') HTTP/1.1" 204 0
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4525/19824525/docs_service_history-1774702656463.jpg?ixlib=js-3.8.0&auto=format&s=c8f09474ac67186c5414a82275a00b85 saved to cache
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4
2026-03-29 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4525/19824525/interior_boot-1771842110340.jpg> (referer: None)
2026-03-29 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4525/19824525/interior_front_seats-1771842023695.jpg> (referer: None)
2026-03-29 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_front_passenger-1774698510448.jpeg> (referer: None)
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4e3fd0>
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1472%252F18171472%252Finterior_dashboard-1774775810629.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1472/18171472/interior_dashboard-1774775810629.jpg saved to cache
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd2d0829-9904-5e2a-948d-d047f9a67dba
2026-03-29 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_front_passenger-1770655898788.jpg> (referer: None)
2026-03-29 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_rear_passenger-1773497576608.jpg> (referer: None)
2026-03-29 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_front_passenger-1774375508190.jpg> (referer: None)
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd0b110>
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4525%252F19824525%252Finterior_boot-1771842110340.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4525/19824525/interior_boot-1771842110340.jpg saved to cache
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4
2026-03-29 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4525/19824525/19824525-interior_dashboard-modified-1774703806795.jpeg> (referer: None)
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5f7610>
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4525%252F19824525%252Finterior_front_seats-1771842023695.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4525/19824525/interior_front_seats-1771842023695.jpg saved to cache
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4
2026-03-29 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_front_passenger-1773497591494.jpg> (referer: None)
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d97da10>
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1082%252F11431082%252Fexterior_front_passenger-1774698510448.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_front_passenger-1774698510448.jpeg saved to cache
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acfa67ea-f820-5f0c-ac83-468e8f98d040
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd09690>
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3173%252F19713173%252Fexterior_front_passenger-1770655898788.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_front_passenger-1770655898788.jpg saved to cache
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0c0290>
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20266056%252Fexterior_rear_passenger-1773497576608.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_rear_passenger-1773497576608.jpg saved to cache
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4895c87-c5fc-532a-b503-769e2618c966
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2d71d0>
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2527%252F20422527%252Fexterior_front_passenger-1774375508190.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_front_passenger-1774375508190.jpg saved to cache
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4c71d0>
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4525%252F19824525%252F19824525-interior_dashboard-modified-1774703806795.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4525/19824525/19824525-interior_dashboard-modified-1774703806795.jpeg saved to cache
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4
2026-03-29 20:07:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4, skipping ID generation
2026-03-29 20:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4 with scrape type 1
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4 sending to next pipeline
2026-03-29 20:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4, identifier: 19824525
2026-03-29 20:07:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4 with identifier: 19824525
2026-03-29 20:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4 with identifier: 19824525
2026-03-29 20:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4 with identifier: 19824525 to the API
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/4525/19824525/19824525-interior_dashboard-modified-1774703806795.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LB70 OUF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19824525',
'listing': 'auction',
'location': 'Kent Folkestone',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 44000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 864775,
'Height': 1878,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_front_driver-1771841918533.jpg',
'Width': 2504},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550311,
'Height': 1527,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_rear_driver-1771841976686.jpg',
'Width': 2036},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1305317,
'Height': 2343,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_front_passenger-1771841932994.jpg',
'Width': 3124},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655327,
'Height': 1638,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4525/19824525/exterior_rear_passenger-1771841948545.jpg',
'Width': 2184},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2102946,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4525/19824525/interior_front_seats-1771842023695.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2528790,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4525/19824525/19824525-interior_dashboard-modified-1774703806795.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2001566,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4525/19824525/interior_boot-1771842110340.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1392951,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4525/19824525/docs_service_history-1774702656463.jpg?ixlib=js-3.8.0&auto=format&s=c8f09474ac67186c5414a82275a00b85',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1460309,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4525/19824525/damage_scratches-1774702148056.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4/8c6ad9cd-9ffd-55ca-9e43-40a681caf4e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1457684,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4525/19824525/damage_scratches-1774702182022.jpg',
'Width': 4080}],
'price': 8148,
'price_includes_vat': False,
'registration_date': '2020-11-30',
'seats_number': None,
'seller_name': None,
'title': 'Citroen Berlingo 650 EN-PRISE Bhdi SS',
'transmission': 'manual',
'trim': '650 EN-PRISE Bhdi SS',
'vin': 'VR7EFYHWCLJ945395',
'year': 2020}
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719824525%27 HTTP/1.1" 200 None
2026-03-29 20:07:08 [motorway.uk] INFO: Saving data for 19824525: {'created_time': 1774814828.473586, 'last_price_update_time': 1774814828.473596, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19824525') HTTP/1.1" 204 0
2026-03-29 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_front_passenger-1774775458643.jpg> (referer: None)
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc2ee90>
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20266056%252Fexterior_front_passenger-1773497591494.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_front_passenger-1773497591494.jpg saved to cache
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4895c87-c5fc-532a-b503-769e2618c966
2026-03-29 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9142/18969142/interior_rear_seats-1774693187487.jpeg> (referer: None)
2026-03-29 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9058/20469058/exterior_front_passenger-1774708390294.jpg> (referer: None)
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d23ba90>
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8604%252F20428604%252Fexterior_front_passenger-1774775458643.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_front_passenger-1774775458643.jpg saved to cache
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2adf565-65cb-58bc-a40e-6be29dd6bc60
2026-03-29 20:07:08 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:08 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:08 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xdb[$\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\nl\x07\x00\xdbP\xa8\x00\x00\x00\x00'
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d66c550>
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9142%252F18969142%252Finterior_rear_seats-1774693187487.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9142/18969142/interior_rear_seats-1774693187487.jpeg saved to cache
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e218a88-3582-5e14-a8fe-95834c36b091
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2fab10>
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9058%252F20469058%252Fexterior_front_passenger-1774708390294.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9058/20469058/exterior_front_passenger-1774708390294.jpg saved to cache
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ea8fb52-3813-5811-a6c0-5883af25aba0
2026-03-29 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2527/20422527/docs_service_history-1774690294799.jpg?ixlib=js-3.8.0&auto=format&s=9d2d90762dccce224922e79080b7c702> (referer: None)
2026-03-29 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6056/20266056/docs_service_history-1773498185258.jpg?ixlib=js-3.8.0&auto=format&s=b69a70db92884136dd893bd7638402a6> (referer: None)
2026-03-29 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1082/11431082/docs_service_history-1774698656856.jpeg?ixlib=js-3.8.0&auto=format&s=c1243619d87fbebe08580d9e6b6b456c> (referer: None)
2026-03-29 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6056/20266056/instrument_cluster-1774775127905.jpg> (referer: None)
2026-03-29 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2527/20422527/interior_boot-1774690579041.jpg> (referer: None)
2026-03-29 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9058/20469058/docs_service_history-1774707247270.jpg?ixlib=js-3.8.0&auto=format&s=4f3b5bd5af4dc25e0c3f9ad54ee98c08> (referer: None)
2026-03-29 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2527/20422527/instrument_cluster-1774636040616.jpg> (referer: None)
2026-03-29 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9058/20469058/interior_boot-1774707068005.jpg> (referer: None)
2026-03-29 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1082/11431082/interior_boot-1774698473120.jpeg> (referer: None)
2026-03-29 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8604/20428604/damage_scratches-1774775535934.jpg> (referer: None)
2026-03-29 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6056/20266056/interior_boot-1773498082787.jpg> (referer: None)
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2281d0>
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2527%252F20422527%252Fdocs_service_history-1774690294799.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9d2d90762dccce224922e79080b7c702') HTTP/1.1" 204 0
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2527/20422527/docs_service_history-1774690294799.jpg?ixlib=js-3.8.0&auto=format&s=9d2d90762dccce224922e79080b7c702 saved to cache
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da4c690>
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6056%252F20266056%252Fdocs_service_history-1773498185258.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db69a70db92884136dd893bd7638402a6') HTTP/1.1" 204 0
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6056/20266056/docs_service_history-1773498185258.jpg?ixlib=js-3.8.0&auto=format&s=b69a70db92884136dd893bd7638402a6 saved to cache
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4895c87-c5fc-532a-b503-769e2618c966
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1e4a90>
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1082%252F11431082%252Fdocs_service_history-1774698656856.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc1243619d87fbebe08580d9e6b6b456c') HTTP/1.1" 204 0
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1082/11431082/docs_service_history-1774698656856.jpeg?ixlib=js-3.8.0&auto=format&s=c1243619d87fbebe08580d9e6b6b456c saved to cache
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item acfa67ea-f820-5f0c-ac83-468e8f98d040
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd41c50>
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6056%252F20266056%252Finstrument_cluster-1774775127905.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6056/20266056/instrument_cluster-1774775127905.jpg saved to cache
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4895c87-c5fc-532a-b503-769e2618c966
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7bf950>
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2527%252F20422527%252Finterior_boot-1774690579041.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2527/20422527/interior_boot-1774690579041.jpg saved to cache
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a
2026-03-29 20:07:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f65fb90>
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9058%252F20469058%252Fdocs_service_history-1774707247270.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4f3b5bd5af4dc25e0c3f9ad54ee98c08') HTTP/1.1" 204 0
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9058/20469058/docs_service_history-1774707247270.jpg?ixlib=js-3.8.0&auto=format&s=4f3b5bd5af4dc25e0c3f9ad54ee98c08 saved to cache
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ea8fb52-3813-5811-a6c0-5883af25aba0
2026-03-29 20:07:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:07:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd403d0>
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2527%252F20422527%252Finstrument_cluster-1774636040616.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2527/20422527/instrument_cluster-1774636040616.jpg saved to cache
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc91a10>
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9058%252F20469058%252Finterior_boot-1774707068005.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9058/20469058/interior_boot-1774707068005.jpg saved to cache
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ea8fb52-3813-5811-a6c0-5883af25aba0
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00:\xc7\xfa\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xefJ\x00:\xbd\xe8\x00\x00\x00\x00'
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d58ccd0>
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1082%252F11431082%252Finterior_boot-1774698473120.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1082/11431082/interior_boot-1774698473120.jpeg saved to cache
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acfa67ea-f820-5f0c-ac83-468e8f98d040
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f65f5d0>
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8604%252F20428604%252Fdamage_scratches-1774775535934.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8604/20428604/damage_scratches-1774775535934.jpg saved to cache
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2adf565-65cb-58bc-a40e-6be29dd6bc60
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f62da90>
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6056%252F20266056%252Finterior_boot-1773498082787.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6056/20266056/interior_boot-1773498082787.jpg saved to cache
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4895c87-c5fc-532a-b503-769e2618c966
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/3173/19713173/docs_service_history-1770659530808.jpg?ixlib=js-3.8.0&auto=format&s=ad1fce93a24531539ac6155ed53921f1> (referer: None)
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3173/19713173/instrument_cluster-1770717800883.jpg> (referer: None)
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8604/20428604/docs_service_history-1774778213553.jpg?ixlib=js-3.8.0&auto=format&s=ca042f9b7bc068fe967d4892c1082c10> (referer: None)
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6056/20266056/interior_dashboard-1774775265172.jpg> (referer: None)
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9058/20469058/interior_dashboard-1774707881230.jpg> (referer: None)
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2527/20422527/interior_dashboard-1774690566399.jpg> (referer: None)
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1082/11431082/instrument_cluster-1774698677943.jpeg> (referer: None)
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8604/20428604/damage_paintwork-1774775580011.jpg> (referer: None)
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9058/20469058/instrument_cluster-1774707091155.jpg> (referer: None)
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3173/19713173/interior_boot-1770655193166.jpg> (referer: None)
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a1350>
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F3173%252F19713173%252Fdocs_service_history-1770659530808.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dad1fce93a24531539ac6155ed53921f1') HTTP/1.1" 204 0
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/3173/19713173/docs_service_history-1770659530808.jpg?ixlib=js-3.8.0&auto=format&s=ad1fce93a24531539ac6155ed53921f1 saved to cache
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc896d0>
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3173%252F19713173%252Finstrument_cluster-1770717800883.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3173/19713173/instrument_cluster-1770717800883.jpg saved to cache
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce74d50>
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8604%252F20428604%252Fdocs_service_history-1774778213553.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dca042f9b7bc068fe967d4892c1082c10') HTTP/1.1" 204 0
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8604/20428604/docs_service_history-1774778213553.jpg?ixlib=js-3.8.0&auto=format&s=ca042f9b7bc068fe967d4892c1082c10 saved to cache
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2adf565-65cb-58bc-a40e-6be29dd6bc60
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d154d90>
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6056%252F20266056%252Finterior_dashboard-1774775265172.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6056/20266056/interior_dashboard-1774775265172.jpg saved to cache
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4895c87-c5fc-532a-b503-769e2618c966
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f427d50>
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9058%252F20469058%252Finterior_dashboard-1774707881230.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9058/20469058/interior_dashboard-1774707881230.jpg saved to cache
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ea8fb52-3813-5811-a6c0-5883af25aba0
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc70250>
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2527%252F20422527%252Finterior_dashboard-1774690566399.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2527/20422527/interior_dashboard-1774690566399.jpg saved to cache
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00#\xf7\xa6\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xd2\x14\x00#\xed\x94\x00\x00\x00\x00'
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8d5a50>
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1082%252F11431082%252Finstrument_cluster-1774698677943.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1082/11431082/instrument_cluster-1774698677943.jpeg saved to cache
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acfa67ea-f820-5f0c-ac83-468e8f98d040
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb8f4d0>
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8604%252F20428604%252Fdamage_paintwork-1774775580011.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8604/20428604/damage_paintwork-1774775580011.jpg saved to cache
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2adf565-65cb-58bc-a40e-6be29dd6bc60
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8d6210>
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9058%252F20469058%252Finstrument_cluster-1774707091155.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9058/20469058/instrument_cluster-1774707091155.jpg saved to cache
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ea8fb52-3813-5811-a6c0-5883af25aba0
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S918B\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S918BXXS8DYI3\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:02:09 16:39:47\x00'
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8d5290>
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3173%252F19713173%252Finterior_boot-1770655193166.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3173/19713173/interior_boot-1770655193166.jpg saved to cache
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3173/19713173/interior_dashboard-1770718084624.jpg> (referer: None)
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2527/20422527/interior_rear_seats-1774635940993.jpg> (referer: None)
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1082/11431082/11431082-interior_dashboard-modified-1774699998593.jpeg> (referer: None)
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1550/20121550/damage_missing_trims-1774631835531.jpg> (referer: None)
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9058/20469058/interior_rear_seats-1774707093474.jpg> (referer: None)
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6056/20266056/interior_rear_seats-1773498049521.jpg> (referer: None)
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8604/20428604/interior_boot-1774775911938.jpg> (referer: None)
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1082/11431082/interior_rear_seats-1774698559992.jpeg> (referer: None)
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8604/20428604/interior_dashboard-1774775972194.jpg> (referer: None)
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3173/19713173/interior_rear_seats-1770656014449.jpg> (referer: None)
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8d72d0>
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3173%252F19713173%252Finterior_dashboard-1770718084624.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3173/19713173/interior_dashboard-1770718084624.jpg saved to cache
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3eb990>
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2527%252F20422527%252Finterior_rear_seats-1774635940993.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2527/20422527/interior_rear_seats-1774635940993.jpg saved to cache
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2f6350>
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1082%252F11431082%252F11431082-interior_dashboard-modified-1774699998593.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1082/11431082/11431082-interior_dashboard-modified-1774699998593.jpeg saved to cache
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acfa67ea-f820-5f0c-ac83-468e8f98d040
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x00\x0c'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 182 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x03\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 214 - value: b'2026:03:27 15:13:12\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\xd6\x0b\x00\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 234 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 242 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x00\x10'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 250 - value: b'motorola edge 60 pro\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 282 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 142 - Data Location: 314 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x01\x00\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b"\x00\x03\x00\x00\x00'\x98\xb2\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xc3z\x00'\x92\x82\x00\x00\x00\x00"
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d58f490>
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1550%252F20121550%252Fdamage_missing_trims-1774631835531.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1550/20121550/damage_missing_trims-1774631835531.jpg saved to cache
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 009bec26-0ff3-5de8-8723-631486c40ab6
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc62990>
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9058%252F20469058%252Finterior_rear_seats-1774707093474.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9058/20469058/interior_rear_seats-1774707093474.jpg saved to cache
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ea8fb52-3813-5811-a6c0-5883af25aba0
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d58f7d0>
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6056%252F20266056%252Finterior_rear_seats-1773498049521.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6056/20266056/interior_rear_seats-1773498049521.jpg saved to cache
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4895c87-c5fc-532a-b503-769e2618c966
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0ece10>
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8604%252F20428604%252Finterior_boot-1774775911938.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8604/20428604/interior_boot-1774775911938.jpg saved to cache
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2adf565-65cb-58bc-a40e-6be29dd6bc60
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x006g]\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02Hy\x006]K\x00\x00\x00\x00'
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da4fe90>
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1082%252F11431082%252Finterior_rear_seats-1774698559992.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1082/11431082/interior_rear_seats-1774698559992.jpeg saved to cache
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acfa67ea-f820-5f0c-ac83-468e8f98d040
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da4f290>
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8604%252F20428604%252Finterior_dashboard-1774775972194.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8604/20428604/interior_dashboard-1774775972194.jpg saved to cache
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2adf565-65cb-58bc-a40e-6be29dd6bc60
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S918B\x00'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S918BXXS8DYI3\x00'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:02:09 16:53:29\x00'
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc91e10>
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3173%252F19713173%252Finterior_rear_seats-1770656014449.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3173/19713173/interior_rear_seats-1770656014449.jpg saved to cache
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_rear_passenger-1774375495495.jpg> (referer: None)
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1550/20121550/docs_service_history-1774631740503.jpg?ixlib=js-3.8.0&auto=format&s=f2d7fa4f575d38f04b59d5caa263d6a4> (referer: None)
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2527/20422527/interior_front_seats-1774636117803.jpg> (referer: None)
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6056/20266056/interior_front_seats-1773498036005.jpg> (referer: None)
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1082/11431082/interior_front_seats-1774698548610.jpeg> (referer: None)
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9058/20469058/interior_front_seats-1774707005250.jpg> (referer: None)
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8604/20428604/interior_front_seats-1774775863373.jpg> (referer: None)
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3173/19713173/interior_front_seats-1770656252285.jpg> (referer: None)
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d228710>
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2527%252F20422527%252Fexterior_rear_passenger-1774375495495.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_rear_passenger-1774375495495.jpg saved to cache
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd54290>
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1550%252F20121550%252Fdocs_service_history-1774631740503.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df2d7fa4f575d38f04b59d5caa263d6a4') HTTP/1.1" 204 0
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1550/20121550/docs_service_history-1774631740503.jpg?ixlib=js-3.8.0&auto=format&s=f2d7fa4f575d38f04b59d5caa263d6a4 saved to cache
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 009bec26-0ff3-5de8-8723-631486c40ab6
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d13ed50>
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2527%252F20422527%252Finterior_front_seats-1774636117803.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2527/20422527/interior_front_seats-1774636117803.jpg saved to cache
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d06b550>
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6056%252F20266056%252Finterior_front_seats-1773498036005.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6056/20266056/interior_front_seats-1773498036005.jpg saved to cache
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4895c87-c5fc-532a-b503-769e2618c966
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b"\x00\x03\x00\x00\x00:\xff9\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02O*\x00:\xf5'\x00\x00\x00\x00"
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c632150>
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1082%252F11431082%252Finterior_front_seats-1774698548610.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1082/11431082/interior_front_seats-1774698548610.jpeg saved to cache
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acfa67ea-f820-5f0c-ac83-468e8f98d040
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dabe850>
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9058%252F20469058%252Finterior_front_seats-1774707005250.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9058/20469058/interior_front_seats-1774707005250.jpg saved to cache
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ea8fb52-3813-5811-a6c0-5883af25aba0
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d22a390>
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8604%252F20428604%252Finterior_front_seats-1774775863373.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8604/20428604/interior_front_seats-1774775863373.jpg saved to cache
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2adf565-65cb-58bc-a40e-6be29dd6bc60
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S918B\x00'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S918BXXS8DYI3\x00'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:14 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:02:09 16:57:12\x00'
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dce7c50>
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3173%252F19713173%252Finterior_front_seats-1770656252285.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3173/19713173/interior_front_seats-1770656252285.jpg saved to cache
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_rear_passenger-1770655807900.jpg> (referer: None)
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_rear_passenger-1774698216972.jpeg> (referer: None)
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_rear_driver-1773497559775.jpg> (referer: None)
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_rear_driver-1774375483883.jpg> (referer: None)
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_rear_passenger-1774775411263.jpg> (referer: None)
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1550/20121550/interior_dashboard-1774631596252.jpg> (referer: None)
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9058/20469058/exterior_rear_driver-1774706567649.jpg> (referer: None)
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_rear_driver-1774775430092.jpg> (referer: None)
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9058/20469058/exterior_rear_passenger-1774708404588.jpg> (referer: None)
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1550/20121550/interior_boot-1774631532483.jpg> (referer: None)
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4260d0>
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3173%252F19713173%252Fexterior_rear_passenger-1770655807900.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_rear_passenger-1770655807900.jpg saved to cache
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc37090>
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1082%252F11431082%252Fexterior_rear_passenger-1774698216972.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_rear_passenger-1774698216972.jpeg saved to cache
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acfa67ea-f820-5f0c-ac83-468e8f98d040
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4ef490>
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20266056%252Fexterior_rear_driver-1773497559775.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_rear_driver-1773497559775.jpg saved to cache
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4895c87-c5fc-532a-b503-769e2618c966
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4dbd50>
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2527%252F20422527%252Fexterior_rear_driver-1774375483883.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_rear_driver-1774375483883.jpg saved to cache
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4ee4d0>
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8604%252F20428604%252Fexterior_rear_passenger-1774775411263.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_rear_passenger-1774775411263.jpg saved to cache
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2adf565-65cb-58bc-a40e-6be29dd6bc60
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d55c810>
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1550%252F20121550%252Finterior_dashboard-1774631596252.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1550/20121550/interior_dashboard-1774631596252.jpg saved to cache
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 009bec26-0ff3-5de8-8723-631486c40ab6
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e16c310>
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9058%252F20469058%252Fexterior_rear_driver-1774706567649.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9058/20469058/exterior_rear_driver-1774706567649.jpg saved to cache
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ea8fb52-3813-5811-a6c0-5883af25aba0
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e13d4d0>
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8604%252F20428604%252Fexterior_rear_driver-1774775430092.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_rear_driver-1774775430092.jpg saved to cache
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2adf565-65cb-58bc-a40e-6be29dd6bc60
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4ef5d0>
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9058%252F20469058%252Fexterior_rear_passenger-1774708404588.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9058/20469058/exterior_rear_passenger-1774708404588.jpg saved to cache
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ea8fb52-3813-5811-a6c0-5883af25aba0
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x00\x0c'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 182 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x03\x00'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 214 - value: b'2026:03:27 15:09:06\x00'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\xda\x0b\x00\x00'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 234 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 242 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x00\x10'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 250 - value: b'motorola edge 60 pro\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 282 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 142 - Data Location: 314 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x01\x00\x00'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00E\x02\x83\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01p\xf2\x00D\xfcS\x00\x00\x00\x00'
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4edbd0>
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1550%252F20121550%252Finterior_boot-1774631532483.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1550/20121550/interior_boot-1774631532483.jpg saved to cache
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 009bec26-0ff3-5de8-8723-631486c40ab6
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_front_driver-1770655853175.jpg> (referer: None)
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_rear_driver-1774698290662.jpeg> (referer: None)
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_rear_driver-1770655919068.jpg> (referer: None)
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_front_driver-1774698256523.jpeg> (referer: None)
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_front_driver-1773497545943.jpg> (referer: None)
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_front_driver-1774775341288.jpg> (referer: None)
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_front_driver-1774375471959.jpg> (referer: None)
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9058/20469058/exterior_front_driver-1774706530397.jpg> (referer: None)
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1550/20121550/interior_rear_seats-1774631538713.jpg> (referer: None)
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1550/20121550/interior_front_seats-1774631547156.jpg> (referer: None)
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4443/18354443/docs_service_history-1774785765857.jpg?ixlib=js-3.8.0&auto=format&s=a21179129951e964d2ccca8d3db1f6f3> (referer: None)
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4ed110>
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3173%252F19713173%252Fexterior_front_driver-1770655853175.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_front_driver-1770655853175.jpg saved to cache
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7943/17727943/docs_service_history-1774703352494-1.jpeg?ixlib=js-3.8.0&auto=format&s=9aaa840fd5dcc43f0fbfaa8b60e68c90> (referer: None)
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a34d0>
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1082%252F11431082%252Fexterior_rear_driver-1774698290662.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_rear_driver-1774698290662.jpeg saved to cache
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acfa67ea-f820-5f0c-ac83-468e8f98d040
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f38fc90>
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3173%252F19713173%252Fexterior_rear_driver-1770655919068.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_rear_driver-1770655919068.jpg saved to cache
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389
2026-03-29 20:07:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389, skipping ID generation
2026-03-29 20:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389 with scrape type 1
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389 sending to next pipeline
2026-03-29 20:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389, identifier: 19713173
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d12fed0>
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1082%252F11431082%252Fexterior_front_driver-1774698256523.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_front_driver-1774698256523.jpeg saved to cache
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acfa67ea-f820-5f0c-ac83-468e8f98d040
2026-03-29 20:07:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acfa67ea-f820-5f0c-ac83-468e8f98d040, skipping ID generation
2026-03-29 20:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acfa67ea-f820-5f0c-ac83-468e8f98d040 with scrape type 1
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acfa67ea-f820-5f0c-ac83-468e8f98d040 sending to next pipeline
2026-03-29 20:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: acfa67ea-f820-5f0c-ac83-468e8f98d040, identifier: 11431082
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daac1d0>
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20266056%252Fexterior_front_driver-1773497545943.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_front_driver-1773497545943.jpg saved to cache
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4895c87-c5fc-532a-b503-769e2618c966
2026-03-29 20:07:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4895c87-c5fc-532a-b503-769e2618c966, skipping ID generation
2026-03-29 20:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4895c87-c5fc-532a-b503-769e2618c966 with scrape type 1
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4895c87-c5fc-532a-b503-769e2618c966 sending to next pipeline
2026-03-29 20:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d4895c87-c5fc-532a-b503-769e2618c966, identifier: 20266056
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dce6850>
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8604%252F20428604%252Fexterior_front_driver-1774775341288.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_front_driver-1774775341288.jpg saved to cache
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2adf565-65cb-58bc-a40e-6be29dd6bc60
2026-03-29 20:07:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2adf565-65cb-58bc-a40e-6be29dd6bc60, skipping ID generation
2026-03-29 20:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2adf565-65cb-58bc-a40e-6be29dd6bc60 with scrape type 1
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2adf565-65cb-58bc-a40e-6be29dd6bc60 sending to next pipeline
2026-03-29 20:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f2adf565-65cb-58bc-a40e-6be29dd6bc60, identifier: 20428604
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e16c390>
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2527%252F20422527%252Fexterior_front_driver-1774375471959.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_front_driver-1774375471959.jpg saved to cache
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a
2026-03-29 20:07:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d190f5d-f4f1-5d34-b03a-85760f294b0a, skipping ID generation
2026-03-29 20:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a with scrape type 1
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d190f5d-f4f1-5d34-b03a-85760f294b0a sending to next pipeline
2026-03-29 20:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5d190f5d-f4f1-5d34-b03a-85760f294b0a, identifier: 20422527
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6071d0>
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9058%252F20469058%252Fexterior_front_driver-1774706530397.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9058/20469058/exterior_front_driver-1774706530397.jpg saved to cache
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ea8fb52-3813-5811-a6c0-5883af25aba0
2026-03-29 20:07:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ea8fb52-3813-5811-a6c0-5883af25aba0, skipping ID generation
2026-03-29 20:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ea8fb52-3813-5811-a6c0-5883af25aba0 with scrape type 1
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ea8fb52-3813-5811-a6c0-5883af25aba0 sending to next pipeline
2026-03-29 20:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3ea8fb52-3813-5811-a6c0-5883af25aba0, identifier: 20469058
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x00\x0c'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 182 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 214 - value: b'2026:03:27 14:58:48\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\xef\x0b\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 234 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 242 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x00\x10'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 250 - value: b'motorola edge 60 pro\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 282 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 142 - Data Location: 314 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x01\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00B\xdcP\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x018\xca\x00B\xd6 \x00\x00\x00\x00'
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e16d550>
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1550%252F20121550%252Finterior_rear_seats-1774631538713.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1550/20121550/interior_rear_seats-1774631538713.jpg saved to cache
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 009bec26-0ff3-5de8-8723-631486c40ab6
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x00\x0c'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 182 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 214 - value: b'2026:03:27 14:58:34\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\xf4\x0b\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 234 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 242 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x00\x10'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 250 - value: b'motorola edge 60 pro\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 282 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 142 - Data Location: 314 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x01\x00\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00HjW\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xa0\xab\x00Hd&\x00\x00\x00\x00'
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d012cd0>
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1550%252F20121550%252Finterior_front_seats-1774631547156.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1550/20121550/interior_front_seats-1774631547156.jpg saved to cache
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 009bec26-0ff3-5de8-8723-631486c40ab6
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daae7d0>
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4443%252F18354443%252Fdocs_service_history-1774785765857.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da21179129951e964d2ccca8d3db1f6f3') HTTP/1.1" 204 0
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4443/18354443/docs_service_history-1774785765857.jpg?ixlib=js-3.8.0&auto=format&s=a21179129951e964d2ccca8d3db1f6f3 saved to cache
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df
2026-03-29 20:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389 with identifier: 19713173
2026-03-29 20:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389 with identifier: 19713173
2026-03-29 20:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6bf1f9a6-bb05-55b1-b6b0-e4299faa4389 with identifier: 19713173 to the API
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_rear_driver-1770655919068.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6bf1f9a6-bb05-55b1-b6b0-e4299faa4389',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'JO51 KAT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19713173',
'listing': 'auction',
'location': 'West Yorkshire Castleford',
'make': 'Audi',
'model': 'A1',
'odometer': 36600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1256115,
'Height': 2287,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_front_driver-1770655853175.jpg',
'Width': 3049},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1079881,
'Height': 2057,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_rear_driver-1770655919068.jpg',
'Width': 2743},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1323723,
'Height': 2197,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_front_passenger-1770655898788.jpg',
'Width': 2929},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 774495,
'Height': 1911,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3173/19713173/exterior_rear_passenger-1770655807900.jpg',
'Width': 2548},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7411160,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/3173/19713173/interior_front_seats-1770656252285.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6221306,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/3173/19713173/interior_rear_seats-1770656014449.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1450103,
'Height': 4080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3173/19713173/interior_dashboard-1770718084624.jpg',
'Width': 5440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 713549,
'Height': 2568,
'OriginUrl': 'https://motorway-photos.imgix.net/3173/19713173/instrument_cluster-1770717800883.jpg',
'Width': 3424},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7038600,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/3173/19713173/interior_boot-1770655193166.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf1f9a6-bb05-55b1-b6b0-e4299faa4389/6bf1f9a6-bb05-55b1-b6b0-e4299faa4389_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125780,
'Height': 2048,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/3173/19713173/docs_service_history-1770659530808.jpg?ixlib=js-3.8.0&auto=format&s=ad1fce93a24531539ac6155ed53921f1',
'Width': 946}],
'price': 20175,
'price_includes_vat': False,
'registration_date': '2023-10-14',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 S Line Black ED 35 TFSI S-A',
'transmission': 'automatic',
'trim': 'S Line Black ED 35 TFSI S-A',
'vin': 'WAUZZZGB5RR014801',
'year': 2023}
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719713173%27 HTTP/1.1" 200 None
2026-03-29 20:07:19 [motorway.uk] INFO: Saving data for 19713173: {'created_time': 1774814839.481753, 'last_price_update_time': 1774814839.481765, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19713173') HTTP/1.1" 204 0
2026-03-29 20:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: acfa67ea-f820-5f0c-ac83-468e8f98d040 with identifier: 11431082
2026-03-29 20:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: acfa67ea-f820-5f0c-ac83-468e8f98d040 with identifier: 11431082
2026-03-29 20:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: acfa67ea-f820-5f0c-ac83-468e8f98d040 with identifier: 11431082 to the API
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_front_driver-1774698256523.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'acfa67ea-f820-5f0c-ac83-468e8f98d040',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FG21 XSN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/11431082',
'listing': 'auction',
'location': 'Milton Keynes Milton Keynes',
'make': 'Kia',
'model': 'Niro',
'odometer': 40108,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1573490,
'Height': 2881,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_front_driver-1774698256523.jpeg',
'Width': 3841},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 974457,
'Height': 2477,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_rear_driver-1774698290662.jpeg',
'Width': 3303},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1135655,
'Height': 2467,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_front_passenger-1774698510448.jpeg',
'Width': 3289},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1131224,
'Height': 2582,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1082/11431082/exterior_rear_passenger-1774698216972.jpeg',
'Width': 3443},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4017763,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1082/11431082/interior_front_seats-1774698548610.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3715030,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1082/11431082/interior_rear_seats-1774698559992.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2305349,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1082/11431082/11431082-interior_dashboard-modified-1774699998593.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2476474,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1082/11431082/instrument_cluster-1774698677943.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3979076,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1082/11431082/interior_boot-1774698473120.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfa67ea-f820-5f0c-ac83-468e8f98d040/acfa67ea-f820-5f0c-ac83-468e8f98d040_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 816238,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1082/11431082/docs_service_history-1774698656856.jpeg?ixlib=js-3.8.0&auto=format&s=c1243619d87fbebe08580d9e6b6b456c',
'Width': 4032}],
'price': 15575,
'price_includes_vat': False,
'registration_date': '2021-06-17',
'seats_number': None,
'seller_name': None,
'title': 'Kia Niro 3 PHEV S-A',
'transmission': 'automatic',
'trim': '3 PHEV S-A',
'vin': 'KNACD81DVM5473205',
'year': 2021}
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711431082%27 HTTP/1.1" 200 None
2026-03-29 20:07:20 [motorway.uk] INFO: Saving data for 11431082: {'created_time': 1774814840.247879, 'last_price_update_time': 1774814840.247892, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='11431082') HTTP/1.1" 204 0
2026-03-29 20:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d4895c87-c5fc-532a-b503-769e2618c966 with identifier: 20266056
2026-03-29 20:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d4895c87-c5fc-532a-b503-769e2618c966 with identifier: 20266056
2026-03-29 20:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d4895c87-c5fc-532a-b503-769e2618c966 with identifier: 20266056 to the API
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_front_driver-1773497545943.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd4895c87-c5fc-532a-b503-769e2618c966',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LM22 NZT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20266056',
'listing': 'auction',
'location': 'Hertfordshire Watford',
'make': 'Mercedes',
'model': 'GLA',
'odometer': 41389,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1941437,
'Height': 2643,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_front_driver-1773497545943.jpg',
'Width': 3524},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1243367,
'Height': 2324,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_rear_driver-1773497559775.jpg',
'Width': 3098},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1886828,
'Height': 2690,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_front_passenger-1773497591494.jpg',
'Width': 3586},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1424713,
'Height': 2527,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6056/20266056/exterior_rear_passenger-1773497576608.jpg',
'Width': 3369},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3418623,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6056/20266056/interior_front_seats-1773498036005.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3467293,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6056/20266056/interior_rear_seats-1773498049521.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2066447,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6056/20266056/interior_dashboard-1774775265172.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1138285,
'Height': 2172,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6056/20266056/instrument_cluster-1774775127905.jpg',
'Width': 2896},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4330759,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6056/20266056/interior_boot-1773498082787.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4895c87-c5fc-532a-b503-769e2618c966/d4895c87-c5fc-532a-b503-769e2618c966_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 816506,
'Height': 3184,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6056/20266056/docs_service_history-1773498185258.jpg?ixlib=js-3.8.0&auto=format&s=b69a70db92884136dd893bd7638402a6',
'Width': 2110}],
'price': 22023,
'price_includes_vat': False,
'registration_date': '2022-05-25',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLA 180 AMG Line Premium Auto',
'transmission': 'automatic',
'trim': '180 AMG Line Premium Auto',
'vin': 'W1N2477842J371246',
'year': 2022}
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720266056%27 HTTP/1.1" 200 None
2026-03-29 20:07:20 [motorway.uk] INFO: Saving data for 20266056: {'created_time': 1774814840.661818, 'last_price_update_time': 1774814840.661826, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20266056') HTTP/1.1" 204 0
2026-03-29 20:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f2adf565-65cb-58bc-a40e-6be29dd6bc60 with identifier: 20428604
2026-03-29 20:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f2adf565-65cb-58bc-a40e-6be29dd6bc60 with identifier: 20428604
2026-03-29 20:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f2adf565-65cb-58bc-a40e-6be29dd6bc60 with identifier: 20428604 to the API
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_front_driver-1774775341288.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'f2adf565-65cb-58bc-a40e-6be29dd6bc60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF71 FSD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20428604',
'listing': 'auction',
'location': 'North Somerset Winscombe',
'make': 'Citroen',
'model': 'Dispatch',
'odometer': 44962,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1911447,
'Height': 2896,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_front_driver-1774775341288.jpg',
'Width': 3861},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2241731,
'Height': 2828,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_rear_driver-1774775430092.jpg',
'Width': 3771},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2058570,
'Height': 2973,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_front_passenger-1774775458643.jpg',
'Width': 3964},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1878584,
'Height': 2986,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8604/20428604/exterior_rear_passenger-1774775411263.jpg',
'Width': 3981},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4456584,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8604/20428604/interior_front_seats-1774775863373.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3886458,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8604/20428604/interior_dashboard-1774775972194.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3605624,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8604/20428604/interior_boot-1774775911938.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 732620,
'Height': 1903,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8604/20428604/docs_service_history-1774778213553.jpg?ixlib=js-3.8.0&auto=format&s=ca042f9b7bc068fe967d4892c1082c10',
'Width': 2537},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3884302,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8604/20428604/damage_scratches-1774775535934.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2adf565-65cb-58bc-a40e-6be29dd6bc60/f2adf565-65cb-58bc-a40e-6be29dd6bc60_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5325266,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8604/20428604/damage_paintwork-1774775580011.jpg',
'Width': 4032}],
'price': 11451,
'price_includes_vat': False,
'registration_date': '2022-01-31',
'seats_number': None,
'seller_name': None,
'title': 'Citroen Dispatch 1000 ENT PRO B-HDI SS',
'transmission': 'manual',
'trim': '1000 ENT PRO B-HDI SS',
'vin': 'VF7VBYHRMN7000485',
'year': 2022}
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720428604%27 HTTP/1.1" 200 None
2026-03-29 20:07:21 [motorway.uk] INFO: Saving data for 20428604: {'created_time': 1774814841.094992, 'last_price_update_time': 1774814841.095005, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20428604') HTTP/1.1" 204 0
2026-03-29 20:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5d190f5d-f4f1-5d34-b03a-85760f294b0a with identifier: 20422527
2026-03-29 20:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5d190f5d-f4f1-5d34-b03a-85760f294b0a with identifier: 20422527
2026-03-29 20:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5d190f5d-f4f1-5d34-b03a-85760f294b0a with identifier: 20422527 to the API
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_front_driver-1774375471959.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '5d190f5d-f4f1-5d34-b03a-85760f294b0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV18 WDA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20422527',
'listing': 'auction',
'location': 'Kent Edenbridge',
'make': 'Kia',
'model': 'Niro',
'odometer': 66432,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1939140,
'Height': 2828,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_front_driver-1774375471959.jpg',
'Width': 3771},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1485598,
'Height': 2505,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_rear_driver-1774375483883.jpg',
'Width': 3340},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1547073,
'Height': 2469,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_front_passenger-1774375508190.jpg',
'Width': 3292},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1653867,
'Height': 2540,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2527/20422527/exterior_rear_passenger-1774375495495.jpg',
'Width': 3386},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2110651,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2527/20422527/interior_front_seats-1774636117803.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1965387,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2527/20422527/interior_rear_seats-1774635940993.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2015792,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2527/20422527/interior_dashboard-1774690566399.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2268473,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2527/20422527/instrument_cluster-1774636040616.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 975361,
'Height': 2191,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2527/20422527/interior_boot-1774690579041.jpg',
'Width': 2922},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d190f5d-f4f1-5d34-b03a-85760f294b0a/5d190f5d-f4f1-5d34-b03a-85760f294b0a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 740987,
'Height': 1754,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/2527/20422527/docs_service_history-1774690294799.jpg?ixlib=js-3.8.0&auto=format&s=9d2d90762dccce224922e79080b7c702',
'Width': 2338}],
'price': 8526,
'price_includes_vat': False,
'registration_date': '2018-05-19',
'seats_number': None,
'seller_name': None,
'title': 'Kia Niro 3 S-A',
'transmission': 'automatic',
'trim': '3 S-A',
'vin': 'KNACC81CVJ5135877',
'year': 2018}
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720422527%27 HTTP/1.1" 200 None
2026-03-29 20:07:21 [motorway.uk] INFO: Saving data for 20422527: {'created_time': 1774814841.496628, 'last_price_update_time': 1774814841.49664, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20422527') HTTP/1.1" 204 0
2026-03-29 20:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3ea8fb52-3813-5811-a6c0-5883af25aba0 with identifier: 20469058
2026-03-29 20:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3ea8fb52-3813-5811-a6c0-5883af25aba0 with identifier: 20469058
2026-03-29 20:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3ea8fb52-3813-5811-a6c0-5883af25aba0 with identifier: 20469058 to the API
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9058/20469058/exterior_front_driver-1774706530397.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '3ea8fb52-3813-5811-a6c0-5883af25aba0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EX72 JHA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20469058',
'listing': 'auction',
'location': 'Essex Colchester',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 38312,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2482714,
'Height': 3011,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9058/20469058/exterior_front_driver-1774706530397.jpg',
'Width': 4014},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2223948,
'Height': 2736,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9058/20469058/exterior_rear_driver-1774706567649.jpg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2397386,
'Height': 2828,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9058/20469058/exterior_front_passenger-1774708390294.jpg',
'Width': 3771},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2499488,
'Height': 2666,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9058/20469058/exterior_rear_passenger-1774708404588.jpg',
'Width': 3555},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4248261,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9058/20469058/interior_front_seats-1774707005250.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3055465,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9058/20469058/interior_rear_seats-1774707093474.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2278083,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9058/20469058/interior_dashboard-1774707881230.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3081542,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9058/20469058/instrument_cluster-1774707091155.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3472369,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9058/20469058/interior_boot-1774707068005.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea8fb52-3813-5811-a6c0-5883af25aba0/3ea8fb52-3813-5811-a6c0-5883af25aba0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2047904,
'Height': 2174,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9058/20469058/docs_service_history-1774707247270.jpg?ixlib=js-3.8.0&auto=format&s=4f3b5bd5af4dc25e0c3f9ad54ee98c08',
'Width': 3084}],
'price': 19882,
'price_includes_vat': False,
'registration_date': '2022-11-23',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Tucson Ultimate T-GDi HEV Auto',
'transmission': 'automatic',
'trim': 'Ultimate T-GDi HEV Auto',
'vin': 'TMAJE811MNJ145197',
'year': 2022}
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469058%27 HTTP/1.1" 200 None
2026-03-29 20:07:21 [motorway.uk] INFO: Saving data for 20469058: {'created_time': 1774814841.889815, 'last_price_update_time': 1774814841.889826, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20469058') HTTP/1.1" 204 0
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e101f90>
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7943%252F17727943%252Fdocs_service_history-1774703352494-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9aaa840fd5dcc43f0fbfaa8b60e68c90') HTTP/1.1" 204 0
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7943/17727943/docs_service_history-1774703352494-1.jpeg?ixlib=js-3.8.0&auto=format&s=9aaa840fd5dcc43f0fbfaa8b60e68c90 saved to cache
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3
2026-03-29 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_front_driver-1774693040425.jpg> (referer: None)
2026-03-29 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2839/17662839/interior_rear_seats-1774271989352.jpg> (referer: None)
2026-03-29 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9142/18969142/docs_service_history-1774694256456.jpeg?ixlib=js-3.8.0&auto=format&s=b6feae8c4805167d3bf9cc551112bbcb> (referer: None)
2026-03-29 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_rear_driver-1774631522804.jpg> (referer: None)
2026-03-29 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1472/18171472/interior_rear_seats-1774687364262.jpg> (referer: None)
2026-03-29 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2839/17662839/17662839-interior_dashboard-modified-1774625841171.jpeg> (referer: None)
2026-03-29 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_rear_passenger-1774631516467.jpg> (referer: None)
2026-03-29 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_front_passenger-1774631470294.jpg> (referer: None)
2026-03-29 20:07:22 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (16156148) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9142/18969142/interior_boot-1774693230577.jpeg>.
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1f7790>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1550%252F20121550%252Fexterior_front_driver-1774693040425.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_front_driver-1774693040425.jpg saved to cache
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 009bec26-0ff3-5de8-8723-631486c40ab6
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d604090>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2839%252F17662839%252Finterior_rear_seats-1774271989352.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2839/17662839/interior_rear_seats-1774271989352.jpg saved to cache
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df180df4-bcaf-55f4-b8c6-698f266f966a
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35723810>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9142%252F18969142%252Fdocs_service_history-1774694256456.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db6feae8c4805167d3bf9cc551112bbcb') HTTP/1.1" 204 0
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9142/18969142/docs_service_history-1774694256456.jpeg?ixlib=js-3.8.0&auto=format&s=b6feae8c4805167d3bf9cc551112bbcb saved to cache
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e218a88-3582-5e14-a8fe-95834c36b091
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2caba3d0>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1550%252F20121550%252Fexterior_rear_driver-1774631522804.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_rear_driver-1774631522804.jpg saved to cache
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 009bec26-0ff3-5de8-8723-631486c40ab6
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d606fd0>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1472%252F18171472%252Finterior_rear_seats-1774687364262.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1472/18171472/interior_rear_seats-1774687364262.jpg saved to cache
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd2d0829-9904-5e2a-948d-d047f9a67dba
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d65a610>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2839%252F17662839%252F17662839-interior_dashboard-modified-1774625841171.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2839/17662839/17662839-interior_dashboard-modified-1774625841171.jpeg saved to cache
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df180df4-bcaf-55f4-b8c6-698f266f966a
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2f9fd0>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1550%252F20121550%252Fexterior_rear_passenger-1774631516467.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_rear_passenger-1774631516467.jpg saved to cache
2026-03-29 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 009bec26-0ff3-5de8-8723-631486c40ab6
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d169610>
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1550%252F20121550%252Fexterior_front_passenger-1774631470294.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_front_passenger-1774631470294.jpg saved to cache
2026-03-29 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 009bec26-0ff3-5de8-8723-631486c40ab6
2026-03-29 20:07:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 009bec26-0ff3-5de8-8723-631486c40ab6, skipping ID generation
2026-03-29 20:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 009bec26-0ff3-5de8-8723-631486c40ab6 with scrape type 1
2026-03-29 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 009bec26-0ff3-5de8-8723-631486c40ab6 sending to next pipeline
2026-03-29 20:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 009bec26-0ff3-5de8-8723-631486c40ab6, identifier: 20121550
2026-03-29 20:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 009bec26-0ff3-5de8-8723-631486c40ab6 with identifier: 20121550
2026-03-29 20:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 009bec26-0ff3-5de8-8723-631486c40ab6 with identifier: 20121550
2026-03-29 20:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 009bec26-0ff3-5de8-8723-631486c40ab6 with identifier: 20121550 to the API
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_front_passenger-1774631470294.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '009bec26-0ff3-5de8-8723-631486c40ab6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK68 USH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20121550',
'listing': 'auction',
'location': 'Lincolnshire Peterborough',
'make': 'Nissan',
'model': 'Leaf',
'odometer': 28500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1983050,
'Height': 3053,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_front_driver-1774693040425.jpg',
'Width': 4071},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1625313,
'Height': 2442,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_rear_driver-1774631522804.jpg',
'Width': 3256},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2005046,
'Height': 3047,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_front_passenger-1774631470294.jpg',
'Width': 4063},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1920349,
'Height': 2800,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1550/20121550/exterior_rear_passenger-1774631516467.jpg',
'Width': 3733},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4935296,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/1550/20121550/interior_front_seats-1774631547156.jpg',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4544943,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/1550/20121550/interior_rear_seats-1774631538713.jpg',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1882835,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1550/20121550/interior_dashboard-1774631596252.jpg',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4703156,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/1550/20121550/interior_boot-1774631532483.jpg',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1642017,
'Height': 3072,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1550/20121550/docs_service_history-1774631740503.jpg?ixlib=js-3.8.0&auto=format&s=f2d7fa4f575d38f04b59d5caa263d6a4',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_009bec26-0ff3-5de8-8723-631486c40ab6/009bec26-0ff3-5de8-8723-631486c40ab6_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2723148,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/1550/20121550/damage_missing_trims-1774631835531.jpg',
'Width': 4096}],
'price': 6057,
'price_includes_vat': False,
'registration_date': '2018-09-03',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Leaf N-Connecta',
'transmission': 'automatic',
'trim': 'N-Connecta',
'vin': 'SJNFAAZE1U0027443',
'year': 2018}
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720121550%27 HTTP/1.1" 200 None
2026-03-29 20:07:23 [motorway.uk] INFO: Saving data for 20121550: {'created_time': 1774814843.735765, 'last_price_update_time': 1774814843.73578, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20121550') HTTP/1.1" 204 0
2026-03-29 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_rear_passenger-1774271583673.jpg> (referer: None)
2026-03-29 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_rear_passenger-1774686803545.jpg> (referer: None)
2026-03-29 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2839/17662839/interior_front_seats-1774271932606.jpg> (referer: None)
2026-03-29 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1472/18171472/interior_front_seats-1774687271963.jpg> (referer: None)
2026-03-29 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7943/17727943/instrument_cluster-1774697632711.jpg> (referer: None)
2026-03-29 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4443/18354443/interior_dashboard-1774786905315.jpg> (referer: None)
2026-03-29 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7943/17727943/interior_boot-1774697648870.jpg> (referer: None)
2026-03-29 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4443/18354443/interior_rear_seats-1774785438962.jpg> (referer: None)
2026-03-29 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4443/18354443/interior_boot-1774785475074.jpg> (referer: None)
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0c1590>
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2839%252F17662839%252Fexterior_rear_passenger-1774271583673.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_rear_passenger-1774271583673.jpg saved to cache
2026-03-29 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df180df4-bcaf-55f4-b8c6-698f266f966a
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d54add0>
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1472%252F18171472%252Fexterior_rear_passenger-1774686803545.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_rear_passenger-1774686803545.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd2d0829-9904-5e2a-948d-d047f9a67dba
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f426390>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2839%252F17662839%252Finterior_front_seats-1774271932606.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2839/17662839/interior_front_seats-1774271932606.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df180df4-bcaf-55f4-b8c6-698f266f966a
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1d6dd0>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1472%252F18171472%252Finterior_front_seats-1774687271963.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1472/18171472/interior_front_seats-1774687271963.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd2d0829-9904-5e2a-948d-d047f9a67dba
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c83b410>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7943%252F17727943%252Finstrument_cluster-1774697632711.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7943/17727943/instrument_cluster-1774697632711.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d104750>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4443%252F18354443%252Finterior_dashboard-1774786905315.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4443/18354443/interior_dashboard-1774786905315.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4747d0>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7943%252F17727943%252Finterior_boot-1774697648870.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7943/17727943/interior_boot-1774697648870.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6af690>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4443%252F18354443%252Finterior_rear_seats-1774785438962.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4443/18354443/interior_rear_seats-1774785438962.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c838750>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4443%252F18354443%252Finterior_boot-1774785475074.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4443/18354443/interior_boot-1774785475074.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_front_passenger-1774271613294.jpg> (referer: None)
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_rear_driver-1774271630180.jpg> (referer: None)
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_rear_driver-1774686890766.jpg> (referer: None)
2026-03-29 20:07:25 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (15496399) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9142/18969142/interior_front_seats-1774693093773.jpeg>.
2026-03-29 20:07:25 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9142/18969142/interior_boot-1774693230577.jpeg>.
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_front_passenger-1774686832485.jpg> (referer: None)
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9142/18969142/instrument_cluster-1774693290035.jpeg> (referer: None)
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7943/17727943/interior_dashboard-1774697716569.jpg> (referer: None)
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7943/17727943/interior_rear_seats-1774697564414.jpg> (referer: None)
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4443/18354443/interior_front_seats-1774785420315.jpg> (referer: None)
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9142/18969142/interior_boot-1774693230577.jpeg> (referer: None)
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f499210>
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2839%252F17662839%252Fexterior_front_passenger-1774271613294.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_front_passenger-1774271613294.jpg saved to cache
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df180df4-bcaf-55f4-b8c6-698f266f966a
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f49a510>
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2839%252F17662839%252Fexterior_rear_driver-1774271630180.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_rear_driver-1774271630180.jpg saved to cache
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df180df4-bcaf-55f4-b8c6-698f266f966a
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d659890>
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1472%252F18171472%252Fexterior_rear_driver-1774686890766.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_rear_driver-1774686890766.jpg saved to cache
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd2d0829-9904-5e2a-948d-d047f9a67dba
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f49a6d0>
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1472%252F18171472%252Fexterior_front_passenger-1774686832485.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_front_passenger-1774686832485.jpg saved to cache
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd2d0829-9904-5e2a-948d-d047f9a67dba
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x99\x1b\xbb\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\xe1\x8e\x00\x99\x11?\x00\x00\x00\x00'
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e16dd90>
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9142%252F18969142%252Finstrument_cluster-1774693290035.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9142/18969142/instrument_cluster-1774693290035.jpeg saved to cache
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e218a88-3582-5e14-a8fe-95834c36b091
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cab8950>
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7943%252F17727943%252Finterior_dashboard-1774697716569.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7943/17727943/interior_dashboard-1774697716569.jpg saved to cache
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d659810>
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7943%252F17727943%252Finterior_rear_seats-1774697564414.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7943/17727943/interior_rear_seats-1774697564414.jpg saved to cache
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c91c710>
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4443%252F18354443%252Finterior_front_seats-1774785420315.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4443/18354443/interior_front_seats-1774785420315.jpg saved to cache
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xeb:\xf4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x0bK\x00\x00\xeb0x\x00\x00\x00\x00'
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daad350>
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9142%252F18969142%252Finterior_boot-1774693230577.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9142/18969142/interior_boot-1774693230577.jpeg saved to cache
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e218a88-3582-5e14-a8fe-95834c36b091
2026-03-29 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9142/18969142/18969142-interior_dashboard-modified-1774696056664.jpeg> (referer: None)
2026-03-29 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_front_driver-1774686710603.jpg> (referer: None)
2026-03-29 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_front_driver-1774271523894.jpg> (referer: None)
2026-03-29 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7943/17727943/exterior_rear_passenger-1774697182281.jpg> (referer: None)
2026-03-29 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4443/18354443/exterior_front_passenger-1774785162691.jpg> (referer: None)
2026-03-29 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4443/18354443/exterior_rear_passenger-1774786878122.jpg> (referer: None)
2026-03-29 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4443/18354443/exterior_rear_driver-1774786837949.jpg> (referer: None)
2026-03-29 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9142/18969142/18969142-exterior_rear_passenger-modified-1774696032939.jpeg> (referer: None)
2026-03-29 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7943/17727943/interior_front_seats-1774697589182.jpg> (referer: None)
2026-03-29 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9142/18969142/18969142-exterior_front_passenger-modified-1774696022939.jpeg> (referer: None)
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c763550>
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9142%252F18969142%252F18969142-interior_dashboard-modified-1774696056664.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9142/18969142/18969142-interior_dashboard-modified-1774696056664.jpeg saved to cache
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e218a88-3582-5e14-a8fe-95834c36b091
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d646250>
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1472%252F18171472%252Fexterior_front_driver-1774686710603.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_front_driver-1774686710603.jpg saved to cache
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd2d0829-9904-5e2a-948d-d047f9a67dba
2026-03-29 20:07:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd2d0829-9904-5e2a-948d-d047f9a67dba, skipping ID generation
2026-03-29 20:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2d0829-9904-5e2a-948d-d047f9a67dba with scrape type 1
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd2d0829-9904-5e2a-948d-d047f9a67dba sending to next pipeline
2026-03-29 20:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: dd2d0829-9904-5e2a-948d-d047f9a67dba, identifier: 18171472
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1e7890>
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2839%252F17662839%252Fexterior_front_driver-1774271523894.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_front_driver-1774271523894.jpg saved to cache
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df180df4-bcaf-55f4-b8c6-698f266f966a
2026-03-29 20:07:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df180df4-bcaf-55f4-b8c6-698f266f966a, skipping ID generation
2026-03-29 20:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df180df4-bcaf-55f4-b8c6-698f266f966a with scrape type 1
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df180df4-bcaf-55f4-b8c6-698f266f966a sending to next pipeline
2026-03-29 20:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: df180df4-bcaf-55f4-b8c6-698f266f966a, identifier: 17662839
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35cca450>
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7943%252F17727943%252Fexterior_rear_passenger-1774697182281.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7943/17727943/exterior_rear_passenger-1774697182281.jpg saved to cache
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d154450>
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4443%252F18354443%252Fexterior_front_passenger-1774785162691.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4443/18354443/exterior_front_passenger-1774785162691.jpg saved to cache
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0c1a50>
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4443%252F18354443%252Fexterior_rear_passenger-1774786878122.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4443/18354443/exterior_rear_passenger-1774786878122.jpg saved to cache
2026-03-29 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6ee250>
2026-03-29 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4443%252F18354443%252Fexterior_rear_driver-1774786837949.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4443/18354443/exterior_rear_driver-1774786837949.jpg saved to cache
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df
2026-03-29 20:07:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfcc4ff3-0923-5380-a331-4b77ed3fa8df, skipping ID generation
2026-03-29 20:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df with scrape type 1
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfcc4ff3-0923-5380-a331-4b77ed3fa8df sending to next pipeline
2026-03-29 20:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bfcc4ff3-0923-5380-a331-4b77ed3fa8df, identifier: 18354443
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f32f250>
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9142%252F18969142%252F18969142-exterior_rear_passenger-modified-1774696032939.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9142/18969142/18969142-exterior_rear_passenger-modified-1774696032939.jpeg saved to cache
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e218a88-3582-5e14-a8fe-95834c36b091
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e13e9d0>
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7943%252F17727943%252Finterior_front_seats-1774697589182.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7943/17727943/interior_front_seats-1774697589182.jpg saved to cache
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f62c950>
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9142%252F18969142%252F18969142-exterior_front_passenger-modified-1774696022939.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9142/18969142/18969142-exterior_front_passenger-modified-1774696022939.jpeg saved to cache
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e218a88-3582-5e14-a8fe-95834c36b091
2026-03-29 20:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: dd2d0829-9904-5e2a-948d-d047f9a67dba with identifier: 18171472
2026-03-29 20:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: dd2d0829-9904-5e2a-948d-d047f9a67dba with identifier: 18171472
2026-03-29 20:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: dd2d0829-9904-5e2a-948d-d047f9a67dba with identifier: 18171472 to the API
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_front_driver-1774686710603.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'dd2d0829-9904-5e2a-948d-d047f9a67dba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KE23 GGZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18171472',
'listing': 'auction',
'location': 'Greater London Harrow',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 9178,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1181438,
'Height': 2297,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_front_driver-1774686710603.jpg',
'Width': 3063},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1333059,
'Height': 2627,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_rear_driver-1774686890766.jpg',
'Width': 3502},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1605903,
'Height': 2798,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_front_passenger-1774686832485.jpg',
'Width': 3730},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 739206,
'Height': 2586,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1472/18171472/exterior_rear_passenger-1774686803545.jpg',
'Width': 3448},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2226843,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1472/18171472/interior_front_seats-1774687271963.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1651179,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1472/18171472/interior_rear_seats-1774687364262.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1564711,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1472/18171472/interior_dashboard-1774775810629.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1292361,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1472/18171472/instrument_cluster-1774687402634.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1458878,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1472/18171472/interior_boot-1774687362413.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd2d0829-9904-5e2a-948d-d047f9a67dba/dd2d0829-9904-5e2a-948d-d047f9a67dba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1052556,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1472/18171472/docs_service_history-1774687663063.jpg?ixlib=js-3.8.0&auto=format&s=691ef46cc0500b621b394fb0ab3ef099',
'Width': 3840}],
'price': 23300,
'price_includes_vat': False,
'registration_date': '2023-07-14',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen T-Roc R-LINE TSI S-A',
'transmission': 'automatic',
'trim': 'R-LINE TSI S-A',
'vin': 'WVGZZZA1ZPV729014',
'year': 2023}
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718171472%27 HTTP/1.1" 200 None
2026-03-29 20:07:34 [motorway.uk] INFO: Saving data for 18171472: {'created_time': 1774814854.253437, 'last_price_update_time': 1774814854.25345, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18171472') HTTP/1.1" 204 0
2026-03-29 20:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: df180df4-bcaf-55f4-b8c6-698f266f966a with identifier: 17662839
2026-03-29 20:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: df180df4-bcaf-55f4-b8c6-698f266f966a with identifier: 17662839
2026-03-29 20:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: df180df4-bcaf-55f4-b8c6-698f266f966a with identifier: 17662839 to the API
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_front_driver-1774271523894.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'df180df4-bcaf-55f4-b8c6-698f266f966a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GU17 FKN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17662839',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Mercedes',
'model': 'C Class',
'odometer': 62004,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 937230,
'Height': 2258,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_front_driver-1774271523894.jpg',
'Width': 3011},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570109,
'Height': 1808,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_rear_driver-1774271630180.jpg',
'Width': 2410},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636545,
'Height': 1998,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_front_passenger-1774271613294.jpg',
'Width': 2664},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 762581,
'Height': 2183,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2839/17662839/exterior_rear_passenger-1774271583673.jpg',
'Width': 2911},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1823037,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2839/17662839/interior_front_seats-1774271932606.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1242632,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2839/17662839/interior_rear_seats-1774271989352.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1707182,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2839/17662839/17662839-interior_dashboard-modified-1774625841171.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337275,
'Height': 1275,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2839/17662839/17662839-instrument_cluster-modified-1774625855321.jpeg',
'Width': 1700},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1867127,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2839/17662839/interior_boot-1774272068510.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df180df4-bcaf-55f4-b8c6-698f266f966a/df180df4-bcaf-55f4-b8c6-698f266f966a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58906,
'Height': 631,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/2839/17662839/17662839-docs_service_history-modified-1757956823228.jpeg?ixlib=js-3.8.0&auto=format&s=3a3a87f539ba30a4177daca2cd2a24f4',
'Width': 841}],
'price': 11739,
'price_includes_vat': False,
'registration_date': '2017-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes C 220 AMG Line PREMIUM+ D 4M A',
'transmission': 'automatic',
'trim': 'C 220 AMG Line PREMIUM+ D 4M A',
'vin': 'WDD2054052F501779',
'year': 2017}
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717662839%27 HTTP/1.1" 200 None
2026-03-29 20:07:34 [motorway.uk] INFO: Saving data for 17662839: {'created_time': 1774814854.739939, 'last_price_update_time': 1774814854.73995, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17662839') HTTP/1.1" 204 0
2026-03-29 20:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bfcc4ff3-0923-5380-a331-4b77ed3fa8df with identifier: 18354443
2026-03-29 20:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bfcc4ff3-0923-5380-a331-4b77ed3fa8df with identifier: 18354443
2026-03-29 20:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bfcc4ff3-0923-5380-a331-4b77ed3fa8df with identifier: 18354443 to the API
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/4443/18354443/exterior_rear_driver-1774786837949.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bfcc4ff3-0923-5380-a331-4b77ed3fa8df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD22 DSU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18354443',
'listing': 'auction',
'location': 'Buckinghamshire Iver',
'make': 'Audi',
'model': 'A5',
'odometer': 71699,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4053239,
'Height': 2903,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4443/18354443/exterior_front_driver-1774787484235.jpg',
'Width': 3870},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3443463,
'Height': 2916,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4443/18354443/exterior_rear_driver-1774786837949.jpg',
'Width': 3888},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2273454,
'Height': 2599,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4443/18354443/exterior_front_passenger-1774785162691.jpg',
'Width': 3465},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2818953,
'Height': 2606,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4443/18354443/exterior_rear_passenger-1774786878122.jpg',
'Width': 3475},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3746859,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4443/18354443/interior_front_seats-1774785420315.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3479589,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4443/18354443/interior_rear_seats-1774785438962.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2414727,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4443/18354443/interior_dashboard-1774786905315.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4034310,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4443/18354443/interior_boot-1774785475074.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426876,
'Height': 2532,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4443/18354443/docs_service_history-1774785765857.jpg?ixlib=js-3.8.0&auto=format&s=a21179129951e964d2ccca8d3db1f6f3',
'Width': 1170},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfcc4ff3-0923-5380-a331-4b77ed3fa8df/bfcc4ff3-0923-5380-a331-4b77ed3fa8df_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 698500,
'Height': 1326,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4443/18354443/damage_missing_trims-1774786573436.jpg',
'Width': 1768}],
'price': 16783,
'price_includes_vat': False,
'registration_date': '2022-03-19',
'seats_number': None,
'seller_name': None,
'title': 'Audi A5 S LN BLK ED 35 TFSI MHEV SA',
'transmission': 'automatic',
'trim': 'S LN BLK ED 35 TFSI MHEV SA',
'vin': 'WAUZZZF5XNA028200',
'year': 2022}
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718354443%27 HTTP/1.1" 200 None
2026-03-29 20:07:35 [motorway.uk] INFO: Saving data for 18354443: {'created_time': 1774814855.139366, 'last_price_update_time': 1774814855.139377, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18354443') HTTP/1.1" 204 0
2026-03-29 20:07:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:35 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9142/18969142/interior_front_seats-1774693093773.jpeg>.
2026-03-29 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9142/18969142/interior_front_seats-1774693093773.jpeg> (referer: None)
2026-03-29 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7943/17727943/exterior_front_driver-1774703441932.jpg> (referer: None)
2026-03-29 20:07:35 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:35 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:35 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xe1\x19\xf7\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x0bZ\xd8\x00\xe1\x0f{\x00\x00\x00\x00'
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c839cd0>
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9142%252F18969142%252Finterior_front_seats-1774693093773.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9142/18969142/interior_front_seats-1774693093773.jpeg saved to cache
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e218a88-3582-5e14-a8fe-95834c36b091
2026-03-29 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9142/18969142/18969142-exterior_front_driver-modified-1774696008241.jpeg> (referer: None)
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c647ad0>
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7943%252F17727943%252Fexterior_front_driver-1774703441932.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7943/17727943/exterior_front_driver-1774703441932.jpg saved to cache
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3
2026-03-29 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9142/18969142/exterior_rear_driver-1774693044036.jpeg> (referer: None)
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6d5e50>
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9142%252F18969142%252F18969142-exterior_front_driver-modified-1774696008241.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9142/18969142/18969142-exterior_front_driver-modified-1774696008241.jpeg saved to cache
2026-03-29 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e218a88-3582-5e14-a8fe-95834c36b091
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de21e50>
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9142%252F18969142%252Fexterior_rear_driver-1774693044036.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9142/18969142/exterior_rear_driver-1774693044036.jpeg saved to cache
2026-03-29 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e218a88-3582-5e14-a8fe-95834c36b091
2026-03-29 20:07:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e218a88-3582-5e14-a8fe-95834c36b091, skipping ID generation
2026-03-29 20:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e218a88-3582-5e14-a8fe-95834c36b091 with scrape type 1
2026-03-29 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e218a88-3582-5e14-a8fe-95834c36b091 sending to next pipeline
2026-03-29 20:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0e218a88-3582-5e14-a8fe-95834c36b091, identifier: 18969142
2026-03-29 20:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0e218a88-3582-5e14-a8fe-95834c36b091 with identifier: 18969142
2026-03-29 20:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0e218a88-3582-5e14-a8fe-95834c36b091 with identifier: 18969142
2026-03-29 20:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0e218a88-3582-5e14-a8fe-95834c36b091 with identifier: 18969142 to the API
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9142/18969142/exterior_rear_driver-1774693044036.jpeg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '0e218a88-3582-5e14-a8fe-95834c36b091',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'C11 REB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18969142',
'listing': 'auction',
'location': 'Vale of Glamorgan Dinas Powys',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 23203,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7191715,
'Height': 5717,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9142/18969142/18969142-exterior_front_driver-modified-1774696008241.jpeg',
'Width': 7623},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3028397,
'Height': 4955,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9142/18969142/exterior_rear_driver-1774693044036.jpeg',
'Width': 6607},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7544965,
'Height': 5765,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9142/18969142/18969142-exterior_front_passenger-modified-1774696022939.jpeg',
'Width': 7687},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4081308,
'Height': 4891,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9142/18969142/18969142-exterior_rear_passenger-modified-1774696032939.jpeg',
'Width': 6521},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 15496399,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/9142/18969142/interior_front_seats-1774693093773.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 15058731,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/9142/18969142/interior_rear_seats-1774693187487.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 9340574,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9142/18969142/18969142-interior_dashboard-modified-1774696056664.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 10419529,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9142/18969142/instrument_cluster-1774693290035.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 16156148,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/9142/18969142/interior_boot-1774693230577.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e218a88-3582-5e14-a8fe-95834c36b091/0e218a88-3582-5e14-a8fe-95834c36b091_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1491844,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9142/18969142/docs_service_history-1774694256456.jpeg?ixlib=js-3.8.0&auto=format&s=b6feae8c4805167d3bf9cc551112bbcb',
'Width': 3024}],
'price': 10795,
'price_includes_vat': False,
'registration_date': '2015-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Yeti Outdoor SE TSI S-A',
'transmission': 'automatic',
'trim': 'Outdoor SE TSI S-A',
'vin': 'TMBKF75L3F6055907',
'year': 2015}
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718969142%27 HTTP/1.1" 200 None
2026-03-29 20:07:36 [motorway.uk] INFO: Saving data for 18969142: {'created_time': 1774814856.776467, 'last_price_update_time': 1774814856.776478, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18969142') HTTP/1.1" 204 0
2026-03-29 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7943/17727943/exterior_front_passenger-1774697245036.jpg> (referer: None)
2026-03-29 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7943/17727943/exterior_rear_driver-1774697051095.jpg> (referer: None)
2026-03-29 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9750/20459750/instrument_cluster-1774703943471.jpg> (referer: None)
2026-03-29 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7615/20487615/exterior_front_driver-1774701462495.jpeg> (referer: None)
2026-03-29 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9750/20459750/interior_boot-1774703877853.jpg> (referer: None)
2026-03-29 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8920/20468920/damage_scratches-1774606898554.jpg> (referer: None)
2026-03-29 20:07:36 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12577214) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8404/20158404/interior_boot-1773062294962.jpeg>.
2026-03-29 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0409/15870409/15870409-interior_front_seats-modified-1774783205123.jpeg> (referer: None)
2026-03-29 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9750/20459750/docs_service_history-1774704110632.jpg?ixlib=js-3.8.0&auto=format&s=621135dab85628272e834bdce7c49691> (referer: None)
2026-03-29 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8920/20468920/interior_dashboard-1774781713943.jpg> (referer: None)
2026-03-29 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5001/20485001/docs_service_history-1774694114598.jpg?ixlib=js-3.8.0&auto=format&s=787a0658177c11cc70c58c6d97d65b46> (referer: None)
2026-03-29 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8920/20468920/docs_service_history-1774607649681.jpg?ixlib=js-3.8.0&auto=format&s=b8a9287a08e8373c293e93dfaaaa893b> (referer: None)
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6330d0>
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7943%252F17727943%252Fexterior_front_passenger-1774697245036.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7943/17727943/exterior_front_passenger-1774697245036.jpg saved to cache
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f62d550>
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7943%252F17727943%252Fexterior_rear_driver-1774697051095.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7943/17727943/exterior_rear_driver-1774697051095.jpg saved to cache
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3
2026-03-29 20:07:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e620fcb-6f0f-5452-aed7-865aaec57fc3, skipping ID generation
2026-03-29 20:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3 with scrape type 1
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e620fcb-6f0f-5452-aed7-865aaec57fc3 sending to next pipeline
2026-03-29 20:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6e620fcb-6f0f-5452-aed7-865aaec57fc3, identifier: 17727943
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2f6010>
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9750%252F20459750%252Finstrument_cluster-1774703943471.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9750/20459750/instrument_cluster-1774703943471.jpg saved to cache
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc73e50>
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7615%252F20487615%252Fexterior_front_driver-1774701462495.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7615/20487615/exterior_front_driver-1774701462495.jpeg saved to cache
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05321a24-38b3-566c-83a5-58c40ff1251b
2026-03-29 20:07:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05321a24-38b3-566c-83a5-58c40ff1251b, skipping ID generation
2026-03-29 20:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05321a24-38b3-566c-83a5-58c40ff1251b with scrape type 1
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05321a24-38b3-566c-83a5-58c40ff1251b sending to next pipeline
2026-03-29 20:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 05321a24-38b3-566c-83a5-58c40ff1251b, identifier: 20487615
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6d7010>
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9750%252F20459750%252Finterior_boot-1774703877853.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9750/20459750/interior_boot-1774703877853.jpg saved to cache
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077
2026-03-29 20:07:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dcdc2d0>
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8920%252F20468920%252Fdamage_scratches-1774606898554.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8920/20468920/damage_scratches-1774606898554.jpg saved to cache
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc913d0>
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eba9632d-1757-5c60-9884-b1dd06d767f9/eba9632d-1757-5c60-9884-b1dd06d767f9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0409%252F15870409%252F15870409-interior_front_seats-modified-1774783205123.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0409/15870409/15870409-interior_front_seats-modified-1774783205123.jpeg saved to cache
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eba9632d-1757-5c60-9884-b1dd06d767f9
2026-03-29 20:07:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eba9632d-1757-5c60-9884-b1dd06d767f9, skipping ID generation
2026-03-29 20:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eba9632d-1757-5c60-9884-b1dd06d767f9 with scrape type 1
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eba9632d-1757-5c60-9884-b1dd06d767f9 sending to next pipeline
2026-03-29 20:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: eba9632d-1757-5c60-9884-b1dd06d767f9, identifier: 15870409
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d105f90>
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9750%252F20459750%252Fdocs_service_history-1774704110632.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D621135dab85628272e834bdce7c49691') HTTP/1.1" 204 0
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9750/20459750/docs_service_history-1774704110632.jpg?ixlib=js-3.8.0&auto=format&s=621135dab85628272e834bdce7c49691 saved to cache
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077
2026-03-29 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35731f10>
2026-03-29 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8920%252F20468920%252Finterior_dashboard-1774781713943.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8920/20468920/interior_dashboard-1774781713943.jpg saved to cache
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5
2026-03-29 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4b3d10>
2026-03-29 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5001%252F20485001%252Fdocs_service_history-1774694114598.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D787a0658177c11cc70c58c6d97d65b46') HTTP/1.1" 204 0
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5001/20485001/docs_service_history-1774694114598.jpg?ixlib=js-3.8.0&auto=format&s=787a0658177c11cc70c58c6d97d65b46 saved to cache
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0
2026-03-29 20:07:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0c18d0>
2026-03-29 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8920%252F20468920%252Fdocs_service_history-1774607649681.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db8a9287a08e8373c293e93dfaaaa893b') HTTP/1.1" 204 0
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8920/20468920/docs_service_history-1774607649681.jpg?ixlib=js-3.8.0&auto=format&s=b8a9287a08e8373c293e93dfaaaa893b saved to cache
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5
2026-03-29 20:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6e620fcb-6f0f-5452-aed7-865aaec57fc3 with identifier: 17727943
2026-03-29 20:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6e620fcb-6f0f-5452-aed7-865aaec57fc3 with identifier: 17727943
2026-03-29 20:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6e620fcb-6f0f-5452-aed7-865aaec57fc3 with identifier: 17727943 to the API
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7943/17727943/exterior_rear_driver-1774697051095.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '6e620fcb-6f0f-5452-aed7-865aaec57fc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'US10 AJS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17727943',
'listing': 'auction',
'location': 'South Yorkshire Doncaster',
'make': 'Jaguar',
'model': 'E-PACE',
'odometer': 67500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2425389,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7943/17727943/exterior_front_driver-1774703441932.jpg',
'Width': 3855},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1331215,
'Height': 2392,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7943/17727943/exterior_rear_driver-1774697051095.jpg',
'Width': 3189},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1049527,
'Height': 2036,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7943/17727943/exterior_front_passenger-1774697245036.jpg',
'Width': 2715},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1570511,
'Height': 2629,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7943/17727943/exterior_rear_passenger-1774697182281.jpg',
'Width': 3505},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4186458,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7943/17727943/interior_front_seats-1774697589182.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3029766,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7943/17727943/interior_rear_seats-1774697564414.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3087691,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7943/17727943/interior_dashboard-1774697716569.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2293564,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7943/17727943/instrument_cluster-1774697632711.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3307352,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7943/17727943/interior_boot-1774697648870.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e620fcb-6f0f-5452-aed7-865aaec57fc3/6e620fcb-6f0f-5452-aed7-865aaec57fc3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83439,
'Height': 1263,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7943/17727943/docs_service_history-1774703352494-1.jpeg?ixlib=js-3.8.0&auto=format&s=9aaa840fd5dcc43f0fbfaa8b60e68c90',
'Width': 892}],
'price': 12443,
'price_includes_vat': False,
'registration_date': '2020-05-29',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar E-PACE Chequered Flag D AWD A',
'transmission': 'automatic',
'trim': 'Chequered Flag D AWD A',
'vin': 'SADFA2AN5L1005677',
'year': 2020}
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717727943%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [motorway.uk] INFO: Saving data for 17727943: {'created_time': 1774814858.818925, 'last_price_update_time': 1774814858.818934, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17727943') HTTP/1.1" 204 0
2026-03-29 20:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 05321a24-38b3-566c-83a5-58c40ff1251b with identifier: 20487615
2026-03-29 20:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 05321a24-38b3-566c-83a5-58c40ff1251b with identifier: 20487615
2026-03-29 20:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 05321a24-38b3-566c-83a5-58c40ff1251b with identifier: 20487615 to the API
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7615/20487615/exterior_front_driver-1774701462495.jpeg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '05321a24-38b3-566c-83a5-58c40ff1251b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'PN19 OHG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487615',
'listing': 'auction',
'location': 'West Midlands West Bromwich',
'make': 'Kia',
'model': 'ProCeed',
'odometer': 67500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1232041,
'Height': 2159,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7615/20487615/exterior_front_driver-1774701462495.jpeg',
'Width': 2879},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1238990,
'Height': 2280,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7615/20487615/exterior_rear_driver-1774701510522.jpeg',
'Width': 3040},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1916635,
'Height': 2320,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7615/20487615/20487615-exterior_front_passenger-modified-1774703593607.jpeg',
'Width': 3093},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2014256,
'Height': 2389,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7615/20487615/20487615-exterior_rear_passenger-modified-1774703603053.jpeg',
'Width': 3185},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3495429,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7615/20487615/interior_front_seats-1774701650151.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3074490,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7615/20487615/interior_rear_seats-1774701667172.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2514131,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7615/20487615/20487615-interior_dashboard-modified-1774703578690.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4311752,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7615/20487615/interior_boot-1774701703525.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1118243,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7615/20487615/docs_service_history-1774702287594.jpeg?ixlib=js-3.8.0&auto=format&s=2af7faa8cd37ff386a1b39847120cd44',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05321a24-38b3-566c-83a5-58c40ff1251b/05321a24-38b3-566c-83a5-58c40ff1251b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 956660,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7615/20487615/docs_service_history-1774702319504.jpeg?ixlib=js-3.8.0&auto=format&s=7055e7e9c8047699dcb3013747216479',
'Width': 4032}],
'price': 9227,
'price_includes_vat': False,
'registration_date': '2019-03-16',
'seats_number': None,
'seller_name': None,
'title': 'Kia Proceed GT-LINE CRDI ISG S-A',
'transmission': 'automatic',
'trim': 'Proceed GT-LINE CRDI ISG S-A',
'vin': 'U5YH2G19VKL004581',
'year': 2019}
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487615%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [motorway.uk] INFO: Saving data for 20487615: {'created_time': 1774814859.218947, 'last_price_update_time': 1774814859.218959, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487615') HTTP/1.1" 204 0
2026-03-29 20:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: eba9632d-1757-5c60-9884-b1dd06d767f9 with identifier: 15870409
2026-03-29 20:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: eba9632d-1757-5c60-9884-b1dd06d767f9 with identifier: 15870409
2026-03-29 20:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: eba9632d-1757-5c60-9884-b1dd06d767f9 with identifier: 15870409 to the API
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0409/15870409/15870409-interior_front_seats-modified-1774783205123.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'eba9632d-1757-5c60-9884-b1dd06d767f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SN21 VWH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15870409',
'listing': 'auction',
'location': 'Surrey Chertsey',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 49000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e745ec-58a9-5eb3-978c-2be8e571a4a3/25e745ec-58a9-5eb3-978c-2be8e571a4a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2005069,
'Height': 2632,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0409/15870409/exterior_front_driver-1769605503493.jpeg',
'Width': 3509},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e745ec-58a9-5eb3-978c-2be8e571a4a3/25e745ec-58a9-5eb3-978c-2be8e571a4a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1195051,
'Height': 2421,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0409/15870409/exterior_rear_driver-1769605577949.jpeg',
'Width': 3228},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e745ec-58a9-5eb3-978c-2be8e571a4a3/25e745ec-58a9-5eb3-978c-2be8e571a4a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1656210,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0409/15870409/exterior_front_passenger-1769605574090.jpeg',
'Width': 3454},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e745ec-58a9-5eb3-978c-2be8e571a4a3/25e745ec-58a9-5eb3-978c-2be8e571a4a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1321622,
'Height': 2457,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0409/15870409/exterior_rear_passenger-1769605561519.jpeg',
'Width': 3276},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eba9632d-1757-5c60-9884-b1dd06d767f9/eba9632d-1757-5c60-9884-b1dd06d767f9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2466587,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0409/15870409/15870409-interior_front_seats-modified-1774783205123.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e745ec-58a9-5eb3-978c-2be8e571a4a3/25e745ec-58a9-5eb3-978c-2be8e571a4a3_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3322685,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0409/15870409/interior_rear_seats-1769605661735.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e745ec-58a9-5eb3-978c-2be8e571a4a3/25e745ec-58a9-5eb3-978c-2be8e571a4a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1936380,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0409/15870409/15870409-interior_dashboard-modified-1769607308705.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e745ec-58a9-5eb3-978c-2be8e571a4a3/25e745ec-58a9-5eb3-978c-2be8e571a4a3_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3906509,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0409/15870409/interior_boot-1769605716543.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e745ec-58a9-5eb3-978c-2be8e571a4a3/25e745ec-58a9-5eb3-978c-2be8e571a4a3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3615625,
'Height': 4284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/0409/15870409/docs_service_history-1769606163141.jpeg?ixlib=js-3.8.0&auto=format&s=b40b4f989548734da3b255001ad017f2',
'Width': 5712},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e745ec-58a9-5eb3-978c-2be8e571a4a3/25e745ec-58a9-5eb3-978c-2be8e571a4a3_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 758041,
'Height': 1880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0409/15870409/wheels_front_driver-1769605742489.jpeg',
'Width': 2507}],
'price': 16104,
'price_includes_vat': False,
'registration_date': '2021-04-29',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 250 AMG Line Premium + E A',
'transmission': 'automatic',
'trim': 'A 250 AMG Line Premium + E A',
'vin': 'W1K1770862V102797',
'year': 2021}
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715870409%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [motorway.uk] INFO: Saving data for 15870409: {'created_time': 1774814859.619159, 'last_price_update_time': 1774814859.61917, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15870409') HTTP/1.1" 204 0
2026-03-29 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=432&page=12&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9750/20459750/interior_front_seats-1774703950204.jpg> (referer: None)
2026-03-29 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8920/20468920/interior_boot-1774607395773.jpg> (referer: None)
2026-03-29 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8920/20468920/interior_front_seats-1774607323008.jpg> (referer: None)
2026-03-29 20:07:39 [motorway.uk] INFO: Found listing with ID: 20168160
2026-03-29 20:07:39 [motorway.uk] INFO: Found listing with ID: 19750033
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719750033%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [motorway.uk] INFO: Scrape type for 19750033: 1
2026-03-29 20:07:39 [motorway.uk] INFO: Found listing with ID: 19427127
2026-03-29 20:07:39 [motorway.uk] INFO: Found listing with ID: 18209819
2026-03-29 20:07:39 [motorway.uk] INFO: Found listing with ID: 18301360
2026-03-29 20:07:39 [motorway.uk] INFO: Found listing with ID: 20315758
2026-03-29 20:07:39 [motorway.uk] INFO: Found listing with ID: 20303235
2026-03-29 20:07:39 [motorway.uk] INFO: Found listing with ID: 20491229
2026-03-29 20:07:39 [motorway.uk] INFO: Found listing with ID: 13358851
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713358851%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [motorway.uk] INFO: Scrape type for 13358851: 1
2026-03-29 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d21c390>
2026-03-29 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9750%252F20459750%252Finterior_front_seats-1774703950204.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9750/20459750/interior_front_seats-1774703950204.jpg saved to cache
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1bd910>
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8920%252F20468920%252Finterior_boot-1774607395773.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8920/20468920/interior_boot-1774607395773.jpg saved to cache
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d012b10>
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8920%252F20468920%252Finterior_front_seats-1774607323008.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8920/20468920/interior_front_seats-1774607323008.jpg saved to cache
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5
2026-03-29 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0509/20260509/docs_service_history-1774015659880.jpg?ixlib=js-3.8.0&auto=format&s=21ea7dcb37c7f64cde8e79cd2eb486fa> (referer: None)
2026-03-29 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2589/20372589/docs_service_history-1774260565899-1.jpeg?ixlib=js-3.8.0&auto=format&s=284a4342c0791cda7bf4ada444ce9258> (referer: None)
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20494032
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 18839642
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20490324
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 19350653
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 13711845
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 14441433
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20499741
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 10678898
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 19016165
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20458519
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720458519%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [motorway.uk] INFO: Scrape type for 20458519: 1
2026-03-29 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16772824.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:40 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (17929447) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8404/20158404/interior_rear_seats-1773062276928.jpeg>.
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20500024
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20461118
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 11411855
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20459543
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 18543563
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20269831
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720269831%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [motorway.uk] INFO: Scrape type for 20269831: 1
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20341046
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20265542
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720265542%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [motorway.uk] INFO: Scrape type for 20265542: 1
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 10211430
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20484735
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484735%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [motorway.uk] INFO: Scrape type for 20484735: 1
2026-03-29 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5001/20485001/interior_boot-1774693922234.jpg> (referer: None)
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20488534
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488534%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [motorway.uk] INFO: Scrape type for 20488534: 1
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d010110>
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0509%252F20260509%252Fdocs_service_history-1774015659880.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D21ea7dcb37c7f64cde8e79cd2eb486fa') HTTP/1.1" 204 0
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0509/20260509/docs_service_history-1774015659880.jpg?ixlib=js-3.8.0&auto=format&s=21ea7dcb37c7f64cde8e79cd2eb486fa saved to cache
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 581e8de5-b04a-5086-a100-01898fcf7c3f
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 1773065
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 14164507
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 19886114
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20414483
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720414483%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [motorway.uk] INFO: Scrape type for 20414483: 1
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f65e090>
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2589%252F20372589%252Fdocs_service_history-1774260565899-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D284a4342c0791cda7bf4ada444ce9258') HTTP/1.1" 204 0
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2589/20372589/docs_service_history-1774260565899-1.jpeg?ixlib=js-3.8.0&auto=format&s=284a4342c0791cda7bf4ada444ce9258 saved to cache
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1dca530e-49ed-53ab-98d9-22b256fd4813
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 19235402
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20488258
2026-03-29 20:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec796279-eef3-5ce5-ad1f-9cebb31be076 with identifier: 16772824
2026-03-29 20:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec796279-eef3-5ce5-ad1f-9cebb31be076 with scrape type 1
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec796279-eef3-5ce5-ad1f-9cebb31be076
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2824%252F16772824%252Fexterior_front_driver-1774695093983.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_front_driver-1774695093983.jpg not downloaded yet
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4e3490>
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5001%252F20485001%252Finterior_boot-1774693922234.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5001/20485001/interior_boot-1774693922234.jpg saved to cache
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2824%252F16772824%252Fexterior_rear_driver-1774695120900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_rear_driver-1774695120900.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2824%252F16772824%252Fexterior_front_passenger-1774695161412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_front_passenger-1774695161412.jpg not downloaded yet
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9750/20459750/exterior_rear_passenger-1774703376128.jpg> (referer: None)
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2824%252F16772824%252Fexterior_rear_passenger-1774695142560.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_rear_passenger-1774695142560.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2824%252F16772824%252Finterior_front_seats-1774695588685.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2824/16772824/interior_front_seats-1774695588685.jpg not downloaded yet
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0509/20260509/instrument_cluster-1774694834820.jpg> (referer: None)
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2824%252F16772824%252Finterior_rear_seats-1774695628324.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2824/16772824/interior_rear_seats-1774695628324.jpg not downloaded yet
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5001/20485001/docs_service_history-1774694085202.jpg?ixlib=js-3.8.0&auto=format&s=c820e15148f8dec53a930b3bef9b742e> (referer: None)
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2824%252F16772824%252Finterior_dashboard-1774695678525.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2824/16772824/interior_dashboard-1774695678525.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2824%252F16772824%252Finstrument_cluster-1774695673204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2824/16772824/instrument_cluster-1774695673204.jpg not downloaded yet
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0b6190>
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9750%252F20459750%252Fexterior_rear_passenger-1774703376128.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9750/20459750/exterior_rear_passenger-1774703376128.jpg saved to cache
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2824%252F16772824%252Finterior_boot-1774695711579.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2824/16772824/interior_boot-1774695711579.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2824%252F16772824%252Fdocs_service_history-1774698551337.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D25af706628748e5b765aabcebde8d99b%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2824/16772824/docs_service_history-1774698551337.jpg?ixlib=js-3.8.0&auto=format&s=25af706628748e5b765aabcebde8d99b not downloaded yet
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de55c10>
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0509%252F20260509%252Finstrument_cluster-1774694834820.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0509/20260509/instrument_cluster-1774694834820.jpg saved to cache
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 581e8de5-b04a-5086-a100-01898fcf7c3f
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de1b950>
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5001%252F20485001%252Fdocs_service_history-1774694085202.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc820e15148f8dec53a930b3bef9b742e') HTTP/1.1" 204 0
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5001/20485001/docs_service_history-1774694085202.jpg?ixlib=js-3.8.0&auto=format&s=c820e15148f8dec53a930b3bef9b742e saved to cache
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0
2026-03-29 20:07:41 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8404/20158404/interior_boot-1773062294962.jpeg>.
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8404/20158404/instrument_cluster-1773062389265.jpeg> (referer: None)
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0509/20260509/interior_boot-1774015551537.jpg> (referer: None)
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8920/20468920/exterior_rear_passenger-1774781880270.jpg> (referer: None)
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8404/20158404/interior_boot-1773062294962.jpeg> (referer: None)
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_front_passenger-1774695161412.jpg> (referer: None)
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8404/20158404/interior_dashboard-1773062321759.jpeg> (referer: None)
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2824/16772824/interior_front_seats-1774695588685.jpg> (referer: None)
2026-03-29 20:07:41 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8404/20158404/interior_rear_seats-1773062276928.jpeg>.
2026-03-29 20:07:41 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:41 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:41 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00xL\xa0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06\x97\x83\x00xB \x00\x00\x00\x00'
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc115d0>
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F20158404%252Finstrument_cluster-1773062389265.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/20158404/instrument_cluster-1773062389265.jpeg saved to cache
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9384f570-0a6f-5529-b6db-f87e678ea572
2026-03-29 20:07:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db74190>
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0509%252F20260509%252Finterior_boot-1774015551537.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0509/20260509/interior_boot-1774015551537.jpg saved to cache
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 581e8de5-b04a-5086-a100-01898fcf7c3f
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca648d0>
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8920%252F20468920%252Fexterior_rear_passenger-1774781880270.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8920/20468920/exterior_rear_passenger-1774781880270.jpg saved to cache
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5
2026-03-29 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xb5\xce\xe9\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\n\x1a\xd5\x00\xb5\xc4i\x00\x00\x00\x00'
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f380bd0>
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8404%252F20158404%252Finterior_boot-1773062294962.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8404/20158404/interior_boot-1773062294962.jpeg saved to cache
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9384f570-0a6f-5529-b6db-f87e678ea572
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce9fb50>
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2824%252F16772824%252Fexterior_front_passenger-1774695161412.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_front_passenger-1774695161412.jpg saved to cache
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec796279-eef3-5ce5-ad1f-9cebb31be076
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce9fcd0>
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F20158404%252Finterior_dashboard-1773062321759.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/20158404/interior_dashboard-1773062321759.jpeg saved to cache
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9384f570-0a6f-5529-b6db-f87e678ea572
2026-03-29 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd0bed0>
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2824%252F16772824%252Finterior_front_seats-1774695588685.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2824/16772824/interior_front_seats-1774695588685.jpg saved to cache
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec796279-eef3-5ce5-ad1f-9cebb31be076
2026-03-29 20:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2824/16772824/docs_service_history-1774698551337.jpg?ixlib=js-3.8.0&auto=format&s=25af706628748e5b765aabcebde8d99b> (referer: None)
2026-03-29 20:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8404/20158404/interior_rear_seats-1773062276928.jpeg> (referer: None)
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3eb910>
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2824%252F16772824%252Fdocs_service_history-1774698551337.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D25af706628748e5b765aabcebde8d99b') HTTP/1.1" 204 0
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2824/16772824/docs_service_history-1774698551337.jpg?ixlib=js-3.8.0&auto=format&s=25af706628748e5b765aabcebde8d99b saved to cache
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec796279-eef3-5ce5-ad1f-9cebb31be076
2026-03-29 20:07:43 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:43 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:43 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x01\n,\x0e\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07h\xd9\x01\n!\x8e\x00\x00\x00\x00'
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da59950>
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8404%252F20158404%252Finterior_rear_seats-1773062276928.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8404/20158404/interior_rear_seats-1773062276928.jpeg saved to cache
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9384f570-0a6f-5529-b6db-f87e678ea572
2026-03-29 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20414483.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20269831.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_front_driver-1774695093983.jpg> (referer: None)
2026-03-29 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_rear_passenger-1774695142560.jpg> (referer: None)
2026-03-29 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_rear_driver-1774695120900.jpg> (referer: None)
2026-03-29 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2824/16772824/instrument_cluster-1774695673204.jpg> (referer: None)
2026-03-29 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2824/16772824/interior_boot-1774695711579.jpg> (referer: None)
2026-03-29 20:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96387454-e571-566f-bbd1-f47ed4b43e5b with identifier: 20414483
2026-03-29 20:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96387454-e571-566f-bbd1-f47ed4b43e5b with scrape type 1
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96387454-e571-566f-bbd1-f47ed4b43e5b
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4483%252F20414483%252Fexterior_front_driver-1774628525191.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_front_driver-1774628525191.jpg not downloaded yet
2026-03-29 20:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9dd7686-3f84-5234-8fb1-31ed3da7eae6 with identifier: 20269831
2026-03-29 20:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6 with scrape type 1
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9831%252F20269831%252Fexterior_front_driver-1774628910099.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_front_driver-1774628910099.jpg not downloaded yet
2026-03-29 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2824/16772824/interior_rear_seats-1774695628324.jpg> (referer: None)
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4483%252F20414483%252Fexterior_rear_driver-1774628526924.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_rear_driver-1774628526924.jpg not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9831%252F20269831%252Fexterior_rear_driver-1774628925196.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_rear_driver-1774628925196.jpg not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4483%252F20414483%252Fexterior_front_passenger-1774628525272.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_front_passenger-1774628525272.jpg not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9831%252F20269831%252Fexterior_front_passenger-1774628968444.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_front_passenger-1774628968444.jpg not downloaded yet
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f3550b190>
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2824%252F16772824%252Fexterior_front_driver-1774695093983.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_front_driver-1774695093983.jpg saved to cache
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec796279-eef3-5ce5-ad1f-9cebb31be076
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4a8a90>
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2824%252F16772824%252Fexterior_rear_passenger-1774695142560.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_rear_passenger-1774695142560.jpg saved to cache
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec796279-eef3-5ce5-ad1f-9cebb31be076
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d98f950>
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2824%252F16772824%252Fexterior_rear_driver-1774695120900.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_rear_driver-1774695120900.jpg saved to cache
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec796279-eef3-5ce5-ad1f-9cebb31be076
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5fbfd0>
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2824%252F16772824%252Finstrument_cluster-1774695673204.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2824/16772824/instrument_cluster-1774695673204.jpg saved to cache
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec796279-eef3-5ce5-ad1f-9cebb31be076
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd03790>
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2824%252F16772824%252Finterior_boot-1774695711579.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2824/16772824/interior_boot-1774695711579.jpg saved to cache
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec796279-eef3-5ce5-ad1f-9cebb31be076
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4483%252F20414483%252Fexterior_rear_passenger-1774628524000.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_rear_passenger-1774628524000.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9831%252F20269831%252Fexterior_rear_passenger-1774628942217.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_rear_passenger-1774628942217.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4483%252F20414483%252Finterior_front_seats-1774631191256.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4483/20414483/interior_front_seats-1774631191256.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9831%252F20269831%252Finterior_front_seats-1774630343998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9831/20269831/interior_front_seats-1774630343998.jpg not downloaded yet
2026-03-29 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=468&page=13&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d63df50>
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2824%252F16772824%252Finterior_rear_seats-1774695628324.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2824/16772824/interior_rear_seats-1774695628324.jpg saved to cache
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec796279-eef3-5ce5-ad1f-9cebb31be076
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4483%252F20414483%252Finterior_rear_seats-1774631190445.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4483/20414483/interior_rear_seats-1774631190445.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9831%252F20269831%252Finterior_rear_seats-1774630464242.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9831/20269831/interior_rear_seats-1774630464242.jpg not downloaded yet
2026-03-29 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488534.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20484735.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 20462264
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 20078752
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720078752%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [motorway.uk] INFO: Scrape type for 20078752: 1
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4483%252F20414483%252Finterior_dashboard-1774631232097.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4483/20414483/interior_dashboard-1774631232097.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9831%252F20269831%252Finterior_dashboard-1774630478877.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9831/20269831/interior_dashboard-1774630478877.jpg not downloaded yet
2026-03-29 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20265542.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 20484739
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484739%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [motorway.uk] INFO: Scrape type for 20484739: 1
2026-03-29 20:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4483%252F20414483%252Finterior_boot-1774631193567.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4483/20414483/interior_boot-1774631193567.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9831%252F20269831%252Finstrument_cluster-1774630637384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9831/20269831/instrument_cluster-1774630637384.jpg not downloaded yet
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 20424839
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 16384485
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 19642157
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 18664090
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 19912374
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 20481823
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 10709908
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 20486849
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486849%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [motorway.uk] INFO: Scrape type for 20486849: 1
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4483%252F20414483%252Fdocs_service_history-1774631348200.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd8cf39e245b43f7662cceaf2ee88e9b2%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4483/20414483/docs_service_history-1774631348200.jpg?ixlib=js-3.8.0&auto=format&s=d8cf39e245b43f7662cceaf2ee88e9b2 not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9831%252F20269831%252Finterior_boot-1774630483690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9831/20269831/interior_boot-1774630483690.jpg not downloaded yet
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 20467542
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 17665821
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 2147652
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 20382820
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 20413228
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 20369309
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 20039478
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 18265628
2026-03-29 20:07:44 [motorway.uk] INFO: Found listing with ID: 20220021
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720220021%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [motorway.uk] INFO: Scrape type for 20220021: 1
2026-03-29 20:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa0f667c-ec56-5c65-926a-65b70fc3f2db with identifier: 20488534
2026-03-29 20:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa0f667c-ec56-5c65-926a-65b70fc3f2db with scrape type 1
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa0f667c-ec56-5c65-926a-65b70fc3f2db
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8534%252F20488534%252Fexterior_front_driver-1774717325298.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8534/20488534/exterior_front_driver-1774717325298.jpg not downloaded yet
2026-03-29 20:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c21ce58-70e4-5332-affc-7a53aabed4f0 with identifier: 20484735
2026-03-29 20:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c21ce58-70e4-5332-affc-7a53aabed4f0 with scrape type 1
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c21ce58-70e4-5332-affc-7a53aabed4f0
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4735%252F20484735%252Fexterior_front_driver-1774692690484.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_front_driver-1774692690484.jpg not downloaded yet
2026-03-29 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2824/16772824/interior_dashboard-1774695678525.jpg> (referer: None)
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4483%252F20414483%252Fdocs_service_history-1774631362695.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D50d87d0c3177fa9125e5b1e4a79815b7%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4483/20414483/docs_service_history-1774631362695.jpg?ixlib=js-3.8.0&auto=format&s=50d87d0c3177fa9125e5b1e4a79815b7 not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9831%252F20269831%252Fdocs_service_history-1774630412975.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dca2cd1aa91c4a511d5c129f47325765c%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9831/20269831/docs_service_history-1774630412975.jpg?ixlib=js-3.8.0&auto=format&s=ca2cd1aa91c4a511d5c129f47325765c not downloaded yet
2026-03-29 20:07:45 [motorway.uk] INFO: Found listing with ID: 20487110
2026-03-29 20:07:45 [motorway.uk] INFO: Found listing with ID: 18634459
2026-03-29 20:07:45 [motorway.uk] INFO: Found listing with ID: 11969339
2026-03-29 20:07:45 [motorway.uk] INFO: Found listing with ID: 20487185
2026-03-29 20:07:45 [motorway.uk] INFO: Found listing with ID: 18469041
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718469041%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [motorway.uk] INFO: Scrape type for 18469041: 1
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8534%252F20488534%252Fexterior_rear_driver-1774717364504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8534/20488534/exterior_rear_driver-1774717364504.jpg not downloaded yet
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4735%252F20484735%252Fexterior_rear_driver-1774692694832.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_rear_driver-1774692694832.jpg not downloaded yet
2026-03-29 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20458519.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83 with identifier: 20265542
2026-03-29 20:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83 with scrape type 1
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5542%252F20265542%252Fexterior_front_driver-1774706513036.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5542/20265542/exterior_front_driver-1774706513036.jpg not downloaded yet
2026-03-29 20:07:45 [motorway.uk] INFO: Found listing with ID: 20456356
2026-03-29 20:07:45 [motorway.uk] INFO: Found listing with ID: 18709305
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718709305%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [motorway.uk] INFO: Scrape type for 18709305: 1
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8534%252F20488534%252Fexterior_front_passenger-1774777863437.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8534/20488534/exterior_front_passenger-1774777863437.jpg not downloaded yet
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4735%252F20484735%252Fexterior_front_passenger-1774692689763.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_front_passenger-1774692689763.jpg not downloaded yet
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5542%252F20265542%252Fexterior_rear_driver-1774706515527.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5542/20265542/exterior_rear_driver-1774706515527.jpg not downloaded yet
2026-03-29 20:07:45 [motorway.uk] INFO: Found listing with ID: 20490237
2026-03-29 20:07:45 [motorway.uk] INFO: Found listing with ID: 19442969
2026-03-29 20:07:45 [motorway.uk] INFO: Found listing with ID: 20171226
2026-03-29 20:07:45 [motorway.uk] INFO: Found listing with ID: 18254903
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718254903%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [motorway.uk] INFO: Scrape type for 18254903: 1
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8534%252F20488534%252Fexterior_rear_passenger-1774717381404.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8534/20488534/exterior_rear_passenger-1774717381404.jpg not downloaded yet
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4735%252F20484735%252Fexterior_rear_passenger-1774692685894.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_rear_passenger-1774692685894.jpg not downloaded yet
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5542%252F20265542%252Fexterior_front_passenger-1774712531736.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5542/20265542/exterior_front_passenger-1774712531736.jpg not downloaded yet
2026-03-29 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddb3fd0>
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2824%252F16772824%252Finterior_dashboard-1774695678525.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2824/16772824/interior_dashboard-1774695678525.jpg saved to cache
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec796279-eef3-5ce5-ad1f-9cebb31be076
2026-03-29 20:07:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec796279-eef3-5ce5-ad1f-9cebb31be076, skipping ID generation
2026-03-29 20:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec796279-eef3-5ce5-ad1f-9cebb31be076 with scrape type 1
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec796279-eef3-5ce5-ad1f-9cebb31be076 sending to next pipeline
2026-03-29 20:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ec796279-eef3-5ce5-ad1f-9cebb31be076, identifier: 16772824
2026-03-29 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_rear_passenger-1774628524000.jpg> (referer: None)
2026-03-29 20:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ec796279-eef3-5ce5-ad1f-9cebb31be076 with identifier: 16772824
2026-03-29 20:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ec796279-eef3-5ce5-ad1f-9cebb31be076 with identifier: 16772824
2026-03-29 20:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ec796279-eef3-5ce5-ad1f-9cebb31be076 with identifier: 16772824 to the API
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2824/16772824/interior_dashboard-1774695678525.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ec796279-eef3-5ce5-ad1f-9cebb31be076',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK18 UJZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16772824',
'listing': 'auction',
'location': 'South Yorkshire Sheffield',
'make': 'Ford',
'model': 'Kuga',
'odometer': 65000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1885895,
'Height': 2588,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_front_driver-1774695093983.jpg',
'Width': 3451},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1631873,
'Height': 2581,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_rear_driver-1774695120900.jpg',
'Width': 3441},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2438666,
'Height': 2840,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_front_passenger-1774695161412.jpg',
'Width': 3786},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1336762,
'Height': 2231,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2824/16772824/exterior_rear_passenger-1774695142560.jpg',
'Width': 2974},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3215174,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2824/16772824/interior_front_seats-1774695588685.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2836251,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2824/16772824/interior_rear_seats-1774695628324.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3369789,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2824/16772824/interior_dashboard-1774695678525.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2675355,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2824/16772824/instrument_cluster-1774695673204.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2881655,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2824/16772824/interior_boot-1774695711579.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec796279-eef3-5ce5-ad1f-9cebb31be076/ec796279-eef3-5ce5-ad1f-9cebb31be076_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673307,
'Height': 4182,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2824/16772824/docs_service_history-1774698551337.jpg?ixlib=js-3.8.0&auto=format&s=25af706628748e5b765aabcebde8d99b',
'Width': 2857}],
'price': 11097,
'price_includes_vat': False,
'registration_date': '2018-03-28',
'seats_number': None,
'seller_name': None,
'title': 'Ford Kuga ST-LINE X TDCI 4X4 Auto',
'transmission': 'automatic',
'trim': 'ST-LINE X TDCI 4X4 Auto',
'vin': 'WF0AXXWPMAJS47829',
'year': 2018}
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716772824%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [motorway.uk] INFO: Saving data for 16772824: {'created_time': 1774814866.112574, 'last_price_update_time': 1774814866.112584, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16772824') HTTP/1.1" 204 0
2026-03-29 20:07:46 [motorway.uk] INFO: Found listing with ID: 9247330
2026-03-29 20:07:46 [motorway.uk] INFO: Found listing with ID: 20221098
2026-03-29 20:07:46 [motorway.uk] INFO: Found listing with ID: 20269740
2026-03-29 20:07:46 [motorway.uk] INFO: Found listing with ID: 20454557
2026-03-29 20:07:46 [motorway.uk] INFO: Found listing with ID: 18587365
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8534%252F20488534%252Finterior_front_seats-1774718111439.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8534/20488534/interior_front_seats-1774718111439.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4735%252F20484735%252Finterior_front_seats-1774694311550.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4735/20484735/interior_front_seats-1774694311550.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5542%252F20265542%252Fexterior_rear_passenger-1774706512401.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5542/20265542/exterior_rear_passenger-1774706512401.jpg not downloaded yet
2026-03-29 20:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9 with identifier: 20458519
2026-03-29 20:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9 with scrape type 1
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F20458519%252Fexterior_front_driver-1774635383778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/20458519/exterior_front_driver-1774635383778.jpg not downloaded yet
2026-03-29 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_front_passenger-1774628525272.jpg> (referer: None)
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8534%252F20488534%252Finterior_rear_seats-1774718127352.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8534/20488534/interior_rear_seats-1774718127352.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4735%252F20484735%252Finterior_rear_seats-1774694314086.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4735/20484735/interior_rear_seats-1774694314086.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5542%252F20265542%252Finterior_front_seats-1774707276174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5542/20265542/interior_front_seats-1774707276174.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F20458519%252Fexterior_rear_driver-1774635053511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/20458519/exterior_rear_driver-1774635053511.jpg not downloaded yet
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c74c310>
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4483%252F20414483%252Fexterior_rear_passenger-1774628524000.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_rear_passenger-1774628524000.jpg saved to cache
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96387454-e571-566f-bbd1-f47ed4b43e5b
2026-03-29 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5001/20485001/instrument_cluster-1774693761110.jpg> (referer: None)
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8534%252F20488534%252Finterior_dashboard-1774718217822.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8534/20488534/interior_dashboard-1774718217822.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4735%252F20484735%252Finterior_dashboard-1774694326524.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4735/20484735/interior_dashboard-1774694326524.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5542%252F20265542%252Finterior_rear_seats-1774707274768.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5542/20265542/interior_rear_seats-1774707274768.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F20458519%252Fexterior_front_passenger-1774635392383.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/20458519/exterior_front_passenger-1774635392383.jpg not downloaded yet
2026-03-29 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9750/20459750/exterior_front_passenger-1774703375193.jpg> (referer: None)
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca3a590>
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4483%252F20414483%252Fexterior_front_passenger-1774628525272.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_front_passenger-1774628525272.jpg saved to cache
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96387454-e571-566f-bbd1-f47ed4b43e5b
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8534%252F20488534%252Finstrument_cluster-1774718195353.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8534/20488534/instrument_cluster-1774718195353.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4735%252F20484735%252Finterior_boot-1774694309274.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4735/20484735/interior_boot-1774694309274.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5542%252F20265542%252Finterior_dashboard-1774711929179.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5542/20265542/interior_dashboard-1774711929179.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8519%252F20458519%252Fexterior_rear_passenger-1774638189445.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8519/20458519/exterior_rear_passenger-1774638189445.jpg not downloaded yet
2026-03-29 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19370782.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13358851.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8534%252F20488534%252Finterior_boot-1774718179483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8534/20488534/interior_boot-1774718179483.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4735%252F20484735%252Fdocs_service_history-1774694672646.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D86932eacb89c62581655b3b79fa34611%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4735/20484735/docs_service_history-1774694672646.jpg?ixlib=js-3.8.0&auto=format&s=86932eacb89c62581655b3b79fa34611 not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5542%252F20265542%252Finterior_boot-1774707273610.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5542/20265542/interior_boot-1774707273610.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8519%252F20458519%252Finterior_front_seats-1774637659143.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8519/20458519/interior_front_seats-1774637659143.jpg not downloaded yet
2026-03-29 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19750033.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5f5e50>
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5001%252F20485001%252Finstrument_cluster-1774693761110.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5001/20485001/instrument_cluster-1774693761110.jpg saved to cache
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8534%252F20488534%252Fdocs_service_history-1774718456256.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2d00a7802f43df063b3466c96beb107c%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8534/20488534/docs_service_history-1774718456256.jpg?ixlib=js-3.8.0&auto=format&s=2d00a7802f43df063b3466c96beb107c not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4735%252F20484735%252Fdocs_service_history-1774694714638.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D486b8223d172f19ad63eab932abfedf1%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4735/20484735/docs_service_history-1774694714638.jpg?ixlib=js-3.8.0&auto=format&s=486b8223d172f19ad63eab932abfedf1 not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5542%252F20265542%252Fdocs_service_history-1774712232048.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D43ce73e4d0ee4a3d3dc69eaf2599f0ab%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5542/20265542/docs_service_history-1774712232048.jpg?ixlib=js-3.8.0&auto=format&s=43ce73e4d0ee4a3d3dc69eaf2599f0ab not downloaded yet
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8519%252F20458519%252Finterior_rear_seats-1774636718935.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8519/20458519/interior_rear_seats-1774636718935.jpg not downloaded yet
2026-03-29 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9831/20269831/interior_rear_seats-1774630464242.jpg> (referer: None)
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db27c90>
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9750%252F20459750%252Fexterior_front_passenger-1774703375193.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9750/20459750/exterior_front_passenger-1774703375193.jpg saved to cache
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077
2026-03-29 20:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f8a19d2-fea0-526d-ae28-7530f5300e8b with identifier: 19370782
2026-03-29 20:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f8a19d2-fea0-526d-ae28-7530f5300e8b with scrape type 1
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f8a19d2-fea0-526d-ae28-7530f5300e8b
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0782%252F19370782%252Fexterior_front_driver-1772121787045.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0782/19370782/exterior_front_driver-1772121787045.jpg already downloaded
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0782%252F19370782%252Fexterior_rear_driver-1772121801308.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0782/19370782/exterior_rear_driver-1772121801308.jpg already downloaded
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0782%252F19370782%252Fexterior_front_passenger-1772121830485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0782/19370782/exterior_front_passenger-1772121830485.jpg already downloaded
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0782%252F19370782%252Fexterior_rear_passenger-1772121805879.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0782/19370782/exterior_rear_passenger-1772121805879.jpg already downloaded
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0782%252F19370782%252Finterior_front_seats-1772122313140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0782/19370782/interior_front_seats-1772122313140.jpg already downloaded
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0782%252F19370782%252Finterior_rear_seats-1772122323259.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0782/19370782/interior_rear_seats-1772122323259.jpg already downloaded
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0782%252F19370782%252Finterior_dashboard-1772194466728.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0782/19370782/interior_dashboard-1772194466728.jpg already downloaded
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0782%252F19370782%252Finterior_boot-1772122375339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0782/19370782/interior_boot-1772122375339.jpg already downloaded
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0782%252F19370782%252Fdamage_scratches-1772121905284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0782/19370782/damage_scratches-1772121905284.jpg already downloaded
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0782%252F19370782%252Fdamage_scratches-1772121927566.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0782/19370782/damage_scratches-1772121927566.jpg already downloaded
2026-03-29 20:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4f8a19d2-fea0-526d-ae28-7530f5300e8b, identifier: 19370782
2026-03-29 20:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 291ae947-e211-59a5-83ec-0b5b1dae7204 with identifier: 13358851
2026-03-29 20:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 291ae947-e211-59a5-83ec-0b5b1dae7204 with scrape type 1
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 291ae947-e211-59a5-83ec-0b5b1dae7204
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8851%252F13358851%252Fexterior_front_driver-1774699337147.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_front_driver-1774699337147.jpg not downloaded yet
2026-03-29 20:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eed10824-8bae-55aa-be44-30e048d3fa93 with identifier: 19750033
2026-03-29 20:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eed10824-8bae-55aa-be44-30e048d3fa93 with scrape type 1
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eed10824-8bae-55aa-be44-30e048d3fa93
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Fexterior_front_driver-1774106757009.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/exterior_front_driver-1774106757009.jpg not downloaded yet
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5542%252F20265542%252Fdamage_scratches-1774706619193.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5542/20265542/damage_scratches-1774706619193.jpg not downloaded yet
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8519%252F20458519%252Finterior_dashboard-1774637720235.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8519/20458519/interior_dashboard-1774637720235.jpg not downloaded yet
2026-03-29 20:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4f8a19d2-fea0-526d-ae28-7530f5300e8b with identifier: 19370782
2026-03-29 20:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4f8a19d2-fea0-526d-ae28-7530f5300e8b with identifier: 19370782
2026-03-29 20:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4f8a19d2-fea0-526d-ae28-7530f5300e8b with identifier: 19370782 to the API
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19370782.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '4f8a19d2-fea0-526d-ae28-7530f5300e8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KJ23 AYF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19370782',
'listing': 'auction',
'location': 'Greater London Wembley',
'make': 'Mercedes',
'model': 'C Class',
'odometer': 34666,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/0782/19370782/exterior_front_driver-1772121787045.jpg',
'https://motorway-photos-redacted.imgix.net/0782/19370782/exterior_rear_driver-1772121801308.jpg',
'https://motorway-photos-redacted.imgix.net/0782/19370782/exterior_front_passenger-1772121830485.jpg',
'https://motorway-photos-redacted.imgix.net/0782/19370782/exterior_rear_passenger-1772121805879.jpg',
'https://motorway-photos.imgix.net/0782/19370782/interior_front_seats-1772122313140.jpg',
'https://motorway-photos.imgix.net/0782/19370782/interior_rear_seats-1772122323259.jpg',
'https://motorway-photos-modified.imgix.net/0782/19370782/interior_dashboard-1772194466728.jpg',
'https://motorway-photos.imgix.net/0782/19370782/interior_boot-1772122375339.jpg',
'https://motorway-photos.imgix.net/0782/19370782/damage_scratches-1772121905284.jpg',
'https://motorway-photos.imgix.net/0782/19370782/damage_scratches-1772121927566.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb61433-c016-5f10-86e2-39cd2d854fe3/edb61433-c016-5f10-86e2-39cd2d854fe3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 889440,
'Height': 1786,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0782/19370782/exterior_front_driver-1772121787045.jpg',
'Width': 2381},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb61433-c016-5f10-86e2-39cd2d854fe3/edb61433-c016-5f10-86e2-39cd2d854fe3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516088,
'Height': 1499,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0782/19370782/exterior_rear_driver-1772121801308.jpg',
'Width': 1998},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb61433-c016-5f10-86e2-39cd2d854fe3/edb61433-c016-5f10-86e2-39cd2d854fe3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521039,
'Height': 1389,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0782/19370782/exterior_front_passenger-1772121830485.jpg',
'Width': 1852},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb61433-c016-5f10-86e2-39cd2d854fe3/edb61433-c016-5f10-86e2-39cd2d854fe3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523623,
'Height': 1450,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0782/19370782/exterior_rear_passenger-1772121805879.jpg',
'Width': 1933},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb61433-c016-5f10-86e2-39cd2d854fe3/edb61433-c016-5f10-86e2-39cd2d854fe3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3451642,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0782/19370782/interior_front_seats-1772122313140.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb61433-c016-5f10-86e2-39cd2d854fe3/edb61433-c016-5f10-86e2-39cd2d854fe3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3287466,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0782/19370782/interior_rear_seats-1772122323259.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb61433-c016-5f10-86e2-39cd2d854fe3/edb61433-c016-5f10-86e2-39cd2d854fe3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1904133,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0782/19370782/interior_dashboard-1772194466728.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb61433-c016-5f10-86e2-39cd2d854fe3/edb61433-c016-5f10-86e2-39cd2d854fe3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3767233,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0782/19370782/interior_boot-1772122375339.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb61433-c016-5f10-86e2-39cd2d854fe3/edb61433-c016-5f10-86e2-39cd2d854fe3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3048680,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0782/19370782/damage_scratches-1772121905284.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb61433-c016-5f10-86e2-39cd2d854fe3/edb61433-c016-5f10-86e2-39cd2d854fe3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2549007,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0782/19370782/damage_scratches-1772121927566.jpg',
'Width': 4032}],
'price': 21436,
'price_includes_vat': False,
'registration_date': '2023-07-21',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes C 200 AMG Line MHEV Auto',
'transmission': 'automatic',
'trim': 'C 200 AMG Line MHEV Auto',
'vin': 'W1KAF4CB9PR127266',
'year': 2023}
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719370782%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [motorway.uk] INFO: Saving data for 19370782: {'created_time': 1774814867.935347, 'last_price_update_time': 1774814867.935359, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19370782') HTTP/1.1" 204 0
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8851%252F13358851%252Fexterior_rear_driver-1774699354902.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_rear_driver-1774699354902.jpg not downloaded yet
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Fexterior_rear_driver-1774107307175.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/exterior_rear_driver-1774107307175.jpg not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8519%252F20458519%252Finterior_boot-1774636906553.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8519/20458519/interior_boot-1774636906553.jpg not downloaded yet
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d28d350>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9831%252F20269831%252Finterior_rear_seats-1774630464242.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9831/20269831/interior_rear_seats-1774630464242.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4483/20414483/interior_rear_seats-1774631190445.jpg> (referer: None)
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8851%252F13358851%252Fexterior_front_passenger-1774699380203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_front_passenger-1774699380203.jpg not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Fexterior_front_passenger-1774107332020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/exterior_front_passenger-1774107332020.jpg not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8519%252F20458519%252Fdocs_service_history-1774637066882.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2cc2d0e8a774bf85fd89b074212dd7bb%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8519/20458519/docs_service_history-1774637066882.jpg?ixlib=js-3.8.0&auto=format&s=2cc2d0e8a774bf85fd89b074212dd7bb not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8851%252F13358851%252Fexterior_rear_passenger-1774699365328.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_rear_passenger-1774699365328.jpg not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Fexterior_rear_passenger-1774107349070.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/exterior_rear_passenger-1774107349070.jpg not downloaded yet
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8920/20468920/exterior_front_passenger-1774606802306.jpg> (referer: None)
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F20458519%252Fwheels_front_driver-1774635421336.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/20458519/wheels_front_driver-1774635421336.jpg not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8851%252F13358851%252Finterior_front_seats-1774699621575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8851/13358851/interior_front_seats-1774699621575.jpg not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0033%252F19750033%252Finterior_front_seats-1774104541435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0033/19750033/interior_front_seats-1774104541435.jpg not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8851%252F13358851%252Finterior_dashboard-1774699653616.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8851/13358851/interior_dashboard-1774699653616.jpg not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Finterior_dashboard-1774107367849.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/interior_dashboard-1774107367849.jpg not downloaded yet
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d053c90>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4483%252F20414483%252Finterior_rear_seats-1774631190445.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4483/20414483/interior_rear_seats-1774631190445.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96387454-e571-566f-bbd1-f47ed4b43e5b
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8851%252F13358851%252Finstrument_cluster-1774699733063.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8851/13358851/instrument_cluster-1774699733063.jpg not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Finterior_boot-1774107379005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/interior_boot-1774107379005.jpg not downloaded yet
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_front_passenger-1774628968444.jpg> (referer: None)
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8851%252F13358851%252Finterior_boot-1774699654901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8851/13358851/interior_boot-1774699654901.jpg not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0033%252F19750033%252Fdocs_service_history-1774104749639.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9dfb42b0236b3298e82439fd2dc7ce6a%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0033/19750033/docs_service_history-1774104749639.jpg?ixlib=js-3.8.0&auto=format&s=9dfb42b0236b3298e82439fd2dc7ce6a not downloaded yet
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d050850>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8920%252F20468920%252Fexterior_front_passenger-1774606802306.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8920/20468920/exterior_front_passenger-1774606802306.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8851%252F13358851%252Fdocs_service_history-1774699949786.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ccc1a49194dcc1f42c7aead6f6d474c%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8851/13358851/docs_service_history-1774699949786.jpg?ixlib=js-3.8.0&auto=format&s=3ccc1a49194dcc1f42c7aead6f6d474c not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Fdamage_scratches-1774106532420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/damage_scratches-1774106532420.jpg not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8851%252F13358851%252Fdocs_service_history-1774699949920.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9d84eee57a07980d1f7727f8ca3b3dde%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8851/13358851/docs_service_history-1774699949920.jpg?ixlib=js-3.8.0&auto=format&s=9d84eee57a07980d1f7727f8ca3b3dde not downloaded yet
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Fdamage_scratches-1774106630569.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/damage_scratches-1774106630569.jpg not downloaded yet
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d59f2d0>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9831%252F20269831%252Fexterior_front_passenger-1774628968444.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_front_passenger-1774628968444.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_rear_driver-1774628925196.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_rear_passenger-1774628942217.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/5542/20265542/docs_service_history-1774712232048.jpg?ixlib=js-3.8.0&auto=format&s=43ce73e4d0ee4a3d3dc69eaf2599f0ab> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5542/20265542/damage_scratches-1774706619193.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8519/20458519/interior_dashboard-1774637720235.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0033/19750033/exterior_rear_driver-1774107307175.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0033/19750033/exterior_front_passenger-1774107332020.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0033/19750033/damage_scratches-1774106630569.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8519/20458519/interior_boot-1774636906553.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0033/19750033/exterior_front_driver-1774106757009.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_front_passenger-1774699380203.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_rear_driver-1774699354902.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_front_driver-1774699337147.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8519/20458519/interior_rear_seats-1774636718935.jpg> (referer: None)
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d89d890>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9831%252F20269831%252Fexterior_rear_driver-1774628925196.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_rear_driver-1774628925196.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb7d850>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9831%252F20269831%252Fexterior_rear_passenger-1774628942217.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_rear_passenger-1774628942217.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd400d0>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5542%252F20265542%252Fdocs_service_history-1774712232048.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D43ce73e4d0ee4a3d3dc69eaf2599f0ab') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5542/20265542/docs_service_history-1774712232048.jpg?ixlib=js-3.8.0&auto=format&s=43ce73e4d0ee4a3d3dc69eaf2599f0ab saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce8e710>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5542%252F20265542%252Fdamage_scratches-1774706619193.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5542/20265542/damage_scratches-1774706619193.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d144410>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8519%252F20458519%252Finterior_dashboard-1774637720235.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8519/20458519/interior_dashboard-1774637720235.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce8c390>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Fexterior_rear_driver-1774107307175.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/exterior_rear_driver-1774107307175.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eed10824-8bae-55aa-be44-30e048d3fa93
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd41c90>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Fexterior_front_passenger-1774107332020.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/exterior_front_passenger-1774107332020.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eed10824-8bae-55aa-be44-30e048d3fa93
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5f7f10>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Fdamage_scratches-1774106630569.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/damage_scratches-1774106630569.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eed10824-8bae-55aa-be44-30e048d3fa93
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce8fc90>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8519%252F20458519%252Finterior_boot-1774636906553.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8519/20458519/interior_boot-1774636906553.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5557d0>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Fexterior_front_driver-1774106757009.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/exterior_front_driver-1774106757009.jpg saved to cache
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eed10824-8bae-55aa-be44-30e048d3fa93
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd425d0>
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8851%252F13358851%252Fexterior_front_passenger-1774699380203.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_front_passenger-1774699380203.jpg saved to cache
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 291ae947-e211-59a5-83ec-0b5b1dae7204
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5f4750>
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8851%252F13358851%252Fexterior_rear_driver-1774699354902.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_rear_driver-1774699354902.jpg saved to cache
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 291ae947-e211-59a5-83ec-0b5b1dae7204
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cebee10>
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8851%252F13358851%252Fexterior_front_driver-1774699337147.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_front_driver-1774699337147.jpg saved to cache
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 291ae947-e211-59a5-83ec-0b5b1dae7204
2026-03-29 20:07:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:07:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d555f90>
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8519%252F20458519%252Finterior_rear_seats-1774636718935.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8519/20458519/interior_rear_seats-1774636718935.jpg saved to cache
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9
2026-03-29 20:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0033/19750033/docs_service_history-1774104749639.jpg?ixlib=js-3.8.0&auto=format&s=9dfb42b0236b3298e82439fd2dc7ce6a> (referer: None)
2026-03-29 20:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8851/13358851/docs_service_history-1774699949920.jpg?ixlib=js-3.8.0&auto=format&s=9d84eee57a07980d1f7727f8ca3b3dde> (referer: None)
2026-03-29 20:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8851/13358851/interior_boot-1774699654901.jpg> (referer: None)
2026-03-29 20:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0033/19750033/damage_scratches-1774106532420.jpg> (referer: None)
2026-03-29 20:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0033/19750033/interior_boot-1774107379005.jpg> (referer: None)
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f622350>
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0033%252F19750033%252Fdocs_service_history-1774104749639.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9dfb42b0236b3298e82439fd2dc7ce6a') HTTP/1.1" 204 0
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0033/19750033/docs_service_history-1774104749639.jpg?ixlib=js-3.8.0&auto=format&s=9dfb42b0236b3298e82439fd2dc7ce6a saved to cache
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eed10824-8bae-55aa-be44-30e048d3fa93
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f35cb10>
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8851%252F13358851%252Fdocs_service_history-1774699949920.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9d84eee57a07980d1f7727f8ca3b3dde') HTTP/1.1" 204 0
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8851/13358851/docs_service_history-1774699949920.jpg?ixlib=js-3.8.0&auto=format&s=9d84eee57a07980d1f7727f8ca3b3dde saved to cache
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 291ae947-e211-59a5-83ec-0b5b1dae7204
2026-03-29 20:07:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f20e1d0>
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8851%252F13358851%252Finterior_boot-1774699654901.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8851/13358851/interior_boot-1774699654901.jpg saved to cache
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 291ae947-e211-59a5-83ec-0b5b1dae7204
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f35f990>
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Fdamage_scratches-1774106532420.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/damage_scratches-1774106532420.jpg saved to cache
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eed10824-8bae-55aa-be44-30e048d3fa93
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f20c490>
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Finterior_boot-1774107379005.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/interior_boot-1774107379005.jpg saved to cache
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eed10824-8bae-55aa-be44-30e048d3fa93
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20078752.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8519/20458519/docs_service_history-1774637066882.jpg?ixlib=js-3.8.0&auto=format&s=2cc2d0e8a774bf85fd89b074212dd7bb> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8534/20488534/docs_service_history-1774718456256.jpg?ixlib=js-3.8.0&auto=format&s=2d00a7802f43df063b3466c96beb107c> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8851/13358851/docs_service_history-1774699949786.jpg?ixlib=js-3.8.0&auto=format&s=3ccc1a49194dcc1f42c7aead6f6d474c> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8519/20458519/wheels_front_driver-1774635421336.jpg> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0033/19750033/exterior_rear_passenger-1774107349070.jpg> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0033/19750033/interior_dashboard-1774107367849.jpg> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8519/20458519/interior_front_seats-1774637659143.jpg> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4735/20484735/docs_service_history-1774694714638.jpg?ixlib=js-3.8.0&auto=format&s=486b8223d172f19ad63eab932abfedf1> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_rear_passenger-1774699365328.jpg> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4735/20484735/docs_service_history-1774694672646.jpg?ixlib=js-3.8.0&auto=format&s=86932eacb89c62581655b3b79fa34611> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0033/19750033/interior_front_seats-1774104541435.jpg> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5542/20265542/interior_boot-1774707273610.jpg> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8851/13358851/interior_dashboard-1774699653616.jpg> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8851/13358851/interior_front_seats-1774699621575.jpg> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8851/13358851/instrument_cluster-1774699733063.jpg> (referer: None)
2026-03-29 20:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b1a95e-ea41-5fb8-80ac-42f1002b21cc with identifier: 20078752
2026-03-29 20:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc with scrape type 1
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8752%252F20078752%252Fexterior_front_driver-1774714366494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8752/20078752/exterior_front_driver-1774714366494.jpg not downloaded yet
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8752%252F20078752%252Fexterior_rear_driver-1774714345382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8752/20078752/exterior_rear_driver-1774714345382.jpg not downloaded yet
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8752%252F20078752%252Fexterior_front_passenger-1774716635415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8752/20078752/exterior_front_passenger-1774716635415.jpg not downloaded yet
2026-03-29 20:07:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd28e10>
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8519%252F20458519%252Fdocs_service_history-1774637066882.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2cc2d0e8a774bf85fd89b074212dd7bb') HTTP/1.1" 204 0
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8519/20458519/docs_service_history-1774637066882.jpg?ixlib=js-3.8.0&auto=format&s=2cc2d0e8a774bf85fd89b074212dd7bb saved to cache
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d302690>
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8534%252F20488534%252Fdocs_service_history-1774718456256.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2d00a7802f43df063b3466c96beb107c') HTTP/1.1" 204 0
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8534/20488534/docs_service_history-1774718456256.jpg?ixlib=js-3.8.0&auto=format&s=2d00a7802f43df063b3466c96beb107c saved to cache
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa0f667c-ec56-5c65-926a-65b70fc3f2db
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d7193d0>
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8851%252F13358851%252Fdocs_service_history-1774699949786.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ccc1a49194dcc1f42c7aead6f6d474c') HTTP/1.1" 204 0
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8851/13358851/docs_service_history-1774699949786.jpg?ixlib=js-3.8.0&auto=format&s=3ccc1a49194dcc1f42c7aead6f6d474c saved to cache
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 291ae947-e211-59a5-83ec-0b5b1dae7204
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d303810>
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F20458519%252Fwheels_front_driver-1774635421336.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/20458519/wheels_front_driver-1774635421336.jpg saved to cache
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8752%252F20078752%252Fexterior_rear_passenger-1774716655077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8752/20078752/exterior_rear_passenger-1774716655077.jpg not downloaded yet
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d71a8d0>
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Fexterior_rear_passenger-1774107349070.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/exterior_rear_passenger-1774107349070.jpg saved to cache
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eed10824-8bae-55aa-be44-30e048d3fa93
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2f6910>
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F19750033%252Finterior_dashboard-1774107367849.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/19750033/interior_dashboard-1774107367849.jpg saved to cache
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eed10824-8bae-55aa-be44-30e048d3fa93
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8752%252F20078752%252Finterior_front_seats-1774709549904.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8752/20078752/interior_front_seats-1774709549904.jpg not downloaded yet
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5822d0>
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8519%252F20458519%252Finterior_front_seats-1774637659143.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8519/20458519/interior_front_seats-1774637659143.jpg saved to cache
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c83bcd0>
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4735%252F20484735%252Fdocs_service_history-1774694714638.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D486b8223d172f19ad63eab932abfedf1') HTTP/1.1" 204 0
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4735/20484735/docs_service_history-1774694714638.jpg?ixlib=js-3.8.0&auto=format&s=486b8223d172f19ad63eab932abfedf1 saved to cache
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c21ce58-70e4-5332-affc-7a53aabed4f0
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c769bd0>
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8851%252F13358851%252Fexterior_rear_passenger-1774699365328.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_rear_passenger-1774699365328.jpg saved to cache
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 291ae947-e211-59a5-83ec-0b5b1dae7204
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c83a610>
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4735%252F20484735%252Fdocs_service_history-1774694672646.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D86932eacb89c62581655b3b79fa34611') HTTP/1.1" 204 0
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4735/20484735/docs_service_history-1774694672646.jpg?ixlib=js-3.8.0&auto=format&s=86932eacb89c62581655b3b79fa34611 saved to cache
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c21ce58-70e4-5332-affc-7a53aabed4f0
2026-03-29 20:07:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f292010>
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0033%252F19750033%252Finterior_front_seats-1774104541435.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0033/19750033/interior_front_seats-1774104541435.jpg saved to cache
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eed10824-8bae-55aa-be44-30e048d3fa93
2026-03-29 20:07:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eed10824-8bae-55aa-be44-30e048d3fa93, skipping ID generation
2026-03-29 20:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eed10824-8bae-55aa-be44-30e048d3fa93 with scrape type 1
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eed10824-8bae-55aa-be44-30e048d3fa93 sending to next pipeline
2026-03-29 20:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: eed10824-8bae-55aa-be44-30e048d3fa93, identifier: 19750033
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d525450>
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5542%252F20265542%252Finterior_boot-1774707273610.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5542/20265542/interior_boot-1774707273610.jpg saved to cache
2026-03-29 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da58750>
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8851%252F13358851%252Finterior_dashboard-1774699653616.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8851/13358851/interior_dashboard-1774699653616.jpg saved to cache
2026-03-29 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 291ae947-e211-59a5-83ec-0b5b1dae7204
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d66ba90>
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8851%252F13358851%252Finterior_front_seats-1774699621575.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8851/13358851/interior_front_seats-1774699621575.jpg saved to cache
2026-03-29 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 291ae947-e211-59a5-83ec-0b5b1dae7204
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5f6050>
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8851%252F13358851%252Finstrument_cluster-1774699733063.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8851/13358851/instrument_cluster-1774699733063.jpg saved to cache
2026-03-29 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 291ae947-e211-59a5-83ec-0b5b1dae7204
2026-03-29 20:07:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 291ae947-e211-59a5-83ec-0b5b1dae7204, skipping ID generation
2026-03-29 20:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 291ae947-e211-59a5-83ec-0b5b1dae7204 with scrape type 1
2026-03-29 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 291ae947-e211-59a5-83ec-0b5b1dae7204 sending to next pipeline
2026-03-29 20:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 291ae947-e211-59a5-83ec-0b5b1dae7204, identifier: 13358851
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8752%252F20078752%252Finterior_rear_seats-1774709442900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8752/20078752/interior_rear_seats-1774709442900.jpg not downloaded yet
2026-03-29 20:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: eed10824-8bae-55aa-be44-30e048d3fa93 with identifier: 19750033
2026-03-29 20:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: eed10824-8bae-55aa-be44-30e048d3fa93 with identifier: 19750033
2026-03-29 20:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: eed10824-8bae-55aa-be44-30e048d3fa93 with identifier: 19750033 to the API
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0033/19750033/interior_front_seats-1774104541435.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'eed10824-8bae-55aa-be44-30e048d3fa93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'N999 WFY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19750033',
'listing': 'auction',
'location': 'Blackpool Thornton-Cleveleys',
'make': 'Vauxhall',
'model': 'Vivaro',
'odometer': 62510,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2267681,
'Height': 2647,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0033/19750033/exterior_front_driver-1774106757009.jpg',
'Width': 3529},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1583719,
'Height': 2462,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0033/19750033/exterior_rear_driver-1774107307175.jpg',
'Width': 3283},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1832834,
'Height': 2627,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0033/19750033/exterior_front_passenger-1774107332020.jpg',
'Width': 3503},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1673836,
'Height': 2549,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0033/19750033/exterior_rear_passenger-1774107349070.jpg',
'Width': 3399},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3263805,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0033/19750033/interior_front_seats-1774104541435.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2448037,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0033/19750033/interior_dashboard-1774107367849.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589904,
'Height': 1514,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0033/19750033/interior_boot-1774107379005.jpg',
'Width': 2018},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431140,
'Height': 2683,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0033/19750033/docs_service_history-1774104749639.jpg?ixlib=js-3.8.0&auto=format&s=9dfb42b0236b3298e82439fd2dc7ce6a',
'Width': 1897},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28541,
'Height': 357,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0033/19750033/damage_scratches-1774106532420.jpg',
'Width': 476},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed10824-8bae-55aa-be44-30e048d3fa93/eed10824-8bae-55aa-be44-30e048d3fa93_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8827,
'Height': 192,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0033/19750033/damage_scratches-1774106630569.jpg',
'Width': 256}],
'price': 11654,
'price_includes_vat': False,
'registration_date': '2020-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Vivaro 3100 Dynamic S/S',
'transmission': 'manual',
'trim': '3100 Dynamic S/S',
'vin': 'VXEVFAHKKLZ034569',
'year': 2020}
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719750033%27 HTTP/1.1" 200 None
2026-03-29 20:07:54 [motorway.uk] INFO: Saving data for 19750033: {'created_time': 1774814874.052541, 'last_price_update_time': 1774814874.052552, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19750033') HTTP/1.1" 204 0
2026-03-29 20:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 291ae947-e211-59a5-83ec-0b5b1dae7204 with identifier: 13358851
2026-03-29 20:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 291ae947-e211-59a5-83ec-0b5b1dae7204 with identifier: 13358851
2026-03-29 20:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 291ae947-e211-59a5-83ec-0b5b1dae7204 with identifier: 13358851 to the API
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8851/13358851/instrument_cluster-1774699733063.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '291ae947-e211-59a5-83ec-0b5b1dae7204',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE61 ECZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13358851',
'listing': 'auction',
'location': 'Buckinghamshire Newport Pagnell',
'make': 'Porsche',
'model': 'Boxster',
'odometer': 31823,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2302246,
'Height': 2719,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_front_driver-1774699337147.jpg',
'Width': 3625},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2162551,
'Height': 2570,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_rear_driver-1774699354902.jpg',
'Width': 3426},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2109487,
'Height': 2704,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_front_passenger-1774699380203.jpg',
'Width': 3605},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1870095,
'Height': 2465,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8851/13358851/exterior_rear_passenger-1774699365328.jpg',
'Width': 3286},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3355440,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8851/13358851/interior_front_seats-1774699621575.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3027321,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8851/13358851/interior_dashboard-1774699653616.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2261560,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8851/13358851/instrument_cluster-1774699733063.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3276309,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8851/13358851/interior_boot-1774699654901.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544577,
'Height': 1846,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8851/13358851/docs_service_history-1774699949786.jpg?ixlib=js-3.8.0&auto=format&s=3ccc1a49194dcc1f42c7aead6f6d474c',
'Width': 2427},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_291ae947-e211-59a5-83ec-0b5b1dae7204/291ae947-e211-59a5-83ec-0b5b1dae7204_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1080883,
'Height': 2728,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8851/13358851/docs_service_history-1774699949920.jpg?ixlib=js-3.8.0&auto=format&s=9d84eee57a07980d1f7727f8ca3b3dde',
'Width': 3633}],
'price': 25675,
'price_includes_vat': False,
'registration_date': '2011-11-10',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Boxster S S-A',
'transmission': 'automatic',
'trim': 'S S-A',
'vin': 'WP0ZZZ98ZBS720962',
'year': 2011}
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713358851%27 HTTP/1.1" 200 None
2026-03-29 20:07:54 [motorway.uk] INFO: Saving data for 13358851: {'created_time': 1774814874.459412, 'last_price_update_time': 1774814874.459423, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13358851') HTTP/1.1" 204 0
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8752%252F20078752%252Finterior_dashboard-1774716942930.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8752/20078752/interior_dashboard-1774716942930.jpg not downloaded yet
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8752%252F20078752%252Finterior_boot-1774709439541.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8752/20078752/interior_boot-1774709439541.jpg not downloaded yet
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8752%252F20078752%252Fdocs_service_history-1774717709845.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db4d3d5ccbc49dde16cca0d76a813bd47%27 HTTP/1.1" 200 None
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8752/20078752/docs_service_history-1774717709845.jpg?ixlib=js-3.8.0&auto=format&s=b4d3d5ccbc49dde16cca0d76a813bd47 not downloaded yet
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8752%252F20078752%252Fdocs_service_history-1774717771727.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D256e2dc1aa891c4bb0e657bee53a9980%27 HTTP/1.1" 200 None
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8752/20078752/docs_service_history-1774717771727.jpg?ixlib=js-3.8.0&auto=format&s=256e2dc1aa891c4bb0e657bee53a9980 not downloaded yet
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8519/20458519/exterior_rear_passenger-1774638189445.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8519/20458519/exterior_front_passenger-1774635392383.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5542/20265542/interior_dashboard-1774711929179.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4735/20484735/interior_boot-1774694309274.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8534/20488534/instrument_cluster-1774718195353.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8534/20488534/interior_boot-1774718179483.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8752/20078752/exterior_front_driver-1774714366494.jpg> (referer: None)
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5fa350>
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8519%252F20458519%252Fexterior_rear_passenger-1774638189445.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8519/20458519/exterior_rear_passenger-1774638189445.jpg saved to cache
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd85f90>
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F20458519%252Fexterior_front_passenger-1774635392383.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/20458519/exterior_front_passenger-1774635392383.jpg saved to cache
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d749590>
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5542%252F20265542%252Finterior_dashboard-1774711929179.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5542/20265542/interior_dashboard-1774711929179.jpg saved to cache
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c74c450>
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4735%252F20484735%252Finterior_boot-1774694309274.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4735/20484735/interior_boot-1774694309274.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c21ce58-70e4-5332-affc-7a53aabed4f0
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd858d0>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8534%252F20488534%252Finstrument_cluster-1774718195353.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8534/20488534/instrument_cluster-1774718195353.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa0f667c-ec56-5c65-926a-65b70fc3f2db
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d748250>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8534%252F20488534%252Finterior_boot-1774718179483.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8534/20488534/interior_boot-1774718179483.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa0f667c-ec56-5c65-926a-65b70fc3f2db
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daa1310>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8752%252F20078752%252Fexterior_front_driver-1774714366494.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8752/20078752/exterior_front_driver-1774714366494.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc
2026-03-29 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8752/20078752/interior_front_seats-1774709549904.jpg> (referer: None)
2026-03-29 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8752/20078752/docs_service_history-1774717709845.jpg?ixlib=js-3.8.0&auto=format&s=b4d3d5ccbc49dde16cca0d76a813bd47> (referer: None)
2026-03-29 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4735/20484735/interior_dashboard-1774694326524.jpg> (referer: None)
2026-03-29 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5542/20265542/interior_rear_seats-1774707274768.jpg> (referer: None)
2026-03-29 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8752/20078752/exterior_rear_passenger-1774716655077.jpg> (referer: None)
2026-03-29 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8752/20078752/exterior_rear_driver-1774714345382.jpg> (referer: None)
2026-03-29 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8752/20078752/interior_boot-1774709439541.jpg> (referer: None)
2026-03-29 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8752/20078752/interior_dashboard-1774716942930.jpg> (referer: None)
2026-03-29 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8752/20078752/docs_service_history-1774717771727.jpg?ixlib=js-3.8.0&auto=format&s=256e2dc1aa891c4bb0e657bee53a9980> (referer: None)
2026-03-29 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8752/20078752/exterior_front_passenger-1774716635415.jpg> (referer: None)
2026-03-29 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8752/20078752/interior_rear_seats-1774709442900.jpg> (referer: None)
2026-03-29 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8534/20488534/interior_dashboard-1774718217822.jpg> (referer: None)
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1c6d50>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8752%252F20078752%252Finterior_front_seats-1774709549904.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8752/20078752/interior_front_seats-1774709549904.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db79ed0>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8752%252F20078752%252Fdocs_service_history-1774717709845.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db4d3d5ccbc49dde16cca0d76a813bd47') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8752/20078752/docs_service_history-1774717709845.jpg?ixlib=js-3.8.0&auto=format&s=b4d3d5ccbc49dde16cca0d76a813bd47 saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d52b450>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4735%252F20484735%252Finterior_dashboard-1774694326524.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4735/20484735/interior_dashboard-1774694326524.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c21ce58-70e4-5332-affc-7a53aabed4f0
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6b1a50>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5542%252F20265542%252Finterior_rear_seats-1774707274768.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5542/20265542/interior_rear_seats-1774707274768.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f268dd0>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8752%252F20078752%252Fexterior_rear_passenger-1774716655077.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8752/20078752/exterior_rear_passenger-1774716655077.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8edbd0>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8752%252F20078752%252Fexterior_rear_driver-1774714345382.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8752/20078752/exterior_rear_driver-1774714345382.jpg saved to cache
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d214a90>
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8752%252F20078752%252Finterior_boot-1774709439541.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8752/20078752/interior_boot-1774709439541.jpg saved to cache
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8ef5d0>
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8752%252F20078752%252Finterior_dashboard-1774716942930.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8752/20078752/interior_dashboard-1774716942930.jpg saved to cache
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f26b150>
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8752%252F20078752%252Fdocs_service_history-1774717771727.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D256e2dc1aa891c4bb0e657bee53a9980') HTTP/1.1" 204 0
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8752/20078752/docs_service_history-1774717771727.jpg?ixlib=js-3.8.0&auto=format&s=256e2dc1aa891c4bb0e657bee53a9980 saved to cache
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dda4310>
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8752%252F20078752%252Fexterior_front_passenger-1774716635415.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8752/20078752/exterior_front_passenger-1774716635415.jpg saved to cache
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8853d0>
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8752%252F20078752%252Finterior_rear_seats-1774709442900.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8752/20078752/interior_rear_seats-1774709442900.jpg saved to cache
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc
2026-03-29 20:07:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58b1a95e-ea41-5fb8-80ac-42f1002b21cc, skipping ID generation
2026-03-29 20:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc with scrape type 1
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58b1a95e-ea41-5fb8-80ac-42f1002b21cc sending to next pipeline
2026-03-29 20:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 58b1a95e-ea41-5fb8-80ac-42f1002b21cc, identifier: 20078752
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daa3ed0>
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8534%252F20488534%252Finterior_dashboard-1774718217822.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8534/20488534/interior_dashboard-1774718217822.jpg saved to cache
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa0f667c-ec56-5c65-926a-65b70fc3f2db
2026-03-29 20:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 58b1a95e-ea41-5fb8-80ac-42f1002b21cc with identifier: 20078752
2026-03-29 20:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 58b1a95e-ea41-5fb8-80ac-42f1002b21cc with identifier: 20078752
2026-03-29 20:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 58b1a95e-ea41-5fb8-80ac-42f1002b21cc with identifier: 20078752 to the API
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8752/20078752/interior_rear_seats-1774709442900.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '58b1a95e-ea41-5fb8-80ac-42f1002b21cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RS54 LAM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20078752',
'listing': 'auction',
'location': 'Greater London Barking',
'make': 'Audi',
'model': 'RS5',
'odometer': 60200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1718617,
'Height': 2719,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8752/20078752/exterior_front_driver-1774714366494.jpg',
'Width': 3625},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2098163,
'Height': 2667,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8752/20078752/exterior_rear_driver-1774714345382.jpg',
'Width': 3556},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2452905,
'Height': 2729,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8752/20078752/exterior_front_passenger-1774716635415.jpg',
'Width': 3639},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2022466,
'Height': 2754,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8752/20078752/exterior_rear_passenger-1774716655077.jpg',
'Width': 3672},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2635609,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8752/20078752/interior_front_seats-1774709549904.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3319905,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8752/20078752/interior_rear_seats-1774709442900.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2172677,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8752/20078752/interior_dashboard-1774716942930.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2220665,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8752/20078752/interior_boot-1774709439541.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1301569,
'Height': 2238,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8752/20078752/docs_service_history-1774717709845.jpg?ixlib=js-3.8.0&auto=format&s=b4d3d5ccbc49dde16cca0d76a813bd47',
'Width': 2984},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b1a95e-ea41-5fb8-80ac-42f1002b21cc/58b1a95e-ea41-5fb8-80ac-42f1002b21cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3298194,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8752/20078752/docs_service_history-1774717771727.jpg?ixlib=js-3.8.0&auto=format&s=256e2dc1aa891c4bb0e657bee53a9980',
'Width': 3000}],
'price': 24971,
'price_includes_vat': False,
'registration_date': '2017-07-24',
'seats_number': None,
'seller_name': None,
'title': 'Audi RS 5 TFSI Quattro Auto',
'transmission': 'automatic',
'trim': 'RS 5 TFSI Quattro Auto',
'vin': 'WUAZZZF50JA900772',
'year': 2017}
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720078752%27 HTTP/1.1" 200 None
2026-03-29 20:07:57 [motorway.uk] INFO: Saving data for 20078752: {'created_time': 1774814877.537257, 'last_price_update_time': 1774814877.537267, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20078752') HTTP/1.1" 204 0
2026-03-29 20:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8519/20458519/exterior_rear_driver-1774635053511.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5542/20265542/exterior_rear_passenger-1774706512401.jpg> (referer: None)
2026-03-29 20:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8519/20458519/exterior_front_driver-1774635383778.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5542/20265542/interior_front_seats-1774707276174.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4735/20484735/interior_front_seats-1774694311550.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8534/20488534/interior_rear_seats-1774718127352.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4735/20484735/interior_rear_seats-1774694314086.jpg> (referer: None)
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4d92d0>
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F20458519%252Fexterior_rear_driver-1774635053511.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/20458519/exterior_rear_driver-1774635053511.jpg saved to cache
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c669bd0>
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5542%252F20265542%252Fexterior_rear_passenger-1774706512401.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5542/20265542/exterior_rear_passenger-1774706512401.jpg saved to cache
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d606bd0>
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F20458519%252Fexterior_front_driver-1774635383778.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/20458519/exterior_front_driver-1774635383778.jpg saved to cache
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9
2026-03-29 20:07:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9, skipping ID generation
2026-03-29 20:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9 with scrape type 1
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9 sending to next pipeline
2026-03-29 20:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9, identifier: 20458519
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4c4250>
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5542%252F20265542%252Finterior_front_seats-1774707276174.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5542/20265542/interior_front_seats-1774707276174.jpg saved to cache
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd32590>
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4735%252F20484735%252Finterior_front_seats-1774694311550.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4735/20484735/interior_front_seats-1774694311550.jpg saved to cache
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c21ce58-70e4-5332-affc-7a53aabed4f0
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4db210>
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8534%252F20488534%252Finterior_rear_seats-1774718127352.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8534/20488534/interior_rear_seats-1774718127352.jpg saved to cache
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa0f667c-ec56-5c65-926a-65b70fc3f2db
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d607890>
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4735%252F20484735%252Finterior_rear_seats-1774694314086.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4735/20484735/interior_rear_seats-1774694314086.jpg saved to cache
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c21ce58-70e4-5332-affc-7a53aabed4f0
2026-03-29 20:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5542/20265542/exterior_front_driver-1774706513036.jpg> (referer: None)
2026-03-29 20:07:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9 with identifier: 20458519
2026-03-29 20:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9 with identifier: 20458519
2026-03-29 20:07:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9b10c4f5-58cd-57c6-b10f-9697ae9f96a9 with identifier: 20458519 to the API
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8519/20458519/exterior_front_driver-1774635383778.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9b10c4f5-58cd-57c6-b10f-9697ae9f96a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'OV24 ERU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20458519',
'listing': 'auction',
'location': 'Greater London Pinner',
'make': 'BMW',
'model': '1 Series',
'odometer': 10726,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1350511,
'Height': 2933,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8519/20458519/exterior_front_driver-1774635383778.jpg',
'Width': 3910},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1235447,
'Height': 2852,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8519/20458519/exterior_rear_driver-1774635053511.jpg',
'Width': 3803},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1430216,
'Height': 2858,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8519/20458519/exterior_front_passenger-1774635392383.jpg',
'Width': 3810},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1449621,
'Height': 2717,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8519/20458519/exterior_rear_passenger-1774638189445.jpg',
'Width': 3623},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2054025,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8519/20458519/interior_front_seats-1774637659143.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2161792,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8519/20458519/interior_rear_seats-1774636718935.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1471643,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8519/20458519/interior_dashboard-1774637720235.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1593275,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8519/20458519/interior_boot-1774636906553.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1042407,
'Height': 1073,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8519/20458519/docs_service_history-1774637066882.jpg?ixlib=js-3.8.0&auto=format&s=2cc2d0e8a774bf85fd89b074212dd7bb',
'Width': 1453},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b10c4f5-58cd-57c6-b10f-9697ae9f96a9/9b10c4f5-58cd-57c6-b10f-9697ae9f96a9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506263,
'Height': 2044,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8519/20458519/wheels_front_driver-1774635421336.jpg',
'Width': 2725}],
'price': 21575,
'price_includes_vat': False,
'registration_date': '2024-03-01',
'seats_number': None,
'seller_name': None,
'title': 'BMW 118I M Sport Auto',
'transmission': 'automatic',
'trim': '118I M Sport Auto',
'vin': 'WBA7K320X07N97458',
'year': 2024}
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720458519%27 HTTP/1.1" 200 None
2026-03-29 20:07:58 [motorway.uk] INFO: Saving data for 20458519: {'created_time': 1774814878.938171, 'last_price_update_time': 1774814878.938181, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20458519') HTTP/1.1" 204 0
2026-03-29 20:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f666b50>
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5542%252F20265542%252Fexterior_front_driver-1774706513036.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5542/20265542/exterior_front_driver-1774706513036.jpg saved to cache
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83
2026-03-29 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_rear_driver-1774692694832.jpg> (referer: None)
2026-03-29 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_rear_passenger-1774692685894.jpg> (referer: None)
2026-03-29 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_front_passenger-1774692689763.jpg> (referer: None)
2026-03-29 20:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5542/20265542/exterior_front_passenger-1774712531736.jpg> (referer: None)
2026-03-29 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5542/20265542/exterior_rear_driver-1774706515527.jpg> (referer: None)
2026-03-29 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8534/20488534/exterior_rear_passenger-1774717381404.jpg> (referer: None)
2026-03-29 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8534/20488534/exterior_front_passenger-1774777863437.jpg> (referer: None)
2026-03-29 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8534/20488534/interior_front_seats-1774718111439.jpg> (referer: None)
2026-03-29 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9831/20269831/docs_service_history-1774630412975.jpg?ixlib=js-3.8.0&auto=format&s=ca2cd1aa91c4a511d5c129f47325765c> (referer: None)
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d606150>
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4735%252F20484735%252Fexterior_rear_driver-1774692694832.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_rear_driver-1774692694832.jpg saved to cache
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c21ce58-70e4-5332-affc-7a53aabed4f0
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8b1610>
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4735%252F20484735%252Fexterior_rear_passenger-1774692685894.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_rear_passenger-1774692685894.jpg saved to cache
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c21ce58-70e4-5332-affc-7a53aabed4f0
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da4e850>
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4735%252F20484735%252Fexterior_front_passenger-1774692689763.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_front_passenger-1774692689763.jpg saved to cache
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c21ce58-70e4-5332-affc-7a53aabed4f0
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d228a50>
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5542%252F20265542%252Fexterior_front_passenger-1774712531736.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5542/20265542/exterior_front_passenger-1774712531736.jpg saved to cache
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db5df90>
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5542%252F20265542%252Fexterior_rear_driver-1774706515527.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5542/20265542/exterior_rear_driver-1774706515527.jpg saved to cache
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83
2026-03-29 20:07:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83, skipping ID generation
2026-03-29 20:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83 with scrape type 1
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83 sending to next pipeline
2026-03-29 20:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83, identifier: 20265542
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d09b310>
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8534%252F20488534%252Fexterior_rear_passenger-1774717381404.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8534/20488534/exterior_rear_passenger-1774717381404.jpg saved to cache
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa0f667c-ec56-5c65-926a-65b70fc3f2db
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de23ed0>
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8534%252F20488534%252Fexterior_front_passenger-1774777863437.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8534/20488534/exterior_front_passenger-1774777863437.jpg saved to cache
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa0f667c-ec56-5c65-926a-65b70fc3f2db
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c917210>
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8534%252F20488534%252Finterior_front_seats-1774718111439.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8534/20488534/interior_front_seats-1774718111439.jpg saved to cache
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa0f667c-ec56-5c65-926a-65b70fc3f2db
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d29ad10>
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9831%252F20269831%252Fdocs_service_history-1774630412975.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dca2cd1aa91c4a511d5c129f47325765c') HTTP/1.1" 204 0
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9831/20269831/docs_service_history-1774630412975.jpg?ixlib=js-3.8.0&auto=format&s=ca2cd1aa91c4a511d5c129f47325765c saved to cache
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6
2026-03-29 20:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83 with identifier: 20265542
2026-03-29 20:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83 with identifier: 20265542
2026-03-29 20:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 350a3b97-ee90-5017-b1ac-d0a3b2bfbf83 with identifier: 20265542 to the API
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5542/20265542/exterior_rear_driver-1774706515527.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '350a3b97-ee90-5017-b1ac-d0a3b2bfbf83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YL21 AVG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20265542',
'listing': 'auction',
'location': 'Greater London Hornchurch',
'make': 'Kia',
'model': 'Niro',
'odometer': 39861,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1110981,
'Height': 2057,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5542/20265542/exterior_front_driver-1774706513036.jpg',
'Width': 2742},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1645954,
'Height': 2464,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5542/20265542/exterior_rear_driver-1774706515527.jpg',
'Width': 3285},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1727702,
'Height': 2413,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5542/20265542/exterior_front_passenger-1774712531736.jpg',
'Width': 3217},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1255158,
'Height': 2688,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5542/20265542/exterior_rear_passenger-1774706512401.jpg',
'Width': 3584},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1560975,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5542/20265542/interior_front_seats-1774707276174.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1439086,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5542/20265542/interior_rear_seats-1774707274768.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1770985,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5542/20265542/interior_dashboard-1774711929179.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2435377,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5542/20265542/interior_boot-1774707273610.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1159524,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/5542/20265542/docs_service_history-1774712232048.jpg?ixlib=js-3.8.0&auto=format&s=43ce73e4d0ee4a3d3dc69eaf2599f0ab',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350a3b97-ee90-5017-b1ac-d0a3b2bfbf83/350a3b97-ee90-5017-b1ac-d0a3b2bfbf83_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1085590,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5542/20265542/damage_scratches-1774706619193.jpg',
'Width': 3840}],
'price': 15133,
'price_includes_vat': False,
'registration_date': '2021-06-23',
'seats_number': None,
'seller_name': None,
'title': 'Kia Niro 3 PHEV S-A',
'transmission': 'automatic',
'trim': '3 PHEV S-A',
'vin': 'KNACD81DVM5473078',
'year': 2021}
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720265542%27 HTTP/1.1" 200 None
2026-03-29 20:08:00 [motorway.uk] INFO: Saving data for 20265542: {'created_time': 1774814880.865688, 'last_price_update_time': 1774814880.865701, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20265542') HTTP/1.1" 204 0
2026-03-29 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_front_driver-1774692690484.jpg> (referer: None)
2026-03-29 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=504&page=14&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4483/20414483/docs_service_history-1774631362695.jpg?ixlib=js-3.8.0&auto=format&s=50d87d0c3177fa9125e5b1e4a79815b7> (referer: None)
2026-03-29 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9831/20269831/interior_boot-1774630483690.jpg> (referer: None)
2026-03-29 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8534/20488534/exterior_front_driver-1774717325298.jpg> (referer: None)
2026-03-29 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8534/20488534/exterior_rear_driver-1774717364504.jpg> (referer: None)
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5fb650>
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4735%252F20484735%252Fexterior_front_driver-1774692690484.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_front_driver-1774692690484.jpg saved to cache
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c21ce58-70e4-5332-affc-7a53aabed4f0
2026-03-29 20:08:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c21ce58-70e4-5332-affc-7a53aabed4f0, skipping ID generation
2026-03-29 20:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c21ce58-70e4-5332-affc-7a53aabed4f0 with scrape type 1
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c21ce58-70e4-5332-affc-7a53aabed4f0 sending to next pipeline
2026-03-29 20:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7c21ce58-70e4-5332-affc-7a53aabed4f0, identifier: 20484735
2026-03-29 20:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7c21ce58-70e4-5332-affc-7a53aabed4f0 with identifier: 20484735
2026-03-29 20:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7c21ce58-70e4-5332-affc-7a53aabed4f0 with identifier: 20484735
2026-03-29 20:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7c21ce58-70e4-5332-affc-7a53aabed4f0 with identifier: 20484735 to the API
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_front_driver-1774692690484.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '7c21ce58-70e4-5332-affc-7a53aabed4f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KR18 ZZF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20484735',
'listing': 'auction',
'location': 'West Sussex Crawley',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 42331,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 38,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1249080,
'Height': 2507,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_front_driver-1774692690484.jpg',
'Width': 3342},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1330337,
'Height': 2716,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_rear_driver-1774692694832.jpg',
'Width': 3621},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1094237,
'Height': 2480,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_front_passenger-1774692689763.jpg',
'Width': 3307},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1096301,
'Height': 2374,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4735/20484735/exterior_rear_passenger-1774692685894.jpg',
'Width': 3165},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2356675,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/4735/20484735/interior_front_seats-1774694311550.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3182256,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/4735/20484735/interior_rear_seats-1774694314086.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1058029,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4735/20484735/interior_dashboard-1774694326524.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2590568,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/4735/20484735/interior_boot-1774694309274.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2281829,
'Height': 2891,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4735/20484735/docs_service_history-1774694672646.jpg?ixlib=js-3.8.0&auto=format&s=86932eacb89c62581655b3b79fa34611',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c21ce58-70e4-5332-affc-7a53aabed4f0/7c21ce58-70e4-5332-affc-7a53aabed4f0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2132419,
'Height': 2891,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4735/20484735/docs_service_history-1774694714638.jpg?ixlib=js-3.8.0&auto=format&s=486b8223d172f19ad63eab932abfedf1',
'Width': 3840}],
'price': 10854,
'price_includes_vat': False,
'registration_date': '2018-05-25',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 200 D Sport Edition + Auto',
'transmission': 'automatic',
'trim': 'A 200 D Sport Edition + Auto',
'vin': 'WDD1760082J782701',
'year': 2018}
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484735%27 HTTP/1.1" 200 None
2026-03-29 20:08:01 [motorway.uk] INFO: Saving data for 20484735: {'created_time': 1774814881.646118, 'last_price_update_time': 1774814881.646128, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20484735') HTTP/1.1" 204 0
2026-03-29 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18709305.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:01 [motorway.uk] INFO: Found listing with ID: 20480434
2026-03-29 20:08:01 [motorway.uk] INFO: Found listing with ID: 20396926
2026-03-29 20:08:01 [motorway.uk] INFO: Found listing with ID: 10578729
2026-03-29 20:08:01 [motorway.uk] INFO: Found listing with ID: 20367865
2026-03-29 20:08:01 [motorway.uk] INFO: Found listing with ID: 20457058
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720457058%27 HTTP/1.1" 200 None
2026-03-29 20:08:01 [motorway.uk] INFO: Scrape type for 20457058: 1
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f21a510>
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4483%252F20414483%252Fdocs_service_history-1774631362695.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D50d87d0c3177fa9125e5b1e4a79815b7') HTTP/1.1" 204 0
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4483/20414483/docs_service_history-1774631362695.jpg?ixlib=js-3.8.0&auto=format&s=50d87d0c3177fa9125e5b1e4a79815b7 saved to cache
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96387454-e571-566f-bbd1-f47ed4b43e5b
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6f4c90>
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9831%252F20269831%252Finterior_boot-1774630483690.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9831/20269831/interior_boot-1774630483690.jpg saved to cache
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f264c50>
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8534%252F20488534%252Fexterior_front_driver-1774717325298.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8534/20488534/exterior_front_driver-1774717325298.jpg saved to cache
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa0f667c-ec56-5c65-926a-65b70fc3f2db
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0ee290>
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8534%252F20488534%252Fexterior_rear_driver-1774717364504.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8534/20488534/exterior_rear_driver-1774717364504.jpg saved to cache
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa0f667c-ec56-5c65-926a-65b70fc3f2db
2026-03-29 20:08:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa0f667c-ec56-5c65-926a-65b70fc3f2db, skipping ID generation
2026-03-29 20:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa0f667c-ec56-5c65-926a-65b70fc3f2db with scrape type 1
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa0f667c-ec56-5c65-926a-65b70fc3f2db sending to next pipeline
2026-03-29 20:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: aa0f667c-ec56-5c65-926a-65b70fc3f2db, identifier: 20488534
2026-03-29 20:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: aa0f667c-ec56-5c65-926a-65b70fc3f2db with identifier: 20488534
2026-03-29 20:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: aa0f667c-ec56-5c65-926a-65b70fc3f2db with identifier: 20488534
2026-03-29 20:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: aa0f667c-ec56-5c65-926a-65b70fc3f2db with identifier: 20488534 to the API
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8534/20488534/exterior_rear_driver-1774717364504.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'aa0f667c-ec56-5c65-926a-65b70fc3f2db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SH67 OTZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488534',
'listing': 'auction',
'location': 'Staffordshire Lichfield',
'make': 'Audi',
'model': 'TT',
'odometer': 70421,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1854536,
'Height': 2501,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8534/20488534/exterior_front_driver-1774717325298.jpg',
'Width': 3334},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2748297,
'Height': 2867,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8534/20488534/exterior_rear_driver-1774717364504.jpg',
'Width': 3822},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2901737,
'Height': 2705,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8534/20488534/exterior_front_passenger-1774777863437.jpg',
'Width': 3607},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2147619,
'Height': 2832,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8534/20488534/exterior_rear_passenger-1774717381404.jpg',
'Width': 3776},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2942581,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8534/20488534/interior_front_seats-1774718111439.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2229707,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8534/20488534/interior_rear_seats-1774718127352.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3419663,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8534/20488534/interior_dashboard-1774718217822.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2512503,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8534/20488534/instrument_cluster-1774718195353.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3318347,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8534/20488534/interior_boot-1774718179483.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa0f667c-ec56-5c65-926a-65b70fc3f2db/aa0f667c-ec56-5c65-926a-65b70fc3f2db_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505298,
'Height': 3271,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8534/20488534/docs_service_history-1774718456256.jpg?ixlib=js-3.8.0&auto=format&s=2d00a7802f43df063b3466c96beb107c',
'Width': 2219}],
'price': 9567,
'price_includes_vat': False,
'registration_date': '2018-01-19',
'seats_number': None,
'seller_name': None,
'title': 'Audi TT S Line TFSI',
'transmission': 'manual',
'trim': 'S Line TFSI',
'vin': 'TRUZZZFV1J1008422',
'year': 2018}
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488534%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [motorway.uk] INFO: Saving data for 20488534: {'created_time': 1774814882.656997, 'last_price_update_time': 1774814882.657007, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488534') HTTP/1.1" 204 0
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 19559218
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 19677086
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 20487346
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 20477373
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 17851318
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717851318%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [motorway.uk] INFO: Scrape type for 17851318: 1
2026-03-29 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18254903.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 20277040
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 20456360
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720456360%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [motorway.uk] INFO: Scrape type for 20456360: 1
2026-03-29 20:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1 with identifier: 18709305
2026-03-29 20:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1 with scrape type 1
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9305%252F18709305%252Fexterior_front_driver-1774773497917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_front_driver-1774773497917.jpg not downloaded yet
2026-03-29 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9831/20269831/instrument_cluster-1774630637384.jpg> (referer: None)
2026-03-29 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_rear_driver-1774628526924.jpg> (referer: None)
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 18732558
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718732558%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [motorway.uk] INFO: Scrape type for 18732558: 1
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9305%252F18709305%252Fexterior_rear_driver-1774773574177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_rear_driver-1774773574177.jpg not downloaded yet
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 5611886
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 20341222
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 14816704
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 17084288
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 20485139
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 20087813
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720087813%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [motorway.uk] INFO: Scrape type for 20087813: 1
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9305%252F18709305%252Fexterior_front_passenger-1774773522181.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_front_passenger-1774773522181.jpg not downloaded yet
2026-03-29 20:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df5df73b-1df7-5e7f-9829-65ab406336f8 with identifier: 18254903
2026-03-29 20:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df5df73b-1df7-5e7f-9829-65ab406336f8 with scrape type 1
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df5df73b-1df7-5e7f-9829-65ab406336f8
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4903%252F18254903%252F18254903-exterior_front_driver-modified-1774705760021.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4903/18254903/18254903-exterior_front_driver-modified-1774705760021.jpeg not downloaded yet
2026-03-29 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4483/20414483/interior_boot-1774631193567.jpg> (referer: None)
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 16608213
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716608213%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [motorway.uk] INFO: Scrape type for 16608213: 1
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9305%252F18709305%252Fexterior_rear_passenger-1774773555900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_rear_passenger-1774773555900.jpg not downloaded yet
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4903%252F18254903%252Fexterior_rear_driver-1770994248940.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4903/18254903/exterior_rear_driver-1770994248940.jpg not downloaded yet
2026-03-29 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4483/20414483/interior_dashboard-1774631232097.jpg> (referer: None)
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 20487775
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 19936274
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 19950167
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 15737342
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 20202633
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 19867021
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 20331785
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 20471533
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 19734644
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 16989772
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716989772%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [motorway.uk] INFO: Scrape type for 16989772: 1
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9305%252F18709305%252Finterior_front_seats-1774773635020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9305/18709305/interior_front_seats-1774773635020.jpg not downloaded yet
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4903%252F18254903%252Fexterior_front_passenger-1770994162819.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4903/18254903/exterior_front_passenger-1770994162819.jpg not downloaded yet
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 20488442
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 20387458
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 20469643
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 20272813
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 7883635
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 20386196
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9305%252F18709305%252Finterior_rear_seats-1774773761494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9305/18709305/interior_rear_seats-1774773761494.jpg not downloaded yet
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cacbd10>
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9831%252F20269831%252Finstrument_cluster-1774630637384.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9831/20269831/instrument_cluster-1774630637384.jpg saved to cache
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ceab4d0>
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4483%252F20414483%252Fexterior_rear_driver-1774628526924.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_rear_driver-1774628526924.jpg saved to cache
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96387454-e571-566f-bbd1-f47ed4b43e5b
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4903%252F18254903%252Fexterior_rear_passenger-1770994237311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4903/18254903/exterior_rear_passenger-1770994237311.jpg not downloaded yet
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9305%252F18709305%252F18709305-interior_dashboard-modified-1774775328156.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9305/18709305/18709305-interior_dashboard-modified-1774775328156.jpeg not downloaded yet
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0e0c10>
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4483%252F20414483%252Finterior_boot-1774631193567.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4483/20414483/interior_boot-1774631193567.jpg saved to cache
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96387454-e571-566f-bbd1-f47ed4b43e5b
2026-03-29 20:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4483/20414483/docs_service_history-1774631348200.jpg?ixlib=js-3.8.0&auto=format&s=d8cf39e245b43f7662cceaf2ee88e9b2> (referer: None)
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4903%252F18254903%252Finterior_front_seats-1770994280422.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4903/18254903/interior_front_seats-1770994280422.jpg not downloaded yet
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9305%252F18709305%252Finterior_boot-1774773723479.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9305/18709305/interior_boot-1774773723479.jpg not downloaded yet
2026-03-29 20:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_front_driver-1774628525191.jpg> (referer: None)
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4903%252F18254903%252F18254903-interior_dashboard-modified-1774705739990.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4903/18254903/18254903-interior_dashboard-modified-1774705739990.jpeg not downloaded yet
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5e3490>
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4483%252F20414483%252Finterior_dashboard-1774631232097.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4483/20414483/interior_dashboard-1774631232097.jpg saved to cache
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96387454-e571-566f-bbd1-f47ed4b43e5b
2026-03-29 20:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_front_driver-1774773497917.jpg> (referer: None)
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9305%252F18709305%252F18709305-docs_service_history-default-1774773108660.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59a112b01f813e140763faa407ac05b2%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9305/18709305/18709305-docs_service_history-default-1774773108660.jpeg?ixlib=js-3.8.0&auto=format&s=59a112b01f813e140763faa407ac05b2 not downloaded yet
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4903%252F18254903%252Finstrument_cluster-1774707053741.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4903/18254903/instrument_cluster-1774707053741.jpg not downloaded yet
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9305%252F18709305%252F18709305-docs_service_history-default-1774773123062.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df59c2c593fd80386425439f8bcfd1c97%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9305/18709305/18709305-docs_service_history-default-1774773123062.jpg?ixlib=js-3.8.0&auto=format&s=f59c2c593fd80386425439f8bcfd1c97 not downloaded yet
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0e2810>
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4483%252F20414483%252Fdocs_service_history-1774631348200.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd8cf39e245b43f7662cceaf2ee88e9b2') HTTP/1.1" 204 0
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4483/20414483/docs_service_history-1774631348200.jpg?ixlib=js-3.8.0&auto=format&s=d8cf39e245b43f7662cceaf2ee88e9b2 saved to cache
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96387454-e571-566f-bbd1-f47ed4b43e5b
2026-03-29 20:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4483/20414483/interior_front_seats-1774631191256.jpg> (referer: None)
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4903%252F18254903%252Finterior_boot-1770994360795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4903/18254903/interior_boot-1770994360795.jpg not downloaded yet
2026-03-29 20:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9831/20269831/interior_front_seats-1774630343998.jpg> (referer: None)
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4903%252F18254903%252Fdocs_service_history-1773417244204.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3a9459b96110044bfc358eb405fe017a%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4903/18254903/docs_service_history-1773417244204.jpg?ixlib=js-3.8.0&auto=format&s=3a9459b96110044bfc358eb405fe017a not downloaded yet
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f68ce90>
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4483%252F20414483%252Fexterior_front_driver-1774628525191.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_front_driver-1774628525191.jpg saved to cache
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96387454-e571-566f-bbd1-f47ed4b43e5b
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2deed8d0>
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9305%252F18709305%252Fexterior_front_driver-1774773497917.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_front_driver-1774773497917.jpg saved to cache
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4903%252F18254903%252Fdocs_service_history-1773417244291.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D07358b2efb6ea18cc1f1570e41d0900b%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4903/18254903/docs_service_history-1773417244291.jpg?ixlib=js-3.8.0&auto=format&s=07358b2efb6ea18cc1f1570e41d0900b not downloaded yet
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f68f890>
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4483%252F20414483%252Finterior_front_seats-1774631191256.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4483/20414483/interior_front_seats-1774631191256.jpg saved to cache
2026-03-29 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96387454-e571-566f-bbd1-f47ed4b43e5b
2026-03-29 20:08:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96387454-e571-566f-bbd1-f47ed4b43e5b, skipping ID generation
2026-03-29 20:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96387454-e571-566f-bbd1-f47ed4b43e5b with scrape type 1
2026-03-29 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96387454-e571-566f-bbd1-f47ed4b43e5b sending to next pipeline
2026-03-29 20:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 96387454-e571-566f-bbd1-f47ed4b43e5b, identifier: 20414483
2026-03-29 20:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e10a110>
2026-03-29 20:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9831%252F20269831%252Finterior_front_seats-1774630343998.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9831/20269831/interior_front_seats-1774630343998.jpg saved to cache
2026-03-29 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6
2026-03-29 20:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0509/20260509/interior_dashboard-1774015519516.jpg> (referer: None)
2026-03-29 20:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 96387454-e571-566f-bbd1-f47ed4b43e5b with identifier: 20414483
2026-03-29 20:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 96387454-e571-566f-bbd1-f47ed4b43e5b with identifier: 20414483
2026-03-29 20:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 96387454-e571-566f-bbd1-f47ed4b43e5b with identifier: 20414483 to the API
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4483/20414483/interior_front_seats-1774631191256.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '96387454-e571-566f-bbd1-f47ed4b43e5b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VX68 OGF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20414483',
'listing': 'auction',
'location': 'Somerset Glastonbury',
'make': 'BMW',
'model': '3 Series',
'odometer': 50000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 686676,
'Height': 1799,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_front_driver-1774628525191.jpg',
'Width': 2398},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 856182,
'Height': 1898,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_rear_driver-1774628526924.jpg',
'Width': 2531},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 941330,
'Height': 1840,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_front_passenger-1774628525272.jpg',
'Width': 2453},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 802593,
'Height': 1964,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4483/20414483/exterior_rear_passenger-1774628524000.jpg',
'Width': 2619},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1852471,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4483/20414483/interior_front_seats-1774631191256.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1595621,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4483/20414483/interior_rear_seats-1774631190445.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1380266,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4483/20414483/interior_dashboard-1774631232097.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1329198,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4483/20414483/interior_boot-1774631193567.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1312969,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4483/20414483/docs_service_history-1774631348200.jpg?ixlib=js-3.8.0&auto=format&s=d8cf39e245b43f7662cceaf2ee88e9b2',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96387454-e571-566f-bbd1-f47ed4b43e5b/96387454-e571-566f-bbd1-f47ed4b43e5b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1257521,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4483/20414483/docs_service_history-1774631362695.jpg?ixlib=js-3.8.0&auto=format&s=50d87d0c3177fa9125e5b1e4a79815b7',
'Width': 3840}],
'price': 21045,
'price_includes_vat': False,
'registration_date': '2018-10-31',
'seats_number': None,
'seller_name': None,
'title': 'BMW 340I M Sport Shadow Edition',
'transmission': 'automatic',
'trim': '340I M Sport Shadow Edition',
'vin': 'WBA8B32030K610388',
'year': 2018}
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720414483%27 HTTP/1.1" 200 None
2026-03-29 20:08:04 [motorway.uk] INFO: Saving data for 20414483: {'created_time': 1774814884.851837, 'last_price_update_time': 1774814884.851848, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20414483') HTTP/1.1" 204 0
2026-03-29 20:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db69210>
2026-03-29 20:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F20260509%252Finterior_dashboard-1774015519516.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/20260509/interior_dashboard-1774015519516.jpg saved to cache
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 581e8de5-b04a-5086-a100-01898fcf7c3f
2026-03-29 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9831/20269831/interior_dashboard-1774630478877.jpg> (referer: None)
2026-03-29 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4903/18254903/18254903-exterior_front_driver-modified-1774705760021.jpeg> (referer: None)
2026-03-29 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_front_driver-1774628910099.jpg> (referer: None)
2026-03-29 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20484739.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486849.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4d4f50>
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9831%252F20269831%252Finterior_dashboard-1774630478877.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9831/20269831/interior_dashboard-1774630478877.jpg saved to cache
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6
2026-03-29 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20220021.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4dd390>
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4903%252F18254903%252F18254903-exterior_front_driver-modified-1774705760021.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4903/18254903/18254903-exterior_front_driver-modified-1774705760021.jpeg saved to cache
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df5df73b-1df7-5e7f-9829-65ab406336f8
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca8ca90>
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9831%252F20269831%252Fexterior_front_driver-1774628910099.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_front_driver-1774628910099.jpg saved to cache
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6
2026-03-29 20:08:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9dd7686-3f84-5234-8fb1-31ed3da7eae6, skipping ID generation
2026-03-29 20:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6 with scrape type 1
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9dd7686-3f84-5234-8fb1-31ed3da7eae6 sending to next pipeline
2026-03-29 20:08:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e9dd7686-3f84-5234-8fb1-31ed3da7eae6, identifier: 20269831
2026-03-29 20:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1992f984-4732-557f-b7fb-9c3a9dbe8712 with identifier: 20484739
2026-03-29 20:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1992f984-4732-557f-b7fb-9c3a9dbe8712 with scrape type 1
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1992f984-4732-557f-b7fb-9c3a9dbe8712
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4739%252F20484739%252Fexterior_front_driver-1774695188166.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4739/20484739/exterior_front_driver-1774695188166.jpg not downloaded yet
2026-03-29 20:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93fdc899-6b55-5b19-bb63-d9915fb7542e with identifier: 20486849
2026-03-29 20:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93fdc899-6b55-5b19-bb63-d9915fb7542e with scrape type 1
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93fdc899-6b55-5b19-bb63-d9915fb7542e
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6849%252F20486849%252Fexterior_front_driver-1774699124863.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_front_driver-1774699124863.jpg not downloaded yet
2026-03-29 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20457058.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e9dd7686-3f84-5234-8fb1-31ed3da7eae6 with identifier: 20269831
2026-03-29 20:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e9dd7686-3f84-5234-8fb1-31ed3da7eae6 with identifier: 20269831
2026-03-29 20:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e9dd7686-3f84-5234-8fb1-31ed3da7eae6 with identifier: 20269831 to the API
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_front_driver-1774628910099.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e9dd7686-3f84-5234-8fb1-31ed3da7eae6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AL21 NHA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20269831',
'listing': 'auction',
'location': 'Greater London Barnet',
'make': 'Mercedes',
'model': 'GLA',
'odometer': 41179,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2610469,
'Height': 2582,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_front_driver-1774628910099.jpg',
'Width': 3442},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2089637,
'Height': 2507,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_rear_driver-1774628925196.jpg',
'Width': 3342},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1994411,
'Height': 2556,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_front_passenger-1774628968444.jpg',
'Width': 3408},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2554301,
'Height': 2681,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9831/20269831/exterior_rear_passenger-1774628942217.jpg',
'Width': 3575},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1991394,
'Height': 2329,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9831/20269831/interior_front_seats-1774630343998.jpg',
'Width': 3105},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1321892,
'Height': 2106,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9831/20269831/interior_rear_seats-1774630464242.jpg',
'Width': 2808},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2638512,
'Height': 2963,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9831/20269831/interior_dashboard-1774630478877.jpg',
'Width': 3950},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 979058,
'Height': 2192,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9831/20269831/instrument_cluster-1774630637384.jpg',
'Width': 2923},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2280459,
'Height': 2575,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9831/20269831/interior_boot-1774630483690.jpg',
'Width': 3433},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9dd7686-3f84-5234-8fb1-31ed3da7eae6/e9dd7686-3f84-5234-8fb1-31ed3da7eae6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121687,
'Height': 1175,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9831/20269831/docs_service_history-1774630412975.jpg?ixlib=js-3.8.0&auto=format&s=ca2cd1aa91c4a511d5c129f47325765c',
'Width': 1567}],
'price': 21772,
'price_includes_vat': False,
'registration_date': '2021-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLA 250 AMG Line Premium Auto',
'transmission': 'automatic',
'trim': '250 AMG Line Premium Auto',
'vin': 'W1N2477462J238014',
'year': 2021}
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720269831%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [motorway.uk] INFO: Saving data for 20269831: {'created_time': 1774814886.213583, 'last_price_update_time': 1774814886.213593, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20269831') HTTP/1.1" 204 0
2026-03-29 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9305/18709305/18709305-docs_service_history-default-1774773123062.jpg?ixlib=js-3.8.0&auto=format&s=f59c2c593fd80386425439f8bcfd1c97> (referer: None)
2026-03-29 20:08:06 [scrapy.extensions.logstats] INFO: Crawled 116 pages (at 21 pages/min), scraped 67 items (at 26 items/min)
2026-03-29 20:08:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 291MiB
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4739%252F20484739%252Fexterior_rear_driver-1774694159379.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4739/20484739/exterior_rear_driver-1774694159379.jpg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6849%252F20486849%252Fexterior_rear_driver-1774699171632.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_rear_driver-1774699171632.jpg not downloaded yet
2026-03-29 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4903/18254903/interior_boot-1770994360795.jpg> (referer: None)
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4739%252F20484739%252Fexterior_front_passenger-1774694190800.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4739/20484739/exterior_front_passenger-1774694190800.jpg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6849%252F20486849%252Fexterior_front_passenger-1774699252233.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_front_passenger-1774699252233.jpg not downloaded yet
2026-03-29 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17851318.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af122423-9c3b-5192-a28e-75504427f4bb with identifier: 20220021
2026-03-29 20:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af122423-9c3b-5192-a28e-75504427f4bb with scrape type 1
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af122423-9c3b-5192-a28e-75504427f4bb
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0021%252F20220021%252F20220021-exterior_front_driver-modified-1774531938611.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0021/20220021/20220021-exterior_front_driver-modified-1774531938611.jpeg not downloaded yet
2026-03-29 20:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f5bcdd6-c0b1-51e1-8299-fb524b733983 with identifier: 20457058
2026-03-29 20:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983 with scrape type 1
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7058%252F20457058%252Fexterior_front_driver-1774628488392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_front_driver-1774628488392.jpg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4739%252F20484739%252Fexterior_rear_passenger-1774694170967.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4739/20484739/exterior_rear_passenger-1774694170967.jpg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6849%252F20486849%252Fexterior_rear_passenger-1774699229562.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_rear_passenger-1774699229562.jpg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0021%252F20220021%252Fexterior_rear_driver-1774530157822.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0021/20220021/exterior_rear_driver-1774530157822.jpeg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7058%252F20457058%252Fexterior_rear_driver-1774628500195.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_rear_driver-1774628500195.jpg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4739%252F20484739%252Finterior_front_seats-1774694481361.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4739/20484739/interior_front_seats-1774694481361.jpg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6849%252F20486849%252Finterior_front_seats-1774699954077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6849/20486849/interior_front_seats-1774699954077.jpg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0021%252F20220021%252Fexterior_front_passenger-1774530129071.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0021/20220021/exterior_front_passenger-1774530129071.jpeg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7058%252F20457058%252Fexterior_front_passenger-1774628564916.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_front_passenger-1774628564916.jpg not downloaded yet
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc29110>
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9305%252F18709305%252F18709305-docs_service_history-default-1774773123062.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df59c2c593fd80386425439f8bcfd1c97') HTTP/1.1" 204 0
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9305/18709305/18709305-docs_service_history-default-1774773123062.jpg?ixlib=js-3.8.0&auto=format&s=f59c2c593fd80386425439f8bcfd1c97 saved to cache
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c88aa50>
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4903%252F18254903%252Finterior_boot-1770994360795.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4903/18254903/interior_boot-1770994360795.jpg saved to cache
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df5df73b-1df7-5e7f-9829-65ab406336f8
2026-03-29 20:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50ae2605-8afc-5032-b1f1-0a61d1887a17 with identifier: 17851318
2026-03-29 20:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50ae2605-8afc-5032-b1f1-0a61d1887a17 with scrape type 1
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50ae2605-8afc-5032-b1f1-0a61d1887a17
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1318%252F17851318%252Fexterior_front_driver-1774623234774.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_front_driver-1774623234774.jpg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4739%252F20484739%252Finterior_rear_seats-1774694495917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4739/20484739/interior_rear_seats-1774694495917.jpg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6849%252F20486849%252Finterior_rear_seats-1774699975513.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6849/20486849/interior_rear_seats-1774699975513.jpg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0021%252F20220021%252Fexterior_rear_passenger-1774530150557.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0021/20220021/exterior_rear_passenger-1774530150557.jpeg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7058%252F20457058%252Fexterior_rear_passenger-1774628520694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_rear_passenger-1774628520694.jpg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1318%252F17851318%252Fexterior_rear_driver-1774623248211.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_rear_driver-1774623248211.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4739%252F20484739%252Finterior_dashboard-1774694529917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4739/20484739/interior_dashboard-1774694529917.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6849%252F20486849%252Finterior_dashboard-1774700010436.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6849/20486849/interior_dashboard-1774700010436.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0021%252F20220021%252Finterior_front_seats-1774530179374.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0021/20220021/interior_front_seats-1774530179374.jpeg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7058%252F20457058%252Finterior_front_seats-1774629200723.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7058/20457058/interior_front_seats-1774629200723.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1318%252F17851318%252Fexterior_front_passenger-1774623274867.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_front_passenger-1774623274867.jpg not downloaded yet
2026-03-29 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4903/18254903/docs_service_history-1773417244204.jpg?ixlib=js-3.8.0&auto=format&s=3a9459b96110044bfc358eb405fe017a> (referer: None)
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4739%252F20484739%252Finterior_boot-1774694556483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4739/20484739/interior_boot-1774694556483.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6849%252F20486849%252Finstrument_cluster-1774700049815.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6849/20486849/instrument_cluster-1774700049815.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0021%252F20220021%252Finterior_dashboard-1774530460578.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0021/20220021/interior_dashboard-1774530460578.jpeg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7058%252F20457058%252Finterior_rear_seats-1774629214681.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7058/20457058/interior_rear_seats-1774629214681.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1318%252F17851318%252Fexterior_rear_passenger-1774623261412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_rear_passenger-1774623261412.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4739%252F20484739%252Fdocs_service_history-1774694710285.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5028f7a2cffb60e39cb71f99c575a18e%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4739/20484739/docs_service_history-1774694710285.jpg?ixlib=js-3.8.0&auto=format&s=5028f7a2cffb60e39cb71f99c575a18e not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6849%252F20486849%252Finterior_boot-1774700018996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6849/20486849/interior_boot-1774700018996.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0021%252F20220021%252Finstrument_cluster-1774530603728.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0021/20220021/instrument_cluster-1774530603728.jpeg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7058%252F20457058%252Finterior_dashboard-1774629249635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7058/20457058/interior_dashboard-1774629249635.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1318%252F17851318%252Finterior_front_seats-1774623745304.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1318/17851318/interior_front_seats-1774623745304.jpg not downloaded yet
2026-03-29 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4903/18254903/docs_service_history-1773417244291.jpg?ixlib=js-3.8.0&auto=format&s=07358b2efb6ea18cc1f1570e41d0900b> (referer: None)
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4739%252F20484739%252Fdamage_scratches-1774694255080.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4739/20484739/damage_scratches-1774694255080.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6849%252F20486849%252Fdocs_service_history-1774706008955.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D290b86f41441f83a3abb104daba7b180%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6849/20486849/docs_service_history-1774706008955.jpg?ixlib=js-3.8.0&auto=format&s=290b86f41441f83a3abb104daba7b180 not downloaded yet
2026-03-29 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9305/18709305/interior_boot-1774773723479.jpg> (referer: None)
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0021%252F20220021%252Finterior_boot-1774530309331.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0021/20220021/interior_boot-1774530309331.jpeg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7058%252F20457058%252Finstrument_cluster-1774629291953.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7058/20457058/instrument_cluster-1774629291953.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1318%252F17851318%252Finterior_rear_seats-1774623662283.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1318/17851318/interior_rear_seats-1774623662283.jpg not downloaded yet
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8f6c10>
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4903%252F18254903%252Fdocs_service_history-1773417244204.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3a9459b96110044bfc358eb405fe017a') HTTP/1.1" 204 0
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4903/18254903/docs_service_history-1773417244204.jpg?ixlib=js-3.8.0&auto=format&s=3a9459b96110044bfc358eb405fe017a saved to cache
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df5df73b-1df7-5e7f-9829-65ab406336f8
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0021%252F20220021%252Fdamage_scratches-1774530757045.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0021/20220021/damage_scratches-1774530757045.jpeg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7058%252F20457058%252Finterior_boot-1774629261477.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7058/20457058/interior_boot-1774629261477.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1318%252F17851318%252Finterior_dashboard-1774625674027.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1318/17851318/interior_dashboard-1774625674027.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0021%252F20220021%252Fdamage_scratches-1774530850705.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0021/20220021/damage_scratches-1774530850705.jpeg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7058%252F20457058%252Fdocs_service_history-1774631318425.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd901710fd1ab6cfbf9e52072765c3d68%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7058/20457058/docs_service_history-1774631318425.jpg?ixlib=js-3.8.0&auto=format&s=d901710fd1ab6cfbf9e52072765c3d68 not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1318%252F17851318%252Finstrument_cluster-1774625626932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1318/17851318/instrument_cluster-1774625626932.jpg not downloaded yet
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f62a490>
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4903%252F18254903%252Fdocs_service_history-1773417244291.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D07358b2efb6ea18cc1f1570e41d0900b') HTTP/1.1" 204 0
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4903/18254903/docs_service_history-1773417244291.jpg?ixlib=js-3.8.0&auto=format&s=07358b2efb6ea18cc1f1570e41d0900b saved to cache
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df5df73b-1df7-5e7f-9829-65ab406336f8
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1dc4d0>
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9305%252F18709305%252Finterior_boot-1774773723479.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9305/18709305/interior_boot-1774773723479.jpg saved to cache
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1318%252F17851318%252Finterior_boot-1774623576463.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1318/17851318/interior_boot-1774623576463.jpg not downloaded yet
2026-03-29 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9305/18709305/18709305-docs_service_history-default-1774773108660.jpeg?ixlib=js-3.8.0&auto=format&s=59a112b01f813e140763faa407ac05b2> (referer: None)
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1318%252F17851318%252Fdocs_service_history-1774623927022.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da2924f8d2caadf283ec2188e72db0a7a%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1318/17851318/docs_service_history-1774623927022.jpg?ixlib=js-3.8.0&auto=format&s=a2924f8d2caadf283ec2188e72db0a7a not downloaded yet
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c83e4d0>
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9305%252F18709305%252F18709305-docs_service_history-default-1774773108660.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59a112b01f813e140763faa407ac05b2') HTTP/1.1" 204 0
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9305/18709305/18709305-docs_service_history-default-1774773108660.jpeg?ixlib=js-3.8.0&auto=format&s=59a112b01f813e140763faa407ac05b2 saved to cache
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_front_driver-1774623234774.jpg> (referer: None)
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_rear_driver-1774628500195.jpg> (referer: None)
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4903/18254903/instrument_cluster-1774707053741.jpg> (referer: None)
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4903/18254903/interior_front_seats-1770994280422.jpg> (referer: None)
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_front_passenger-1774628564916.jpg> (referer: None)
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_front_passenger-1774623274867.jpg> (referer: None)
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4903/18254903/18254903-interior_dashboard-modified-1774705739990.jpeg> (referer: None)
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4739/20484739/interior_front_seats-1774694481361.jpg> (referer: None)
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4739/20484739/interior_rear_seats-1774694495917.jpg> (referer: None)
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1318/17851318/interior_dashboard-1774625674027.jpg> (referer: None)
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6849/20486849/interior_front_seats-1774699954077.jpg> (referer: None)
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6849/20486849/interior_rear_seats-1774699975513.jpg> (referer: None)
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c849890>
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1318%252F17851318%252Fexterior_front_driver-1774623234774.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_front_driver-1774623234774.jpg saved to cache
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50ae2605-8afc-5032-b1f1-0a61d1887a17
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c836e10>
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7058%252F20457058%252Fexterior_rear_driver-1774628500195.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_rear_driver-1774628500195.jpg saved to cache
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d652cd0>
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4903%252F18254903%252Finstrument_cluster-1774707053741.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4903/18254903/instrument_cluster-1774707053741.jpg saved to cache
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df5df73b-1df7-5e7f-9829-65ab406336f8
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f40fa90>
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4903%252F18254903%252Finterior_front_seats-1770994280422.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4903/18254903/interior_front_seats-1770994280422.jpg saved to cache
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df5df73b-1df7-5e7f-9829-65ab406336f8
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ceceed0>
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7058%252F20457058%252Fexterior_front_passenger-1774628564916.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_front_passenger-1774628564916.jpg saved to cache
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6527d0>
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1318%252F17851318%252Fexterior_front_passenger-1774623274867.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_front_passenger-1774623274867.jpg saved to cache
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50ae2605-8afc-5032-b1f1-0a61d1887a17
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f40fb50>
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4903%252F18254903%252F18254903-interior_dashboard-modified-1774705739990.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4903/18254903/18254903-interior_dashboard-modified-1774705739990.jpeg saved to cache
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df5df73b-1df7-5e7f-9829-65ab406336f8
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca41850>
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4739%252F20484739%252Finterior_front_seats-1774694481361.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4739/20484739/interior_front_seats-1774694481361.jpg saved to cache
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1992f984-4732-557f-b7fb-9c3a9dbe8712
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd2d550>
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4739%252F20484739%252Finterior_rear_seats-1774694495917.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4739/20484739/interior_rear_seats-1774694495917.jpg saved to cache
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1992f984-4732-557f-b7fb-9c3a9dbe8712
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cecc750>
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1318%252F17851318%252Finterior_dashboard-1774625674027.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1318/17851318/interior_dashboard-1774625674027.jpg saved to cache
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 50ae2605-8afc-5032-b1f1-0a61d1887a17
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f40e810>
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6849%252F20486849%252Finterior_front_seats-1774699954077.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6849/20486849/interior_front_seats-1774699954077.jpg saved to cache
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93fdc899-6b55-5b19-bb63-d9915fb7542e
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da8f990>
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6849%252F20486849%252Finterior_rear_seats-1774699975513.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6849/20486849/interior_rear_seats-1774699975513.jpg saved to cache
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93fdc899-6b55-5b19-bb63-d9915fb7542e
2026-03-29 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0021/20220021/exterior_front_passenger-1774530129071.jpeg> (referer: None)
2026-03-29 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1318/17851318/instrument_cluster-1774625626932.jpg> (referer: None)
2026-03-29 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7058/20457058/interior_boot-1774629261477.jpg> (referer: None)
2026-03-29 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1318/17851318/docs_service_history-1774623927022.jpg?ixlib=js-3.8.0&auto=format&s=a2924f8d2caadf283ec2188e72db0a7a> (referer: None)
2026-03-29 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1318/17851318/interior_boot-1774623576463.jpg> (referer: None)
2026-03-29 20:08:09 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (13976512) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0021/20220021/damage_scratches-1774530757045.jpeg>.
2026-03-29 20:08:09 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (11298247) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0021/20220021/damage_scratches-1774530850705.jpeg>.
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9aad50>
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0021%252F20220021%252Fexterior_front_passenger-1774530129071.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0021/20220021/exterior_front_passenger-1774530129071.jpeg saved to cache
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af122423-9c3b-5192-a28e-75504427f4bb
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f419a10>
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1318%252F17851318%252Finstrument_cluster-1774625626932.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1318/17851318/instrument_cluster-1774625626932.jpg saved to cache
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 50ae2605-8afc-5032-b1f1-0a61d1887a17
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d67c490>
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7058%252F20457058%252Finterior_boot-1774629261477.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7058/20457058/interior_boot-1774629261477.jpg saved to cache
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d59b2d0>
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1318%252F17851318%252Fdocs_service_history-1774623927022.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da2924f8d2caadf283ec2188e72db0a7a') HTTP/1.1" 204 0
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1318/17851318/docs_service_history-1774623927022.jpg?ixlib=js-3.8.0&auto=format&s=a2924f8d2caadf283ec2188e72db0a7a saved to cache
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 50ae2605-8afc-5032-b1f1-0a61d1887a17
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f44a590>
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1318%252F17851318%252Finterior_boot-1774623576463.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1318/17851318/interior_boot-1774623576463.jpg saved to cache
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 50ae2605-8afc-5032-b1f1-0a61d1887a17
2026-03-29 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7058/20457058/docs_service_history-1774631318425.jpg?ixlib=js-3.8.0&auto=format&s=d901710fd1ab6cfbf9e52072765c3d68> (referer: None)
2026-03-29 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6849/20486849/docs_service_history-1774706008955.jpg?ixlib=js-3.8.0&auto=format&s=290b86f41441f83a3abb104daba7b180> (referer: None)
2026-03-29 20:08:10 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (11693392) larger than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/0021/20220021/interior_dashboard-1774530460578.jpeg>.
2026-03-29 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7058/20457058/interior_dashboard-1774629249635.jpg> (referer: None)
2026-03-29 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7058/20457058/instrument_cluster-1774629291953.jpg> (referer: None)
2026-03-29 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1318/17851318/interior_rear_seats-1774623662283.jpg> (referer: None)
2026-03-29 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4739/20484739/damage_scratches-1774694255080.jpg> (referer: None)
2026-03-29 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1318/17851318/interior_front_seats-1774623745304.jpg> (referer: None)
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d59abd0>
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7058%252F20457058%252Fdocs_service_history-1774631318425.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd901710fd1ab6cfbf9e52072765c3d68') HTTP/1.1" 204 0
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7058/20457058/docs_service_history-1774631318425.jpg?ixlib=js-3.8.0&auto=format&s=d901710fd1ab6cfbf9e52072765c3d68 saved to cache
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4a9610>
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6849%252F20486849%252Fdocs_service_history-1774706008955.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D290b86f41441f83a3abb104daba7b180') HTTP/1.1" 204 0
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6849/20486849/docs_service_history-1774706008955.jpg?ixlib=js-3.8.0&auto=format&s=290b86f41441f83a3abb104daba7b180 saved to cache
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 93fdc899-6b55-5b19-bb63-d9915fb7542e
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d58ffd0>
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7058%252F20457058%252Finterior_dashboard-1774629249635.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7058/20457058/interior_dashboard-1774629249635.jpg saved to cache
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dbecb50>
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7058%252F20457058%252Finstrument_cluster-1774629291953.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7058/20457058/instrument_cluster-1774629291953.jpg saved to cache
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8f6b90>
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1318%252F17851318%252Finterior_rear_seats-1774623662283.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1318/17851318/interior_rear_seats-1774623662283.jpg saved to cache
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 50ae2605-8afc-5032-b1f1-0a61d1887a17
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d58de50>
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4739%252F20484739%252Fdamage_scratches-1774694255080.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4739/20484739/damage_scratches-1774694255080.jpg saved to cache
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1992f984-4732-557f-b7fb-9c3a9dbe8712
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dbeecd0>
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1318%252F17851318%252Finterior_front_seats-1774623745304.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1318/17851318/interior_front_seats-1774623745304.jpg saved to cache
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50ae2605-8afc-5032-b1f1-0a61d1887a17
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18469041.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:11 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (11871421) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0021/20220021/interior_front_seats-1774530179374.jpeg>.
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_rear_passenger-1774623261412.jpg> (referer: None)
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4739/20484739/docs_service_history-1774694710285.jpg?ixlib=js-3.8.0&auto=format&s=5028f7a2cffb60e39cb71f99c575a18e> (referer: None)
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6849/20486849/instrument_cluster-1774700049815.jpg> (referer: None)
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0021/20220021/interior_boot-1774530309331.jpeg> (referer: None)
2026-03-29 20:08:11 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0021/20220021/damage_scratches-1774530757045.jpeg>.
2026-03-29 20:08:11 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0021/20220021/damage_scratches-1774530850705.jpeg>.
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4739/20484739/interior_boot-1774694556483.jpg> (referer: None)
2026-03-29 20:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dcd0150-ba09-56de-9bc6-733c2752d8a3 with identifier: 18469041
2026-03-29 20:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3 with scrape type 1
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9041%252F18469041%252Fexterior_front_driver-1774696579705.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9041/18469041/exterior_front_driver-1774696579705.jpg not downloaded yet
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9041%252F18469041%252Fexterior_rear_driver-1774535564504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9041/18469041/exterior_rear_driver-1774535564504.jpg not downloaded yet
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9041%252F18469041%252Fexterior_front_passenger-1774535556486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9041/18469041/exterior_front_passenger-1774535556486.jpg not downloaded yet
2026-03-29 20:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6849/20486849/interior_boot-1774700018996.jpg> (referer: None)
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8f5a50>
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1318%252F17851318%252Fexterior_rear_passenger-1774623261412.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_rear_passenger-1774623261412.jpg saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50ae2605-8afc-5032-b1f1-0a61d1887a17
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8f8910>
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4739%252F20484739%252Fdocs_service_history-1774694710285.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5028f7a2cffb60e39cb71f99c575a18e') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4739/20484739/docs_service_history-1774694710285.jpg?ixlib=js-3.8.0&auto=format&s=5028f7a2cffb60e39cb71f99c575a18e saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1992f984-4732-557f-b7fb-9c3a9dbe8712
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9041%252F18469041%252Fexterior_rear_passenger-1774535553923.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9041/18469041/exterior_rear_passenger-1774535553923.jpg not downloaded yet
2026-03-29 20:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0021/20220021/damage_scratches-1774530850705.jpeg> (referer: None)
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9041%252F18469041%252Finterior_front_seats-1774695953902.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9041/18469041/interior_front_seats-1774695953902.jpg not downloaded yet
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9041%252F18469041%252Finterior_rear_seats-1774695894056.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9041/18469041/interior_rear_seats-1774695894056.jpg not downloaded yet
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f629ed0>
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6849%252F20486849%252Finstrument_cluster-1774700049815.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6849/20486849/instrument_cluster-1774700049815.jpg saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 93fdc899-6b55-5b19-bb63-d9915fb7542e
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x84l\x81\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06b\xea\x00\x84a\xf1\x00\x00\x00\x00'
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c74db10>
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0021%252F20220021%252Finterior_boot-1774530309331.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0021/20220021/interior_boot-1774530309331.jpeg saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af122423-9c3b-5192-a28e-75504427f4bb
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d947610>
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4739%252F20484739%252Finterior_boot-1774694556483.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4739/20484739/interior_boot-1774694556483.jpg saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1992f984-4732-557f-b7fb-9c3a9dbe8712
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d944050>
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6849%252F20486849%252Finterior_boot-1774700018996.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6849/20486849/interior_boot-1774700018996.jpg saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 93fdc899-6b55-5b19-bb63-d9915fb7542e
2026-03-29 20:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7058/20457058/interior_rear_seats-1774629214681.jpg> (referer: None)
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9041%252F18469041%252Finterior_dashboard-1774695901565.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9041/18469041/interior_dashboard-1774695901565.jpg not downloaded yet
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9041%252F18469041%252Finstrument_cluster-1774695838300.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9041/18469041/instrument_cluster-1774695838300.jpg not downloaded yet
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xa7\xf4\xd0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04p\xf7\x00\xa7\xea@\x00\x00\x00\x00'
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db7ff10>
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0021%252F20220021%252Fdamage_scratches-1774530850705.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0021/20220021/damage_scratches-1774530850705.jpeg saved to cache
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af122423-9c3b-5192-a28e-75504427f4bb
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9041%252F18469041%252Finterior_boot-1774695889256.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9041/18469041/interior_boot-1774695889256.jpg not downloaded yet
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9041%252F18469041%252Fdocs_service_history-1774696192950.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D26da585567a6125e10f20d98d896eba6%27 HTTP/1.1" 200 None
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9041/18469041/docs_service_history-1774696192950.jpg?ixlib=js-3.8.0&auto=format&s=26da585567a6125e10f20d98d896eba6 not downloaded yet
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c87d890>
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7058%252F20457058%252Finterior_rear_seats-1774629214681.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7058/20457058/interior_rear_seats-1774629214681.jpg saved to cache
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_rear_driver-1774623248211.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_rear_passenger-1774628520694.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6849/20486849/interior_dashboard-1774700010436.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0021/20220021/damage_scratches-1774530757045.jpeg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4739/20484739/interior_dashboard-1774694529917.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7058/20457058/interior_front_seats-1774629200723.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0021/20220021/exterior_rear_passenger-1774530150557.jpeg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/0021/20220021/interior_dashboard-1774530460578.jpeg>.
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0021/20220021/instrument_cluster-1774530603728.jpeg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0021/20220021/interior_dashboard-1774530460578.jpeg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0021/20220021/interior_front_seats-1774530179374.jpeg>.
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0021/20220021/interior_front_seats-1774530179374.jpeg> (referer: None)
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c74eed0>
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1318%252F17851318%252Fexterior_rear_driver-1774623248211.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_rear_driver-1774623248211.jpg saved to cache
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50ae2605-8afc-5032-b1f1-0a61d1887a17
2026-03-29 20:08:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50ae2605-8afc-5032-b1f1-0a61d1887a17, skipping ID generation
2026-03-29 20:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50ae2605-8afc-5032-b1f1-0a61d1887a17 with scrape type 1
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50ae2605-8afc-5032-b1f1-0a61d1887a17 sending to next pipeline
2026-03-29 20:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 50ae2605-8afc-5032-b1f1-0a61d1887a17, identifier: 17851318
2026-03-29 20:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 50ae2605-8afc-5032-b1f1-0a61d1887a17 with identifier: 17851318
2026-03-29 20:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 50ae2605-8afc-5032-b1f1-0a61d1887a17 with identifier: 17851318
2026-03-29 20:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 50ae2605-8afc-5032-b1f1-0a61d1887a17 with identifier: 17851318 to the API
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_rear_driver-1774623248211.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '50ae2605-8afc-5032-b1f1-0a61d1887a17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MNZ 434',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17851318',
'listing': 'auction',
'location': 'Nottinghamshire Worksop',
'make': 'Audi',
'model': 'Q7',
'odometer': 46500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1235173,
'Height': 2477,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_front_driver-1774623234774.jpg',
'Width': 3303},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1376697,
'Height': 2444,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_rear_driver-1774623248211.jpg',
'Width': 3258},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1847769,
'Height': 2759,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_front_passenger-1774623274867.jpg',
'Width': 3678},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1434709,
'Height': 2318,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1318/17851318/exterior_rear_passenger-1774623261412.jpg',
'Width': 3090},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3315205,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1318/17851318/interior_front_seats-1774623745304.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2822632,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1318/17851318/interior_rear_seats-1774623662283.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2215511,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1318/17851318/interior_dashboard-1774625674027.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1799581,
'Height': 2771,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1318/17851318/instrument_cluster-1774625626932.jpg',
'Width': 3694},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4023626,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1318/17851318/interior_boot-1774623576463.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50ae2605-8afc-5032-b1f1-0a61d1887a17/50ae2605-8afc-5032-b1f1-0a61d1887a17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3301339,
'Height': 3458,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1318/17851318/docs_service_history-1774623927022.jpg?ixlib=js-3.8.0&auto=format&s=a2924f8d2caadf283ec2188e72db0a7a',
'Width': 2402}],
'price': 27267,
'price_includes_vat': False,
'registration_date': '2018-06-23',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q7 S Line Black ED TDI QU',
'transmission': 'automatic',
'trim': 'S Line Black ED TDI QU',
'vin': 'WAUZZZ4MXJD050846',
'year': 2018}
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717851318%27 HTTP/1.1" 200 None
2026-03-29 20:08:14 [motorway.uk] INFO: Saving data for 17851318: {'created_time': 1774814894.676871, 'last_price_update_time': 1774814894.676882, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17851318') HTTP/1.1" 204 0
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cba1a10>
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7058%252F20457058%252Fexterior_rear_passenger-1774628520694.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_rear_passenger-1774628520694.jpg saved to cache
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0b22d0>
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6849%252F20486849%252Finterior_dashboard-1774700010436.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6849/20486849/interior_dashboard-1774700010436.jpg saved to cache
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 93fdc899-6b55-5b19-bb63-d9915fb7542e
2026-03-29 20:08:14 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:14 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:14 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xccO0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xf4\x90\x00\xccD\xa0\x00\x00\x00\x00'
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d90efd0>
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0021%252F20220021%252Fdamage_scratches-1774530757045.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0021/20220021/damage_scratches-1774530757045.jpeg saved to cache
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af122423-9c3b-5192-a28e-75504427f4bb
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dee4c10>
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4739%252F20484739%252Finterior_dashboard-1774694529917.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4739/20484739/interior_dashboard-1774694529917.jpg saved to cache
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1992f984-4732-557f-b7fb-9c3a9dbe8712
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0760d0>
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7058%252F20457058%252Finterior_front_seats-1774629200723.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7058/20457058/interior_front_seats-1774629200723.jpg saved to cache
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9a9d90>
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0021%252F20220021%252Fexterior_rear_passenger-1774530150557.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0021/20220021/exterior_rear_passenger-1774530150557.jpeg saved to cache
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af122423-9c3b-5192-a28e-75504427f4bb
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x99j\x1b\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04rV\x00\x99_\x8b\x00\x00\x00\x00'
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dee6ad0>
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0021%252F20220021%252Finstrument_cluster-1774530603728.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0021/20220021/instrument_cluster-1774530603728.jpeg saved to cache
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af122423-9c3b-5192-a28e-75504427f4bb
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xa8\xc3Y\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\t\xa9\xf7\x00\xa8\xb8\xc9\x00\x00\x00\x00'
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c919490>
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0021%252F20220021%252Finterior_dashboard-1774530460578.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0021/20220021/interior_dashboard-1774530460578.jpeg saved to cache
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af122423-9c3b-5192-a28e-75504427f4bb
2026-03-29 20:08:16 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:16 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:16 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xadj\xe4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07\xb9\xd9\x00\xad`T\x00\x00\x00\x00'
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d90ced0>
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0021%252F20220021%252Finterior_front_seats-1774530179374.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0021/20220021/interior_front_seats-1774530179374.jpeg saved to cache
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af122423-9c3b-5192-a28e-75504427f4bb
2026-03-29 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9041/18469041/interior_front_seats-1774695953902.jpg> (referer: None)
2026-03-29 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9041/18469041/interior_dashboard-1774695901565.jpg> (referer: None)
2026-03-29 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9041/18469041/exterior_rear_driver-1774535564504.jpg> (referer: None)
2026-03-29 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9041/18469041/exterior_front_passenger-1774535556486.jpg> (referer: None)
2026-03-29 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9041/18469041/exterior_rear_passenger-1774535553923.jpg> (referer: None)
2026-03-29 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9041/18469041/instrument_cluster-1774695838300.jpg> (referer: None)
2026-03-29 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9041/18469041/docs_service_history-1774696192950.jpg?ixlib=js-3.8.0&auto=format&s=26da585567a6125e10f20d98d896eba6> (referer: None)
2026-03-29 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9041/18469041/interior_rear_seats-1774695894056.jpg> (referer: None)
2026-03-29 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9041/18469041/interior_boot-1774695889256.jpg> (referer: None)
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d98f590>
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9041%252F18469041%252Finterior_front_seats-1774695953902.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9041/18469041/interior_front_seats-1774695953902.jpg saved to cache
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d98db10>
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9041%252F18469041%252Finterior_dashboard-1774695901565.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9041/18469041/interior_dashboard-1774695901565.jpg saved to cache
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c91df50>
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9041%252F18469041%252Fexterior_rear_driver-1774535564504.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9041/18469041/exterior_rear_driver-1774535564504.jpg saved to cache
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e106b10>
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9041%252F18469041%252Fexterior_front_passenger-1774535556486.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9041/18469041/exterior_front_passenger-1774535556486.jpg saved to cache
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c91ecd0>
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9041%252F18469041%252Fexterior_rear_passenger-1774535553923.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9041/18469041/exterior_rear_passenger-1774535553923.jpg saved to cache
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5756d0>
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9041%252F18469041%252Finstrument_cluster-1774695838300.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9041/18469041/instrument_cluster-1774695838300.jpg saved to cache
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9a8750>
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9041%252F18469041%252Fdocs_service_history-1774696192950.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D26da585567a6125e10f20d98d896eba6') HTTP/1.1" 204 0
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9041/18469041/docs_service_history-1774696192950.jpg?ixlib=js-3.8.0&auto=format&s=26da585567a6125e10f20d98d896eba6 saved to cache
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dde0250>
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9041%252F18469041%252Finterior_rear_seats-1774695894056.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9041/18469041/interior_rear_seats-1774695894056.jpg saved to cache
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9a96d0>
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9041%252F18469041%252Finterior_boot-1774695889256.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9041/18469041/interior_boot-1774695889256.jpg saved to cache
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3
2026-03-29 20:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9041/18469041/exterior_front_driver-1774696579705.jpg> (referer: None)
2026-03-29 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4739/20484739/exterior_rear_driver-1774694159379.jpg> (referer: None)
2026-03-29 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4739/20484739/exterior_front_passenger-1774694190800.jpg> (referer: None)
2026-03-29 20:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_front_driver-1774628488392.jpg> (referer: None)
2026-03-29 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4739/20484739/exterior_rear_passenger-1774694170967.jpg> (referer: None)
2026-03-29 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9305/18709305/interior_rear_seats-1774773761494.jpg> (referer: None)
2026-03-29 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_rear_driver-1774699171632.jpg> (referer: None)
2026-03-29 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_rear_passenger-1774699229562.jpg> (referer: None)
2026-03-29 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_front_passenger-1774699252233.jpg> (referer: None)
2026-03-29 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4739/20484739/exterior_front_driver-1774695188166.jpg> (referer: None)
2026-03-29 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0021/20220021/exterior_rear_driver-1774530157822.jpeg> (referer: None)
2026-03-29 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0021/20220021/20220021-exterior_front_driver-modified-1774531938611.jpeg> (referer: None)
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db6d050>
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9041%252F18469041%252Fexterior_front_driver-1774696579705.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9041/18469041/exterior_front_driver-1774696579705.jpg saved to cache
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3
2026-03-29 20:08:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1dcd0150-ba09-56de-9bc6-733c2752d8a3, skipping ID generation
2026-03-29 20:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3 with scrape type 1
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1dcd0150-ba09-56de-9bc6-733c2752d8a3 sending to next pipeline
2026-03-29 20:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1dcd0150-ba09-56de-9bc6-733c2752d8a3, identifier: 18469041
2026-03-29 20:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1dcd0150-ba09-56de-9bc6-733c2752d8a3 with identifier: 18469041
2026-03-29 20:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1dcd0150-ba09-56de-9bc6-733c2752d8a3 with identifier: 18469041
2026-03-29 20:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1dcd0150-ba09-56de-9bc6-733c2752d8a3 with identifier: 18469041 to the API
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/9041/18469041/exterior_front_driver-1774696579705.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '1dcd0150-ba09-56de-9bc6-733c2752d8a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DT17 WWN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18469041',
'listing': 'auction',
'location': 'Warwickshire Nuneaton',
'make': 'Vauxhall',
'model': 'Mokka',
'odometer': 37555,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1620445,
'Height': 2753,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9041/18469041/exterior_front_driver-1774696579705.jpg',
'Width': 3671},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 775363,
'Height': 2292,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9041/18469041/exterior_rear_driver-1774535564504.jpg',
'Width': 3056},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1037728,
'Height': 2457,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9041/18469041/exterior_front_passenger-1774535556486.jpg',
'Width': 3276},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1235831,
'Height': 2811,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9041/18469041/exterior_rear_passenger-1774535553923.jpg',
'Width': 3748},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1807548,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9041/18469041/interior_front_seats-1774695953902.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1600466,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9041/18469041/interior_rear_seats-1774695894056.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765775,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9041/18469041/interior_dashboard-1774695901565.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1397229,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9041/18469041/instrument_cluster-1774695838300.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1823827,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9041/18469041/interior_boot-1774695889256.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dcd0150-ba09-56de-9bc6-733c2752d8a3/1dcd0150-ba09-56de-9bc6-733c2752d8a3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1520972,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9041/18469041/docs_service_history-1774696192950.jpg?ixlib=js-3.8.0&auto=format&s=26da585567a6125e10f20d98d896eba6',
'Width': 3840}],
'price': 7833,
'price_includes_vat': False,
'registration_date': '2017-07-11',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Mokka X Elite Turbo Auto',
'transmission': 'automatic',
'trim': 'X Elite Turbo Auto',
'vin': 'W0LJD7E87HB204857',
'year': 2017}
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718469041%27 HTTP/1.1" 200 None
2026-03-29 20:08:18 [motorway.uk] INFO: Saving data for 18469041: {'created_time': 1774814898.476038, 'last_price_update_time': 1774814898.47605, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18469041') HTTP/1.1" 204 0
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd66bd0>
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4739%252F20484739%252Fexterior_rear_driver-1774694159379.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4739/20484739/exterior_rear_driver-1774694159379.jpg saved to cache
2026-03-29 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1992f984-4732-557f-b7fb-9c3a9dbe8712
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5fa510>
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4739%252F20484739%252Fexterior_front_passenger-1774694190800.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4739/20484739/exterior_front_passenger-1774694190800.jpg saved to cache
2026-03-29 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1992f984-4732-557f-b7fb-9c3a9dbe8712
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3eb050>
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7058%252F20457058%252Fexterior_front_driver-1774628488392.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_front_driver-1774628488392.jpg saved to cache
2026-03-29 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983
2026-03-29 20:08:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f5bcdd6-c0b1-51e1-8299-fb524b733983, skipping ID generation
2026-03-29 20:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983 with scrape type 1
2026-03-29 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f5bcdd6-c0b1-51e1-8299-fb524b733983 sending to next pipeline
2026-03-29 20:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1f5bcdd6-c0b1-51e1-8299-fb524b733983, identifier: 20457058
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd679d0>
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4739%252F20484739%252Fexterior_rear_passenger-1774694170967.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4739/20484739/exterior_rear_passenger-1774694170967.jpg saved to cache
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1992f984-4732-557f-b7fb-9c3a9dbe8712
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d653e10>
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9305%252F18709305%252Finterior_rear_seats-1774773761494.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9305/18709305/interior_rear_seats-1774773761494.jpg saved to cache
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d11bcd0>
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6849%252F20486849%252Fexterior_rear_driver-1774699171632.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_rear_driver-1774699171632.jpg saved to cache
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93fdc899-6b55-5b19-bb63-d9915fb7542e
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cea8710>
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6849%252F20486849%252Fexterior_rear_passenger-1774699229562.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_rear_passenger-1774699229562.jpg saved to cache
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93fdc899-6b55-5b19-bb63-d9915fb7542e
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce1c950>
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6849%252F20486849%252Fexterior_front_passenger-1774699252233.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_front_passenger-1774699252233.jpg saved to cache
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93fdc899-6b55-5b19-bb63-d9915fb7542e
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6e7a10>
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4739%252F20484739%252Fexterior_front_driver-1774695188166.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4739/20484739/exterior_front_driver-1774695188166.jpg saved to cache
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1992f984-4732-557f-b7fb-9c3a9dbe8712
2026-03-29 20:08:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1992f984-4732-557f-b7fb-9c3a9dbe8712, skipping ID generation
2026-03-29 20:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1992f984-4732-557f-b7fb-9c3a9dbe8712 with scrape type 1
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1992f984-4732-557f-b7fb-9c3a9dbe8712 sending to next pipeline
2026-03-29 20:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1992f984-4732-557f-b7fb-9c3a9dbe8712, identifier: 20484739
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2be890>
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0021%252F20220021%252Fexterior_rear_driver-1774530157822.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0021/20220021/exterior_rear_driver-1774530157822.jpeg saved to cache
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af122423-9c3b-5192-a28e-75504427f4bb
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2deb21d0>
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0021%252F20220021%252F20220021-exterior_front_driver-modified-1774531938611.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0021/20220021/20220021-exterior_front_driver-modified-1774531938611.jpeg saved to cache
2026-03-29 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af122423-9c3b-5192-a28e-75504427f4bb
2026-03-29 20:08:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af122423-9c3b-5192-a28e-75504427f4bb, skipping ID generation
2026-03-29 20:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af122423-9c3b-5192-a28e-75504427f4bb with scrape type 1
2026-03-29 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af122423-9c3b-5192-a28e-75504427f4bb sending to next pipeline
2026-03-29 20:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: af122423-9c3b-5192-a28e-75504427f4bb, identifier: 20220021
2026-03-29 20:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1f5bcdd6-c0b1-51e1-8299-fb524b733983 with identifier: 20457058
2026-03-29 20:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1f5bcdd6-c0b1-51e1-8299-fb524b733983 with identifier: 20457058
2026-03-29 20:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1f5bcdd6-c0b1-51e1-8299-fb524b733983 with identifier: 20457058 to the API
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_front_driver-1774628488392.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '1f5bcdd6-c0b1-51e1-8299-fb524b733983',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'WN70 JHV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20457058',
'listing': 'auction',
'location': 'North Yorkshire Selby',
'make': 'Ford',
'model': 'Ranger',
'odometer': 60989,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2024081,
'Height': 2537,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_front_driver-1774628488392.jpg',
'Width': 3383},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1217971,
'Height': 2232,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_rear_driver-1774628500195.jpg',
'Width': 2976},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1810765,
'Height': 2261,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_front_passenger-1774628564916.jpg',
'Width': 3015},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1547178,
'Height': 2727,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7058/20457058/exterior_rear_passenger-1774628520694.jpg',
'Width': 3636},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4144407,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7058/20457058/interior_front_seats-1774629200723.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4202164,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7058/20457058/interior_rear_seats-1774629214681.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2023908,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7058/20457058/interior_dashboard-1774629249635.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2743861,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7058/20457058/instrument_cluster-1774629291953.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4531541,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7058/20457058/interior_boot-1774629261477.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5bcdd6-c0b1-51e1-8299-fb524b733983/1f5bcdd6-c0b1-51e1-8299-fb524b733983_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 810799,
'Height': 3660,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7058/20457058/docs_service_history-1774631318425.jpg?ixlib=js-3.8.0&auto=format&s=d901710fd1ab6cfbf9e52072765c3d68',
'Width': 2577}],
'price': 13198,
'price_includes_vat': False,
'registration_date': '2020-09-18',
'seats_number': None,
'seller_name': None,
'title': 'Ford Ranger Wildtrak Ecoblue 4X4 A',
'transmission': 'automatic',
'trim': 'Wildtrak Ecoblue 4X4 A',
'vin': '6FPPXXMJ2PLK13895',
'year': 2020}
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720457058%27 HTTP/1.1" 200 None
2026-03-29 20:08:20 [motorway.uk] INFO: Saving data for 20457058: {'created_time': 1774814900.605774, 'last_price_update_time': 1774814900.605784, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20457058') HTTP/1.1" 204 0
2026-03-29 20:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1992f984-4732-557f-b7fb-9c3a9dbe8712 with identifier: 20484739
2026-03-29 20:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1992f984-4732-557f-b7fb-9c3a9dbe8712 with identifier: 20484739
2026-03-29 20:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1992f984-4732-557f-b7fb-9c3a9dbe8712 with identifier: 20484739 to the API
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/4739/20484739/exterior_front_driver-1774695188166.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '1992f984-4732-557f-b7fb-9c3a9dbe8712',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK24 MYC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20484739',
'listing': 'auction',
'location': 'Greater Manchester Wigan',
'make': 'BMW',
'model': '2 Series',
'odometer': 39338,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2200129,
'Height': 2524,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4739/20484739/exterior_front_driver-1774695188166.jpg',
'Width': 3365},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1251652,
'Height': 2334,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4739/20484739/exterior_rear_driver-1774694159379.jpg',
'Width': 3112},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1279513,
'Height': 2241,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4739/20484739/exterior_front_passenger-1774694190800.jpg',
'Width': 2988},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1548917,
'Height': 2507,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4739/20484739/exterior_rear_passenger-1774694170967.jpg',
'Width': 3343},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3068095,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4739/20484739/interior_front_seats-1774694481361.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3606741,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4739/20484739/interior_rear_seats-1774694495917.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2948086,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4739/20484739/interior_dashboard-1774694529917.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3449146,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4739/20484739/interior_boot-1774694556483.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2074778,
'Height': 1326,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4739/20484739/docs_service_history-1774694710285.jpg?ixlib=js-3.8.0&auto=format&s=5028f7a2cffb60e39cb71f99c575a18e',
'Width': 1792},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1992f984-4732-557f-b7fb-9c3a9dbe8712/1992f984-4732-557f-b7fb-9c3a9dbe8712_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3027946,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4739/20484739/damage_scratches-1774694255080.jpg',
'Width': 4032}],
'price': 24848,
'price_includes_vat': False,
'registration_date': '2024-03-18',
'seats_number': None,
'seller_name': None,
'title': 'BMW 230I M Sport Auto',
'transmission': 'automatic',
'trim': '230I M Sport Auto',
'vin': 'WBA22CM0108D75444',
'year': 2024}
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484739%27 HTTP/1.1" 200 None
2026-03-29 20:08:20 [motorway.uk] INFO: Saving data for 20484739: {'created_time': 1774814900.989174, 'last_price_update_time': 1774814900.989187, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20484739') HTTP/1.1" 204 0
2026-03-29 20:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: af122423-9c3b-5192-a28e-75504427f4bb with identifier: 20220021
2026-03-29 20:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: af122423-9c3b-5192-a28e-75504427f4bb with identifier: 20220021
2026-03-29 20:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: af122423-9c3b-5192-a28e-75504427f4bb with identifier: 20220021 to the API
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0021/20220021/20220021-exterior_front_driver-modified-1774531938611.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'af122423-9c3b-5192-a28e-75504427f4bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BN17 WZD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20220021',
'listing': 'auction',
'location': 'Milton Keynes Milton Keynes',
'make': 'Vauxhall',
'model': 'Vivaro',
'odometer': 122000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7827859,
'Height': 5369,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0021/20220021/20220021-exterior_front_driver-modified-1774531938611.jpeg',
'Width': 7159},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5061162,
'Height': 4852,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0021/20220021/exterior_rear_driver-1774530157822.jpeg',
'Width': 6469},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6237292,
'Height': 5499,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0021/20220021/exterior_front_passenger-1774530129071.jpeg',
'Width': 7332},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5380416,
'Height': 5290,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0021/20220021/exterior_rear_passenger-1774530150557.jpeg',
'Width': 7053},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 11871421,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/0021/20220021/interior_front_seats-1774530179374.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 11693392,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0021/20220021/interior_dashboard-1774530460578.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 10345585,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0021/20220021/instrument_cluster-1774530603728.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 9097067,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/0021/20220021/interior_boot-1774530309331.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 13976512,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/0021/20220021/damage_scratches-1774530757045.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af122423-9c3b-5192-a28e-75504427f4bb/af122423-9c3b-5192-a28e-75504427f4bb_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 11298247,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/0021/20220021/damage_scratches-1774530850705.jpeg',
'Width': 8064}],
'price': 3157,
'price_includes_vat': False,
'registration_date': '2017-03-21',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Vivaro 2700 CDTI ecoFLEX S/S',
'transmission': 'manual',
'trim': '2700 CDTI ecoFLEX S/S',
'vin': 'W0LF7F60XHV624191',
'year': 2017}
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720220021%27 HTTP/1.1" 200 None
2026-03-29 20:08:21 [motorway.uk] INFO: Saving data for 20220021: {'created_time': 1774814901.389261, 'last_price_update_time': 1774814901.389271, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20220021') HTTP/1.1" 204 0
2026-03-29 20:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9305/18709305/interior_front_seats-1774773635020.jpg> (referer: None)
2026-03-29 20:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4903/18254903/exterior_front_passenger-1770994162819.jpg> (referer: None)
2026-03-29 20:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4903/18254903/exterior_rear_passenger-1770994237311.jpg> (referer: None)
2026-03-29 20:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_front_driver-1774699124863.jpg> (referer: None)
2026-03-29 20:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9305/18709305/18709305-interior_dashboard-modified-1774775328156.jpeg> (referer: None)
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4ef7d0>
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9305%252F18709305%252Finterior_front_seats-1774773635020.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9305/18709305/interior_front_seats-1774773635020.jpg saved to cache
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f3433c190>
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4903%252F18254903%252Fexterior_front_passenger-1770994162819.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4903/18254903/exterior_front_passenger-1770994162819.jpg saved to cache
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df5df73b-1df7-5e7f-9829-65ab406336f8
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d98c910>
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4903%252F18254903%252Fexterior_rear_passenger-1770994237311.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4903/18254903/exterior_rear_passenger-1770994237311.jpg saved to cache
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df5df73b-1df7-5e7f-9829-65ab406336f8
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cac9210>
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6849%252F20486849%252Fexterior_front_driver-1774699124863.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_front_driver-1774699124863.jpg saved to cache
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93fdc899-6b55-5b19-bb63-d9915fb7542e
2026-03-29 20:08:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93fdc899-6b55-5b19-bb63-d9915fb7542e, skipping ID generation
2026-03-29 20:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93fdc899-6b55-5b19-bb63-d9915fb7542e with scrape type 1
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93fdc899-6b55-5b19-bb63-d9915fb7542e sending to next pipeline
2026-03-29 20:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 93fdc899-6b55-5b19-bb63-d9915fb7542e, identifier: 20486849
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc89410>
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9305%252F18709305%252F18709305-interior_dashboard-modified-1774775328156.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9305/18709305/18709305-interior_dashboard-modified-1774775328156.jpeg saved to cache
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1
2026-03-29 20:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 93fdc899-6b55-5b19-bb63-d9915fb7542e with identifier: 20486849
2026-03-29 20:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 93fdc899-6b55-5b19-bb63-d9915fb7542e with identifier: 20486849
2026-03-29 20:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 93fdc899-6b55-5b19-bb63-d9915fb7542e with identifier: 20486849 to the API
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_front_driver-1774699124863.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '93fdc899-6b55-5b19-bb63-d9915fb7542e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LB70 ZCN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20486849',
'listing': 'auction',
'location': 'West Sussex Burgess Hill',
'make': 'Mazda',
'model': 'CX-30',
'odometer': 44820,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2322486,
'Height': 2745,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_front_driver-1774699124863.jpg',
'Width': 3660},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2372187,
'Height': 2930,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_rear_driver-1774699171632.jpg',
'Width': 3907},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2697446,
'Height': 2835,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_front_passenger-1774699252233.jpg',
'Width': 3780},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2440686,
'Height': 2822,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6849/20486849/exterior_rear_passenger-1774699229562.jpg',
'Width': 3762},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3610128,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6849/20486849/interior_front_seats-1774699954077.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3613815,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6849/20486849/interior_rear_seats-1774699975513.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1586599,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6849/20486849/interior_dashboard-1774700010436.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2716552,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6849/20486849/instrument_cluster-1774700049815.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3832746,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6849/20486849/interior_boot-1774700018996.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93fdc899-6b55-5b19-bb63-d9915fb7542e/93fdc899-6b55-5b19-bb63-d9915fb7542e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 983319,
'Height': 4356,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6849/20486849/docs_service_history-1774706008955.jpg?ixlib=js-3.8.0&auto=format&s=290b86f41441f83a3abb104daba7b180',
'Width': 2929}],
'price': 12414,
'price_includes_vat': False,
'registration_date': '2020-12-19',
'seats_number': None,
'seller_name': None,
'title': 'Mazda CX-30 GT Sport MHEV',
'transmission': 'manual',
'trim': 'GT Sport MHEV',
'vin': 'JMZDM6WH600146322',
'year': 2020}
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486849%27 HTTP/1.1" 200 None
2026-03-29 20:08:22 [motorway.uk] INFO: Saving data for 20486849: {'created_time': 1774814902.408014, 'last_price_update_time': 1774814902.408026, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20486849') HTTP/1.1" 204 0
2026-03-29 20:08:22 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (14486234) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8404/20158404/interior_front_seats-1773062417573.jpeg>.
2026-03-29 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_rear_driver-1774773574177.jpg> (referer: None)
2026-03-29 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_rear_passenger-1774773555900.jpg> (referer: None)
2026-03-29 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_front_passenger-1774773522181.jpg> (referer: None)
2026-03-29 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8920/20468920/exterior_rear_driver-1774606771382.jpg> (referer: None)
2026-03-29 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9750/20459750/exterior_rear_driver-1774706219940.jpg> (referer: None)
2026-03-29 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4903/18254903/exterior_rear_driver-1770994248940.jpg> (referer: None)
2026-03-29 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2589/20372589/interior_boot-1774112343928.jpg> (referer: None)
2026-03-29 20:08:22 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8404/20158404/interior_front_seats-1773062417573.jpeg>.
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0e4cd0>
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9305%252F18709305%252Fexterior_rear_driver-1774773574177.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_rear_driver-1774773574177.jpg saved to cache
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0e6410>
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9305%252F18709305%252Fexterior_rear_passenger-1774773555900.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_rear_passenger-1774773555900.jpg saved to cache
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35cabbd0>
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9305%252F18709305%252Fexterior_front_passenger-1774773522181.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_front_passenger-1774773522181.jpg saved to cache
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1
2026-03-29 20:08:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1, skipping ID generation
2026-03-29 20:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1 with scrape type 1
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1 sending to next pipeline
2026-03-29 20:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1, identifier: 18709305
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0e52d0>
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8920%252F20468920%252Fexterior_rear_driver-1774606771382.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8920/20468920/exterior_rear_driver-1774606771382.jpg saved to cache
2026-03-29 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5
2026-03-29 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0e6dd0>
2026-03-29 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9750%252F20459750%252Fexterior_rear_driver-1774706219940.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9750/20459750/exterior_rear_driver-1774706219940.jpg saved to cache
2026-03-29 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077
2026-03-29 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd2cc50>
2026-03-29 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4903%252F18254903%252Fexterior_rear_driver-1770994248940.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4903/18254903/exterior_rear_driver-1770994248940.jpg saved to cache
2026-03-29 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df5df73b-1df7-5e7f-9829-65ab406336f8
2026-03-29 20:08:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df5df73b-1df7-5e7f-9829-65ab406336f8, skipping ID generation
2026-03-29 20:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df5df73b-1df7-5e7f-9829-65ab406336f8 with scrape type 1
2026-03-29 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df5df73b-1df7-5e7f-9829-65ab406336f8 sending to next pipeline
2026-03-29 20:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: df5df73b-1df7-5e7f-9829-65ab406336f8, identifier: 18254903
2026-03-29 20:08:23 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x0c\x00\x00'
2026-03-29 20:08:23 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:08:23 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:21 16:58:53\x00'
2026-03-29 20:08:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:23 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x10\x00\x00'
2026-03-29 20:08:23 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'ThinkPhone 25 by motorola\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:23 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'vienna_g_syset-user 15 V2UIS35.\x00'
2026-03-29 20:08:23 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:23 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:08:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f419810>
2026-03-29 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2589%252F20372589%252Finterior_boot-1774112343928.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2589/20372589/interior_boot-1774112343928.jpg saved to cache
2026-03-29 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1dca530e-49ed-53ab-98d9-22b256fd4813
2026-03-29 20:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1 with identifier: 18709305
2026-03-29 20:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1 with identifier: 18709305
2026-03-29 20:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1 with identifier: 18709305 to the API
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_front_passenger-1774773522181.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD19 POS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18709305',
'listing': 'auction',
'location': 'West Yorkshire Bradford',
'make': 'BMW',
'model': '1 Series',
'odometer': 41650,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622448,
'Height': 1760,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_front_driver-1774773497917.jpg',
'Width': 2346},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307367,
'Height': 1210,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_rear_driver-1774773574177.jpg',
'Width': 1613},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430234,
'Height': 1556,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_front_passenger-1774773522181.jpg',
'Width': 2075},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352864,
'Height': 1329,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9305/18709305/exterior_rear_passenger-1774773555900.jpg',
'Width': 1772},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1062937,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9305/18709305/interior_front_seats-1774773635020.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 704234,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9305/18709305/interior_rear_seats-1774773761494.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2554657,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9305/18709305/18709305-interior_dashboard-modified-1774775328156.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1892727,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9305/18709305/interior_boot-1774773723479.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1989979,
'Height': 3000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9305/18709305/18709305-docs_service_history-default-1774773108660.jpeg?ixlib=js-3.8.0&auto=format&s=59a112b01f813e140763faa407ac05b2',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1/9f86a0ff-8be5-53ea-8fb9-28c2bc96cef1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418246,
'Height': 3179,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9305/18709305/18709305-docs_service_history-default-1774773123062.jpg?ixlib=js-3.8.0&auto=format&s=f59c2c593fd80386425439f8bcfd1c97',
'Width': 2255}],
'price': 14167,
'price_includes_vat': False,
'registration_date': '2019-07-19',
'seats_number': None,
'seller_name': None,
'title': 'BMW 120D xDrive M Sport Shadow ED A',
'transmission': 'automatic',
'trim': '120D xDrive M Sport Shadow ED A',
'vin': 'WBA1T120607E13479',
'year': 2019}
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718709305%27 HTTP/1.1" 200 None
2026-03-29 20:08:23 [motorway.uk] INFO: Saving data for 18709305: {'created_time': 1774814903.924843, 'last_price_update_time': 1774814903.924856, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18709305') HTTP/1.1" 204 0
2026-03-29 20:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: df5df73b-1df7-5e7f-9829-65ab406336f8 with identifier: 18254903
2026-03-29 20:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: df5df73b-1df7-5e7f-9829-65ab406336f8 with identifier: 18254903
2026-03-29 20:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: df5df73b-1df7-5e7f-9829-65ab406336f8 with identifier: 18254903 to the API
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4903/18254903/exterior_rear_driver-1770994248940.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'df5df73b-1df7-5e7f-9829-65ab406336f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL17 FHV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18254903',
'listing': 'auction',
'location': 'Perth and Kinross Perth',
'make': 'Smart',
'model': 'fortwo',
'odometer': 24337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1538785,
'Height': 1924,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4903/18254903/18254903-exterior_front_driver-modified-1774705760021.jpeg',
'Width': 2565},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2647191,
'Height': 2851,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4903/18254903/exterior_rear_driver-1770994248940.jpg',
'Width': 3801},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1346137,
'Height': 1957,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4903/18254903/exterior_front_passenger-1770994162819.jpg',
'Width': 2609},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1791754,
'Height': 2322,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4903/18254903/exterior_rear_passenger-1770994237311.jpg',
'Width': 3096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3116521,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4903/18254903/interior_front_seats-1770994280422.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3757968,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4903/18254903/18254903-interior_dashboard-modified-1774705739990.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3075290,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4903/18254903/instrument_cluster-1774707053741.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3355235,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4903/18254903/interior_boot-1770994360795.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1201861,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4903/18254903/docs_service_history-1773417244204.jpg?ixlib=js-3.8.0&auto=format&s=3a9459b96110044bfc358eb405fe017a',
'Width': 3000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5df73b-1df7-5e7f-9829-65ab406336f8/df5df73b-1df7-5e7f-9829-65ab406336f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1427803,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4903/18254903/docs_service_history-1773417244291.jpg?ixlib=js-3.8.0&auto=format&s=07358b2efb6ea18cc1f1570e41d0900b',
'Width': 3000}],
'price': 6667,
'price_includes_vat': False,
'registration_date': '2017-05-15',
'seats_number': None,
'seller_name': None,
'title': 'Smart Fortwo Passion Auto',
'transmission': 'automatic',
'trim': 'Fortwo Passion Auto',
'vin': 'WME4534422K131782',
'year': 2017}
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718254903%27 HTTP/1.1" 200 None
2026-03-29 20:08:24 [motorway.uk] INFO: Saving data for 18254903: {'created_time': 1774814904.335394, 'last_price_update_time': 1774814904.335414, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18254903') HTTP/1.1" 204 0
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9750/20459750/exterior_front_driver-1774703376342.jpg> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8920/20468920/exterior_front_driver-1774606748819.jpg> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5001/20485001/interior_dashboard-1774693938135.jpg> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5001/20485001/interior_front_seats-1774693924945.jpg> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0509/20260509/interior_rear_seats-1774015503705.jpg> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8404/20158404/interior_front_seats-1773062417573.jpeg> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_rear_passenger-1773062229806.jpeg> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2589/20372589/instrument_cluster-1774112352534.jpg> (referer: None)
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d98d8d0>
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9750%252F20459750%252Fexterior_front_driver-1774703376342.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9750/20459750/exterior_front_driver-1774703376342.jpg saved to cache
2026-03-29 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077
2026-03-29 20:08:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b7a7af5-f600-5d8a-b3de-e69b71bc5077, skipping ID generation
2026-03-29 20:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077 with scrape type 1
2026-03-29 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b7a7af5-f600-5d8a-b3de-e69b71bc5077 sending to next pipeline
2026-03-29 20:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9b7a7af5-f600-5d8a-b3de-e69b71bc5077, identifier: 20459750
2026-03-29 20:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9b7a7af5-f600-5d8a-b3de-e69b71bc5077 with identifier: 20459750
2026-03-29 20:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9b7a7af5-f600-5d8a-b3de-e69b71bc5077 with identifier: 20459750
2026-03-29 20:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9b7a7af5-f600-5d8a-b3de-e69b71bc5077 with identifier: 20459750 to the API
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9750/20459750/exterior_front_driver-1774703376342.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '9b7a7af5-f600-5d8a-b3de-e69b71bc5077',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EF72 ODG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20459750',
'listing': 'auction',
'location': 'Swansea Swansea',
'make': 'Renault',
'model': 'Zoe',
'odometer': 22000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1640639,
'Height': 2516,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9750/20459750/exterior_front_driver-1774703376342.jpg',
'Width': 3354},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2017347,
'Height': 2589,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9750/20459750/exterior_rear_driver-1774706219940.jpg',
'Width': 3452},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1576371,
'Height': 2606,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9750/20459750/exterior_front_passenger-1774703375193.jpg',
'Width': 3475},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1250366,
'Height': 2466,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9750/20459750/exterior_rear_passenger-1774703376128.jpg',
'Width': 3288},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2780450,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9750/20459750/interior_front_seats-1774703950204.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2279273,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9750/20459750/interior_rear_seats-1774703876966.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1520690,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9750/20459750/interior_dashboard-1774706232064.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1217421,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9750/20459750/instrument_cluster-1774703943471.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1686537,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9750/20459750/interior_boot-1774703877853.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7a7af5-f600-5d8a-b3de-e69b71bc5077/9b7a7af5-f600-5d8a-b3de-e69b71bc5077_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1310754,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9750/20459750/docs_service_history-1774704110632.jpg?ixlib=js-3.8.0&auto=format&s=621135dab85628272e834bdce7c49691',
'Width': 3840}],
'price': 8364,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seats_number': None,
'seller_name': None,
'title': 'Renault ZOE Techno Boost Charge EV 50',
'transmission': 'automatic',
'trim': 'ZOE Techno Boost Charge EV 50',
'vin': 'VF1AG000869917304',
'year': 2022}
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459750%27 HTTP/1.1" 200 None
2026-03-29 20:08:25 [motorway.uk] INFO: Saving data for 20459750: {'created_time': 1774814905.03713, 'last_price_update_time': 1774814905.03714, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20459750') HTTP/1.1" 204 0
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd84c10>
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8920%252F20468920%252Fexterior_front_driver-1774606748819.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8920/20468920/exterior_front_driver-1774606748819.jpg saved to cache
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5
2026-03-29 20:08:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa4a2d4a-4f4f-5712-a84a-cff1d2032df5, skipping ID generation
2026-03-29 20:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5 with scrape type 1
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa4a2d4a-4f4f-5712-a84a-cff1d2032df5 sending to next pipeline
2026-03-29 20:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: aa4a2d4a-4f4f-5712-a84a-cff1d2032df5, identifier: 20468920
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20087813.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16989772.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: aa4a2d4a-4f4f-5712-a84a-cff1d2032df5 with identifier: 20468920
2026-03-29 20:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: aa4a2d4a-4f4f-5712-a84a-cff1d2032df5 with identifier: 20468920
2026-03-29 20:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: aa4a2d4a-4f4f-5712-a84a-cff1d2032df5 with identifier: 20468920 to the API
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8920/20468920/exterior_front_driver-1774606748819.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': 'aa4a2d4a-4f4f-5712-a84a-cff1d2032df5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KV71 YGH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20468920',
'listing': 'auction',
'location': 'Central Bedfordshire Bedford',
'make': 'Jaguar',
'model': 'I-PACE',
'odometer': 33678,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1543826,
'Height': 2397,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8920/20468920/exterior_front_driver-1774606748819.jpg',
'Width': 3196},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1449645,
'Height': 2429,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8920/20468920/exterior_rear_driver-1774606771382.jpg',
'Width': 3239},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2408980,
'Height': 2769,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8920/20468920/exterior_front_passenger-1774606802306.jpg',
'Width': 3692},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3679551,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8920/20468920/exterior_rear_passenger-1774781880270.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3070431,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8920/20468920/interior_front_seats-1774607323008.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2856379,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8920/20468920/interior_rear_seats-1774781680913.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2326112,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8920/20468920/interior_dashboard-1774781713943.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4331740,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8920/20468920/interior_boot-1774607395773.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3604672,
'Height': 3302,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8920/20468920/docs_service_history-1774607649681.jpg?ixlib=js-3.8.0&auto=format&s=b8a9287a08e8373c293e93dfaaaa893b',
'Width': 2293},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4a2d4a-4f4f-5712-a84a-cff1d2032df5/aa4a2d4a-4f4f-5712-a84a-cff1d2032df5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1830905,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8920/20468920/damage_scratches-1774606898554.jpg',
'Width': 4032}],
'price': 15369,
'price_includes_vat': False,
'registration_date': '2021-09-01',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar I-PACE EV400 HSE',
'transmission': 'automatic',
'trim': 'EV400 HSE',
'vin': 'SADHA2A13M1617836',
'year': 2021}
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720468920%27 HTTP/1.1" 200 None
2026-03-29 20:08:25 [motorway.uk] INFO: Saving data for 20468920: {'created_time': 1774814905.668053, 'last_price_update_time': 1774814905.668063, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20468920') HTTP/1.1" 204 0
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18732558.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20456360.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16608213.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f645890>
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5001%252F20485001%252Finterior_dashboard-1774693938135.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5001/20485001/interior_dashboard-1774693938135.jpg saved to cache
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c885850>
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5001%252F20485001%252Finterior_front_seats-1774693924945.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5001/20485001/interior_front_seats-1774693924945.jpg saved to cache
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f63dcd0>
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0509%252F20260509%252Finterior_rear_seats-1774015503705.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0509/20260509/interior_rear_seats-1774015503705.jpg saved to cache
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 581e8de5-b04a-5086-a100-01898fcf7c3f
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xd4\xea\x8e\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08 L\x00\xd4\xe0\x0e\x00\x00\x00\x00'
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c884390>
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8404%252F20158404%252Finterior_front_seats-1773062417573.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8404/20158404/interior_front_seats-1773062417573.jpeg saved to cache
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9384f570-0a6f-5529-b6db-f87e678ea572
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cecda90>
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F20158404%252Fexterior_rear_passenger-1773062229806.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_rear_passenger-1773062229806.jpeg saved to cache
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9384f570-0a6f-5529-b6db-f87e678ea572
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x0c\x00\x00'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:21 16:56:51\x00'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x10\x00\x00'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'ThinkPhone 25 by motorola\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'vienna_g_syset-user 15 V2UIS35.\x00'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c885190>
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2589%252F20372589%252Finstrument_cluster-1774112352534.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2589/20372589/instrument_cluster-1774112352534.jpg saved to cache
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1dca530e-49ed-53ab-98d9-22b256fd4813
2026-03-29 20:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b34c870-ec72-5ac0-8f68-cb6ac0649f37 with identifier: 20087813
2026-03-29 20:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37 with scrape type 1
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7813%252F20087813%252Fexterior_front_driver-1773320950097.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_front_driver-1773320950097.jpg not downloaded yet
2026-03-29 20:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55fff08f-3215-512b-a76a-96e171430300 with identifier: 16989772
2026-03-29 20:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55fff08f-3215-512b-a76a-96e171430300 with scrape type 1
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55fff08f-3215-512b-a76a-96e171430300
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9772%252F16989772%252Fexterior_front_driver-1774715854160.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_front_driver-1774715854160.jpg not downloaded yet
2026-03-29 20:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52e4ec49-2446-5b4d-bcdb-705910774bb0 with identifier: 18732558
2026-03-29 20:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52e4ec49-2446-5b4d-bcdb-705910774bb0 with scrape type 1
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 52e4ec49-2446-5b4d-bcdb-705910774bb0
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2558%252F18732558%252Fexterior_front_driver-1769769271395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2558/18732558/exterior_front_driver-1769769271395.jpg not downloaded yet
2026-03-29 20:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b47a8e5-ea12-5bde-9616-7ac9ac714d79 with identifier: 20456360
2026-03-29 20:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79 with scrape type 1
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6360%252F20456360%252Fexterior_front_driver-1774706943434.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6360/20456360/exterior_front_driver-1774706943434.jpg not downloaded yet
2026-03-29 20:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c with identifier: 16608213
2026-03-29 20:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c with scrape type 1
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8213%252F16608213%252Fexterior_front_driver-1774711708881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_front_driver-1774711708881.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7813%252F20087813%252Fexterior_rear_driver-1773320933793.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_rear_driver-1773320933793.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9772%252F16989772%252Fexterior_rear_driver-1774715869993.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_rear_driver-1774715869993.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2558%252F18732558%252Fexterior_rear_driver-1769769291226.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2558/18732558/exterior_rear_driver-1769769291226.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6360%252F20456360%252Fexterior_rear_driver-1774705470832.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6360/20456360/exterior_rear_driver-1774705470832.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8213%252F16608213%252Fexterior_rear_driver-1774711733665.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_rear_driver-1774711733665.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7813%252F20087813%252Fexterior_front_passenger-1773320887389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_front_passenger-1773320887389.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9772%252F16989772%252Fexterior_front_passenger-1774715927807.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_front_passenger-1774715927807.jpg not downloaded yet
2026-03-29 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_rear_passenger-1774693045894.jpg> (referer: None)
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2558%252F18732558%252Fexterior_front_passenger-1769769320968.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2558/18732558/exterior_front_passenger-1769769320968.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6360%252F20456360%252Fexterior_front_passenger-1774705492664.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6360/20456360/exterior_front_passenger-1774705492664.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8213%252F16608213%252Fexterior_front_passenger-1774711767290.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_front_passenger-1774711767290.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7813%252F20087813%252Fexterior_rear_passenger-1773320913798.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_rear_passenger-1773320913798.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9772%252F16989772%252Fexterior_rear_passenger-1774715898111.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_rear_passenger-1774715898111.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2558%252F18732558%252Fexterior_rear_passenger-1774715670430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2558/18732558/exterior_rear_passenger-1774715670430.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6360%252F20456360%252Fexterior_rear_passenger-1774705486829.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6360/20456360/exterior_rear_passenger-1774705486829.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8213%252F16608213%252Fexterior_rear_passenger-1774711748469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_rear_passenger-1774711748469.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7813%252F20087813%252Finterior_front_seats-1773321665560.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7813/20087813/interior_front_seats-1773321665560.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9772%252F16989772%252Finterior_front_seats-1774716433939.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9772/16989772/interior_front_seats-1774716433939.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2558%252F18732558%252Finterior_front_seats-1769769613465.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2558/18732558/interior_front_seats-1769769613465.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6360%252F20456360%252Finterior_front_seats-1774706128426.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6360/20456360/interior_front_seats-1774706128426.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8213%252F16608213%252Finterior_front_seats-1774712140589.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8213/16608213/interior_front_seats-1774712140589.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7813%252F20087813%252Finterior_rear_seats-1773321662284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7813/20087813/interior_rear_seats-1773321662284.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9772%252F16989772%252Finterior_rear_seats-1774716464985.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9772/16989772/interior_rear_seats-1774716464985.jpg not downloaded yet
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d255c50>
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5001%252F20485001%252Fexterior_rear_passenger-1774693045894.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_rear_passenger-1774693045894.jpg saved to cache
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2558%252F18732558%252Finterior_rear_seats-1769769641571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2558/18732558/interior_rear_seats-1769769641571.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6360%252F20456360%252Finterior_rear_seats-1774706140648.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6360/20456360/interior_rear_seats-1774706140648.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8213%252F16608213%252Finterior_rear_seats-1774712161288.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8213/16608213/interior_rear_seats-1774712161288.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7813%252F20087813%252Finterior_dashboard-1773321788474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7813/20087813/interior_dashboard-1773321788474.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9772%252F16989772%252Finterior_dashboard-1774716496401.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9772/16989772/interior_dashboard-1774716496401.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2558%252F18732558%252Finterior_dashboard-1774715695248.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2558/18732558/interior_dashboard-1774715695248.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6360%252F20456360%252Finterior_dashboard-1774706168996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6360/20456360/interior_dashboard-1774706168996.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8213%252F16608213%252Finterior_dashboard-1774712192839.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8213/16608213/interior_dashboard-1774712192839.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7813%252F20087813%252Finterior_boot-1773321663523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7813/20087813/interior_boot-1773321663523.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9772%252F16989772%252Finstrument_cluster-1774716509975.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9772/16989772/instrument_cluster-1774716509975.jpg not downloaded yet
2026-03-29 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2589/20372589/interior_dashboard-1774771607322.jpg> (referer: None)
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2558%252F18732558%252Finterior_boot-1774715710736.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2558/18732558/interior_boot-1774715710736.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6360%252F20456360%252Finterior_boot-1774706183256.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6360/20456360/interior_boot-1774706183256.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8213%252F16608213%252Finstrument_cluster-1774712240665.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8213/16608213/instrument_cluster-1774712240665.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7813%252F20087813%252Fdocs_service_history-1774626637351.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc6eef0a0211c74bfc0d94f72eaf5677c%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7813/20087813/docs_service_history-1774626637351.jpg?ixlib=js-3.8.0&auto=format&s=c6eef0a0211c74bfc0d94f72eaf5677c not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9772%252F16989772%252Finterior_boot-1774716511030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9772/16989772/interior_boot-1774716511030.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F2558%252F18732558%252Fdocs_service_history-1769858687182.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D600b3a36f24e24b760f272f71411effe%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/2558/18732558/docs_service_history-1769858687182.jpg?ixlib=js-3.8.0&auto=format&s=600b3a36f24e24b760f272f71411effe not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6360%252F20456360%252Fdocs_service_history-1774706330961.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D94ccf5bc6c34a1d653516cb70c4c3d1e%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6360/20456360/docs_service_history-1774706330961.jpg?ixlib=js-3.8.0&auto=format&s=94ccf5bc6c34a1d653516cb70c4c3d1e not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8213%252F16608213%252Finterior_boot-1774712201133.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8213/16608213/interior_boot-1774712201133.jpg not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7813%252F20087813%252Fdamage_missing_trims-1774629197426.png%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7813/20087813/damage_missing_trims-1774629197426.png not downloaded yet
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9772%252F16989772%252Fdocs_service_history-1774716920596.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D74a6e56930c91a3dd2e64cbe8fde7b24%27 HTTP/1.1" 200 None
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9772/16989772/docs_service_history-1774716920596.jpg?ixlib=js-3.8.0&auto=format&s=74a6e56930c91a3dd2e64cbe8fde7b24 not downloaded yet
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2558%252F18732558%252Fwheels_front_driver-1769769348628.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2558/18732558/wheels_front_driver-1769769348628.jpg not downloaded yet
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6360%252F20456360%252Fdocs_service_history-1774706333184.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3406e1280f5e20c6d1451797c658aa40%27 HTTP/1.1" 200 None
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6360/20456360/docs_service_history-1774706333184.jpg?ixlib=js-3.8.0&auto=format&s=3406e1280f5e20c6d1451797c658aa40 not downloaded yet
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8213%252F16608213%252F16608213-docs_service_history-modified-1751562141198.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dff1ce210d0402d5236c7914189f30494%27 HTTP/1.1" 200 None
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8213/16608213/16608213-docs_service_history-modified-1751562141198.jpeg?ixlib=js-3.8.0&auto=format&s=ff1ce210d0402d5236c7914189f30494 not downloaded yet
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2d9590>
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2589%252F20372589%252Finterior_dashboard-1774771607322.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2589/20372589/interior_dashboard-1774771607322.jpg saved to cache
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1dca530e-49ed-53ab-98d9-22b256fd4813
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_rear_driver-1774693053470.jpg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_front_passenger-1774693054432.jpg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_rear_passenger-1774015177369.jpg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2589/20372589/interior_front_seats-1774722457944.jpg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2589/20372589/exterior_front_passenger-1774772277173.jpg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_rear_driver-1774015133287.jpg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_front_passenger-1773062192837.jpeg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_front_passenger-1774015147969.jpg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0509/20260509/interior_front_seats-1774015492773.jpg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_front_driver-1773062176386.jpeg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_rear_driver-1773062242022.jpeg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2589/20372589/interior_rear_seats-1774112349311.jpg> (referer: None)
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c58d0>
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5001%252F20485001%252Fexterior_rear_driver-1774693053470.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_rear_driver-1774693053470.jpg saved to cache
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc3f790>
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5001%252F20485001%252Fexterior_front_passenger-1774693054432.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_front_passenger-1774693054432.jpg saved to cache
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0
2026-03-29 20:08:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b314d3e-c26b-5f2a-82df-40dab0c16fa0, skipping ID generation
2026-03-29 20:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0 with scrape type 1
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b314d3e-c26b-5f2a-82df-40dab0c16fa0 sending to next pipeline
2026-03-29 20:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8b314d3e-c26b-5f2a-82df-40dab0c16fa0, identifier: 20485001
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc3d9d0>
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F20260509%252Fexterior_rear_passenger-1774015177369.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_rear_passenger-1774015177369.jpg saved to cache
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 581e8de5-b04a-5086-a100-01898fcf7c3f
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8197d0>
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2589%252F20372589%252Finterior_front_seats-1774722457944.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2589/20372589/interior_front_seats-1774722457944.jpg saved to cache
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1dca530e-49ed-53ab-98d9-22b256fd4813
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d525cd0>
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2589%252F20372589%252Fexterior_front_passenger-1774772277173.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2589/20372589/exterior_front_passenger-1774772277173.jpg saved to cache
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1dca530e-49ed-53ab-98d9-22b256fd4813
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc2b510>
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F20260509%252Fexterior_rear_driver-1774015133287.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_rear_driver-1774015133287.jpg saved to cache
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 581e8de5-b04a-5086-a100-01898fcf7c3f
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca20310>
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F20158404%252Fexterior_front_passenger-1773062192837.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_front_passenger-1773062192837.jpeg saved to cache
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9384f570-0a6f-5529-b6db-f87e678ea572
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d280750>
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F20260509%252Fexterior_front_passenger-1774015147969.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_front_passenger-1774015147969.jpg saved to cache
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 581e8de5-b04a-5086-a100-01898fcf7c3f
2026-03-29 20:08:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c6d10>
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0509%252F20260509%252Finterior_front_seats-1774015492773.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0509/20260509/interior_front_seats-1774015492773.jpg saved to cache
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 581e8de5-b04a-5086-a100-01898fcf7c3f
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6c0e50>
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F20158404%252Fexterior_front_driver-1773062176386.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_front_driver-1773062176386.jpeg saved to cache
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9384f570-0a6f-5529-b6db-f87e678ea572
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2f5450>
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F20158404%252Fexterior_rear_driver-1773062242022.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_rear_driver-1773062242022.jpeg saved to cache
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9384f570-0a6f-5529-b6db-f87e678ea572
2026-03-29 20:08:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9384f570-0a6f-5529-b6db-f87e678ea572, skipping ID generation
2026-03-29 20:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9384f570-0a6f-5529-b6db-f87e678ea572 with scrape type 1
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9384f570-0a6f-5529-b6db-f87e678ea572 sending to next pipeline
2026-03-29 20:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9384f570-0a6f-5529-b6db-f87e678ea572, identifier: 20158404
2026-03-29 20:08:30 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x0c\x00\x00'
2026-03-29 20:08:30 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:08:30 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:21 16:57:59\x00'
2026-03-29 20:08:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:30 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x10\x00\x00'
2026-03-29 20:08:30 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'ThinkPhone 25 by motorola\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:30 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'vienna_g_syset-user 15 V2UIS35.\x00'
2026-03-29 20:08:30 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:30 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:08:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc3e890>
2026-03-29 20:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2589%252F20372589%252Finterior_rear_seats-1774112349311.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2589/20372589/interior_rear_seats-1774112349311.jpg saved to cache
2026-03-29 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1dca530e-49ed-53ab-98d9-22b256fd4813
2026-03-29 20:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8b314d3e-c26b-5f2a-82df-40dab0c16fa0 with identifier: 20485001
2026-03-29 20:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8b314d3e-c26b-5f2a-82df-40dab0c16fa0 with identifier: 20485001
2026-03-29 20:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8b314d3e-c26b-5f2a-82df-40dab0c16fa0 with identifier: 20485001 to the API
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_front_passenger-1774693054432.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8b314d3e-c26b-5f2a-82df-40dab0c16fa0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'LG67 UAB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20485001',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 21700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1043545,
'Height': 2297,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_front_driver-1774693044580.jpg',
'Width': 3063},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 760451,
'Height': 2149,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_rear_driver-1774693053470.jpg',
'Width': 2865},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 958523,
'Height': 2375,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_front_passenger-1774693054432.jpg',
'Width': 3167},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711391,
'Height': 2134,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5001/20485001/exterior_rear_passenger-1774693045894.jpg',
'Width': 2845},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2009940,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5001/20485001/interior_front_seats-1774693924945.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1580681,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5001/20485001/interior_dashboard-1774693938135.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1472983,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5001/20485001/instrument_cluster-1774693761110.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1488235,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5001/20485001/interior_boot-1774693922234.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2407864,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5001/20485001/docs_service_history-1774694085202.jpg?ixlib=js-3.8.0&auto=format&s=c820e15148f8dec53a930b3bef9b742e',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b314d3e-c26b-5f2a-82df-40dab0c16fa0/8b314d3e-c26b-5f2a-82df-40dab0c16fa0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2337209,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5001/20485001/docs_service_history-1774694114598.jpg?ixlib=js-3.8.0&auto=format&s=787a0658177c11cc70c58c6d97d65b46',
'Width': 3840}],
'price': 5341,
'price_includes_vat': False,
'registration_date': '2017-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Fiat Doblo 16V SX Maxi Mutijet II',
'transmission': 'manual',
'trim': '16V SX Maxi Mutijet II',
'vin': 'ZFA26300006G69157',
'year': 2017}
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485001%27 HTTP/1.1" 200 None
2026-03-29 20:08:30 [motorway.uk] INFO: Saving data for 20485001: {'created_time': 1774814910.536925, 'last_price_update_time': 1774814910.536937, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20485001') HTTP/1.1" 204 0
2026-03-29 20:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9384f570-0a6f-5529-b6db-f87e678ea572 with identifier: 20158404
2026-03-29 20:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9384f570-0a6f-5529-b6db-f87e678ea572 with identifier: 20158404
2026-03-29 20:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9384f570-0a6f-5529-b6db-f87e678ea572 with identifier: 20158404 to the API
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_rear_driver-1773062242022.jpeg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9384f570-0a6f-5529-b6db-f87e678ea572',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EJ66 UWY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20158404',
'listing': 'auction',
'location': 'Buckinghamshire High Wycombe',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 62000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3093305,
'Height': 4058,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_front_driver-1773062176386.jpeg',
'Width': 5411},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3396173,
'Height': 4142,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_rear_driver-1773062242022.jpeg',
'Width': 5523},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2675244,
'Height': 3948,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_front_passenger-1773062192837.jpeg',
'Width': 5264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3794224,
'Height': 4265,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8404/20158404/exterior_rear_passenger-1773062229806.jpeg',
'Width': 5686},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 14486234,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8404/20158404/interior_front_seats-1773062417573.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 17929447,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8404/20158404/interior_rear_seats-1773062276928.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5376345,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8404/20158404/interior_dashboard-1773062321759.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 8315939,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8404/20158404/instrument_cluster-1773062389265.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 12577214,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8404/20158404/interior_boot-1773062294962.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9384f570-0a6f-5529-b6db-f87e678ea572/9384f570-0a6f-5529-b6db-f87e678ea572_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2103986,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8404/20158404/docs_service_history-1773657246693.jpeg?ixlib=js-3.8.0&auto=format&s=9e13eb07365a2eb2cb67905c9bd4323c',
'Width': 3024}],
'price': 3650,
'price_includes_vat': False,
'registration_date': '2016-11-10',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta ST-LINE',
'transmission': 'manual',
'trim': 'ST-LINE',
'vin': 'WF0CXXGAKCGS16259',
'year': 2016}
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720158404%27 HTTP/1.1" 200 None
2026-03-29 20:08:30 [motorway.uk] INFO: Saving data for 20158404: {'created_time': 1774814910.911137, 'last_price_update_time': 1774814910.91115, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20158404') HTTP/1.1" 204 0
2026-03-29 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8213/16608213/16608213-docs_service_history-modified-1751562141198.jpeg?ixlib=js-3.8.0&auto=format&s=ff1ce210d0402d5236c7914189f30494> (referer: None)
2026-03-29 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6360/20456360/docs_service_history-1774706333184.jpg?ixlib=js-3.8.0&auto=format&s=3406e1280f5e20c6d1451797c658aa40> (referer: None)
2026-03-29 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2558/18732558/wheels_front_driver-1769769348628.jpg> (referer: None)
2026-03-29 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_front_passenger-1774715927807.jpg> (referer: None)
2026-03-29 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_front_driver-1774015116390.jpg> (referer: None)
2026-03-29 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8213/16608213/interior_dashboard-1774712192839.jpg> (referer: None)
2026-03-29 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7813/20087813/docs_service_history-1774626637351.jpg?ixlib=js-3.8.0&auto=format&s=c6eef0a0211c74bfc0d94f72eaf5677c> (referer: None)
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cec68d0>
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8213%252F16608213%252F16608213-docs_service_history-modified-1751562141198.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dff1ce210d0402d5236c7914189f30494') HTTP/1.1" 204 0
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8213/16608213/16608213-docs_service_history-modified-1751562141198.jpeg?ixlib=js-3.8.0&auto=format&s=ff1ce210d0402d5236c7914189f30494 saved to cache
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c
2026-03-29 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7813/20087813/damage_missing_trims-1774629197426.png> (referer: None)
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f32d110>
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6360%252F20456360%252Fdocs_service_history-1774706333184.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3406e1280f5e20c6d1451797c658aa40') HTTP/1.1" 204 0
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6360/20456360/docs_service_history-1774706333184.jpg?ixlib=js-3.8.0&auto=format&s=3406e1280f5e20c6d1451797c658aa40 saved to cache
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8319d0>
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2558%252F18732558%252Fwheels_front_driver-1769769348628.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2558/18732558/wheels_front_driver-1769769348628.jpg saved to cache
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 52e4ec49-2446-5b4d-bcdb-705910774bb0
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1cc790>
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9772%252F16989772%252Fexterior_front_passenger-1774715927807.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_front_passenger-1774715927807.jpg saved to cache
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55fff08f-3215-512b-a76a-96e171430300
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5c5790>
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F20260509%252Fexterior_front_driver-1774015116390.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_front_driver-1774015116390.jpg saved to cache
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 581e8de5-b04a-5086-a100-01898fcf7c3f
2026-03-29 20:08:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 581e8de5-b04a-5086-a100-01898fcf7c3f, skipping ID generation
2026-03-29 20:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 581e8de5-b04a-5086-a100-01898fcf7c3f with scrape type 1
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 581e8de5-b04a-5086-a100-01898fcf7c3f sending to next pipeline
2026-03-29 20:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 581e8de5-b04a-5086-a100-01898fcf7c3f, identifier: 20260509
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f32eb90>
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8213%252F16608213%252Finterior_dashboard-1774712192839.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8213/16608213/interior_dashboard-1774712192839.jpg saved to cache
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0684d0>
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7813%252F20087813%252Fdocs_service_history-1774626637351.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc6eef0a0211c74bfc0d94f72eaf5677c') HTTP/1.1" 204 0
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7813/20087813/docs_service_history-1774626637351.jpg?ixlib=js-3.8.0&auto=format&s=c6eef0a0211c74bfc0d94f72eaf5677c saved to cache
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37
2026-03-29 20:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 581e8de5-b04a-5086-a100-01898fcf7c3f with identifier: 20260509
2026-03-29 20:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 581e8de5-b04a-5086-a100-01898fcf7c3f with identifier: 20260509
2026-03-29 20:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 581e8de5-b04a-5086-a100-01898fcf7c3f with identifier: 20260509 to the API
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_front_driver-1774015116390.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '581e8de5-b04a-5086-a100-01898fcf7c3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RE66 AYM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20260509',
'listing': 'auction',
'location': 'Hampshire Romsey',
'make': 'BMW',
'model': '2 Series',
'odometer': 58000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1824503,
'Height': 2645,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_front_driver-1774015116390.jpg',
'Width': 3527},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1368295,
'Height': 2366,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_rear_driver-1774015133287.jpg',
'Width': 3155},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2245342,
'Height': 2737,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_front_passenger-1774015147969.jpg',
'Width': 3649},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2201237,
'Height': 2806,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0509/20260509/exterior_rear_passenger-1774015177369.jpg',
'Width': 3741},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3669245,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0509/20260509/interior_front_seats-1774015492773.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3039565,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0509/20260509/interior_rear_seats-1774015503705.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 909290,
'Height': 2274,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0509/20260509/interior_dashboard-1774015519516.jpg',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2224264,
'Height': 2736,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0509/20260509/instrument_cluster-1774694834820.jpg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2778782,
'Height': 2274,
'OriginUrl': 'https://motorway-photos.imgix.net/0509/20260509/interior_boot-1774015551537.jpg',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_581e8de5-b04a-5086-a100-01898fcf7c3f/581e8de5-b04a-5086-a100-01898fcf7c3f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7230459,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0509/20260509/docs_service_history-1774015659880.jpg?ixlib=js-3.8.0&auto=format&s=21ea7dcb37c7f64cde8e79cd2eb486fa',
'Width': 4032}],
'price': 6664,
'price_includes_vat': False,
'registration_date': '2016-09-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW 225XE Sport PHEV Auto',
'transmission': 'automatic',
'trim': '225XE Sport PHEV Auto',
'vin': 'WBA2C72050V365909',
'year': 2016}
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720260509%27 HTTP/1.1" 200 None
2026-03-29 20:08:33 [motorway.uk] INFO: Saving data for 20260509: {'created_time': 1774814913.144592, 'last_price_update_time': 1774814913.144603, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20260509') HTTP/1.1" 204 0
2026-03-29 20:08:33 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:08:33 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-29 20:08:33 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-29 20:08:33 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-29 20:08:33 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 56092
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2c7590>
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_9.png HTTP/1.1" 201 0
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7813%252F20087813%252Fdamage_missing_trims-1774629197426.png') HTTP/1.1" 204 0
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7813/20087813/damage_missing_trims-1774629197426.png saved to cache
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37
2026-03-29 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9772/16989772/docs_service_history-1774716920596.jpg?ixlib=js-3.8.0&auto=format&s=74a6e56930c91a3dd2e64cbe8fde7b24> (referer: None)
2026-03-29 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6360/20456360/docs_service_history-1774706330961.jpg?ixlib=js-3.8.0&auto=format&s=94ccf5bc6c34a1d653516cb70c4c3d1e> (referer: None)
2026-03-29 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/2558/18732558/docs_service_history-1769858687182.jpg?ixlib=js-3.8.0&auto=format&s=600b3a36f24e24b760f272f71411effe> (referer: None)
2026-03-29 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8213/16608213/instrument_cluster-1774712240665.jpg> (referer: None)
2026-03-29 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2558/18732558/interior_boot-1774715710736.jpg> (referer: None)
2026-03-29 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9772/16989772/instrument_cluster-1774716509975.jpg> (referer: None)
2026-03-29 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6360/20456360/interior_boot-1774706183256.jpg> (referer: None)
2026-03-29 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6360/20456360/interior_dashboard-1774706168996.jpg> (referer: None)
2026-03-29 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8213/16608213/interior_boot-1774712201133.jpg> (referer: None)
2026-03-29 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9772/16989772/interior_boot-1774716511030.jpg> (referer: None)
2026-03-29 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7813/20087813/interior_boot-1773321663523.jpg> (referer: None)
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4d4650>
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9772%252F16989772%252Fdocs_service_history-1774716920596.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D74a6e56930c91a3dd2e64cbe8fde7b24') HTTP/1.1" 204 0
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9772/16989772/docs_service_history-1774716920596.jpg?ixlib=js-3.8.0&auto=format&s=74a6e56930c91a3dd2e64cbe8fde7b24 saved to cache
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55fff08f-3215-512b-a76a-96e171430300
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e16ebd0>
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6360%252F20456360%252Fdocs_service_history-1774706330961.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D94ccf5bc6c34a1d653516cb70c4c3d1e') HTTP/1.1" 204 0
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6360/20456360/docs_service_history-1774706330961.jpg?ixlib=js-3.8.0&auto=format&s=94ccf5bc6c34a1d653516cb70c4c3d1e saved to cache
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x009TF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x85\xf9\x0090\x1f\x00\x00\x00\x00'
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d665d90>
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F2558%252F18732558%252Fdocs_service_history-1769858687182.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D600b3a36f24e24b760f272f71411effe') HTTP/1.1" 204 0
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/2558/18732558/docs_service_history-1769858687182.jpg?ixlib=js-3.8.0&auto=format&s=600b3a36f24e24b760f272f71411effe saved to cache
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 52e4ec49-2446-5b4d-bcdb-705910774bb0
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f608350>
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8213%252F16608213%252Finstrument_cluster-1774712240665.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8213/16608213/instrument_cluster-1774712240665.jpg saved to cache
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a4b10>
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2558%252F18732558%252Finterior_boot-1774715710736.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2558/18732558/interior_boot-1774715710736.jpg saved to cache
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 52e4ec49-2446-5b4d-bcdb-705910774bb0
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6095d0>
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9772%252F16989772%252Finstrument_cluster-1774716509975.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9772/16989772/instrument_cluster-1774716509975.jpg saved to cache
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55fff08f-3215-512b-a76a-96e171430300
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2d5cd0>
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6360%252F20456360%252Finterior_boot-1774706183256.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6360/20456360/interior_boot-1774706183256.jpg saved to cache
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc3e190>
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6360%252F20456360%252Finterior_dashboard-1774706168996.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6360/20456360/interior_dashboard-1774706168996.jpg saved to cache
2026-03-29 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d935b90>
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8213%252F16608213%252Finterior_boot-1774712201133.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8213/16608213/interior_boot-1774712201133.jpg saved to cache
2026-03-29 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d303bd0>
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9772%252F16989772%252Finterior_boot-1774716511030.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9772/16989772/interior_boot-1774716511030.jpg saved to cache
2026-03-29 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55fff08f-3215-512b-a76a-96e171430300
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x12\x00\x00'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'HONOR\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x00'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:12 13:19:20\x00'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x80\r\x00\x00'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2d5e50>
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7813%252F20087813%252Finterior_boot-1773321663523.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7813/20087813/interior_boot-1773321663523.jpg saved to cache
2026-03-29 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7813/20087813/interior_dashboard-1773321788474.jpg> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2558/18732558/interior_dashboard-1774715695248.jpg> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9772/16989772/interior_dashboard-1774716496401.jpg> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2558/18732558/interior_rear_seats-1769769641571.jpg> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6360/20456360/interior_rear_seats-1774706140648.jpg> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9772/16989772/interior_rear_seats-1774716464985.jpg> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8213/16608213/interior_rear_seats-1774712161288.jpg> (referer: None)
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c626b50>
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7813%252F20087813%252Finterior_dashboard-1773321788474.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7813/20087813/interior_dashboard-1773321788474.jpg saved to cache
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c627f50>
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2558%252F18732558%252Finterior_dashboard-1774715695248.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2558/18732558/interior_dashboard-1774715695248.jpg saved to cache
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 52e4ec49-2446-5b4d-bcdb-705910774bb0
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c818b90>
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9772%252F16989772%252Finterior_dashboard-1774716496401.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9772/16989772/interior_dashboard-1774716496401.jpg saved to cache
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55fff08f-3215-512b-a76a-96e171430300
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cabb050>
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2558%252F18732558%252Finterior_rear_seats-1769769641571.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2558/18732558/interior_rear_seats-1769769641571.jpg saved to cache
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52e4ec49-2446-5b4d-bcdb-705910774bb0
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6fab50>
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6360%252F20456360%252Finterior_rear_seats-1774706140648.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6360/20456360/interior_rear_seats-1774706140648.jpg saved to cache
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6ff610>
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9772%252F16989772%252Finterior_rear_seats-1774716464985.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9772/16989772/interior_rear_seats-1774716464985.jpg saved to cache
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55fff08f-3215-512b-a76a-96e171430300
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d06be10>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8213%252F16608213%252Finterior_rear_seats-1774712161288.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8213/16608213/interior_rear_seats-1774712161288.jpg saved to cache
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_rear_passenger-1774715898111.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6360/20456360/exterior_rear_passenger-1774705486829.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2558/18732558/exterior_rear_passenger-1774715670430.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_rear_passenger-1774711748469.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8213/16608213/interior_front_seats-1774712140589.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9772/16989772/interior_front_seats-1774716433939.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2558/18732558/interior_front_seats-1769769613465.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6360/20456360/interior_front_seats-1774706128426.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7813/20087813/interior_front_seats-1773321665560.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7813/20087813/interior_rear_seats-1773321662284.jpg> (referer: None)
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca38c90>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9772%252F16989772%252Fexterior_rear_passenger-1774715898111.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_rear_passenger-1774715898111.jpg saved to cache
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55fff08f-3215-512b-a76a-96e171430300
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1cea10>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6360%252F20456360%252Fexterior_rear_passenger-1774705486829.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6360/20456360/exterior_rear_passenger-1774705486829.jpg saved to cache
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd37990>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2558%252F18732558%252Fexterior_rear_passenger-1774715670430.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2558/18732558/exterior_rear_passenger-1774715670430.jpg saved to cache
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52e4ec49-2446-5b4d-bcdb-705910774bb0
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd37f50>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8213%252F16608213%252Fexterior_rear_passenger-1774711748469.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_rear_passenger-1774711748469.jpg saved to cache
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f29f050>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8213%252F16608213%252Finterior_front_seats-1774712140589.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8213/16608213/interior_front_seats-1774712140589.jpg saved to cache
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc68790>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9772%252F16989772%252Finterior_front_seats-1774716433939.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9772/16989772/interior_front_seats-1774716433939.jpg saved to cache
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55fff08f-3215-512b-a76a-96e171430300
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f291e10>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2558%252F18732558%252Finterior_front_seats-1769769613465.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2558/18732558/interior_front_seats-1769769613465.jpg saved to cache
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52e4ec49-2446-5b4d-bcdb-705910774bb0
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6c1590>
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6360%252F20456360%252Finterior_front_seats-1774706128426.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6360/20456360/interior_front_seats-1774706128426.jpg saved to cache
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x12\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'HONOR\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:12 13:20:55\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x80\r\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc6aed0>
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7813%252F20087813%252Finterior_front_seats-1773321665560.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7813/20087813/interior_front_seats-1773321665560.jpg saved to cache
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x12\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'HONOR\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:12 13:16:57\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x80\r\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f29d610>
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7813%252F20087813%252Finterior_rear_seats-1773321662284.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7813/20087813/interior_rear_seats-1773321662284.jpg saved to cache
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_rear_passenger-1773320913798.jpg> (referer: None)
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_front_passenger-1773320887389.jpg> (referer: None)
2026-03-29 20:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6360/20456360/exterior_front_passenger-1774705492664.jpg> (referer: None)
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_front_passenger-1774711767290.jpg> (referer: None)
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6360/20456360/exterior_rear_driver-1774705470832.jpg> (referer: None)
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_rear_driver-1774711733665.jpg> (referer: None)
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2558/18732558/exterior_front_passenger-1769769320968.jpg> (referer: None)
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6360/20456360/exterior_front_driver-1774706943434.jpg> (referer: None)
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce74a90>
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7813%252F20087813%252Fexterior_rear_passenger-1773320913798.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_rear_passenger-1773320913798.jpg saved to cache
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6ade10>
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7813%252F20087813%252Fexterior_front_passenger-1773320887389.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_front_passenger-1773320887389.jpg saved to cache
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d06a9d0>
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6360%252F20456360%252Fexterior_front_passenger-1774705492664.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6360/20456360/exterior_front_passenger-1774705492664.jpg saved to cache
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f499590>
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8213%252F16608213%252Fexterior_front_passenger-1774711767290.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_front_passenger-1774711767290.jpg saved to cache
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d068790>
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6360%252F20456360%252Fexterior_rear_driver-1774705470832.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6360/20456360/exterior_rear_driver-1774705470832.jpg saved to cache
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4b3ed0>
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8213%252F16608213%252Fexterior_rear_driver-1774711733665.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_rear_driver-1774711733665.jpg saved to cache
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f498990>
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2558%252F18732558%252Fexterior_front_passenger-1769769320968.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2558/18732558/exterior_front_passenger-1769769320968.jpg saved to cache
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52e4ec49-2446-5b4d-bcdb-705910774bb0
2026-03-29 20:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=540&page=15&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f65ced0>
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6360%252F20456360%252Fexterior_front_driver-1774706943434.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6360/20456360/exterior_front_driver-1774706943434.jpg saved to cache
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79
2026-03-29 20:08:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b47a8e5-ea12-5bde-9616-7ac9ac714d79, skipping ID generation
2026-03-29 20:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79 with scrape type 1
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b47a8e5-ea12-5bde-9616-7ac9ac714d79 sending to next pipeline
2026-03-29 20:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9b47a8e5-ea12-5bde-9616-7ac9ac714d79, identifier: 20456360
2026-03-29 20:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9b47a8e5-ea12-5bde-9616-7ac9ac714d79 with identifier: 20456360
2026-03-29 20:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9b47a8e5-ea12-5bde-9616-7ac9ac714d79 with identifier: 20456360
2026-03-29 20:08:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9b47a8e5-ea12-5bde-9616-7ac9ac714d79 with identifier: 20456360 to the API
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/6360/20456360/exterior_front_driver-1774706943434.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '9b47a8e5-ea12-5bde-9616-7ac9ac714d79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'CA18 KSV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20456360',
'listing': 'auction',
'location': 'Dorset Wimborne',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 39300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1848542,
'Height': 2414,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6360/20456360/exterior_front_driver-1774706943434.jpg',
'Width': 3219},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1820097,
'Height': 2637,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6360/20456360/exterior_rear_driver-1774705470832.jpg',
'Width': 3516},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1343673,
'Height': 2273,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6360/20456360/exterior_front_passenger-1774705492664.jpg',
'Width': 3031},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1777928,
'Height': 2594,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6360/20456360/exterior_rear_passenger-1774705486829.jpg',
'Width': 3459},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3879099,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6360/20456360/interior_front_seats-1774706128426.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3584609,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6360/20456360/interior_rear_seats-1774706140648.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3375849,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6360/20456360/interior_dashboard-1774706168996.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3303059,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6360/20456360/interior_boot-1774706183256.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 791715,
'Height': 2087,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6360/20456360/docs_service_history-1774706330961.jpg?ixlib=js-3.8.0&auto=format&s=94ccf5bc6c34a1d653516cb70c4c3d1e',
'Width': 3678},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b47a8e5-ea12-5bde-9616-7ac9ac714d79/9b47a8e5-ea12-5bde-9616-7ac9ac714d79_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 811120,
'Height': 2278,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6360/20456360/docs_service_history-1774706333184.jpg?ixlib=js-3.8.0&auto=format&s=3406e1280f5e20c6d1451797c658aa40',
'Width': 3286}],
'price': 9956,
'price_includes_vat': False,
'registration_date': '2018-06-15',
'seats_number': None,
'seller_name': None,
'title': 'Nissan X-Trail N-Connecta DCI',
'transmission': 'manual',
'trim': 'N-Connecta DCI',
'vin': 'JN1TCAT32U0104899',
'year': 2018}
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720456360%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Saving data for 20456360: {'created_time': 1774814919.579179, 'last_price_update_time': 1774814919.579189, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20456360') HTTP/1.1" 204 0
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20301561
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720301561%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Scrape type for 20301561: 1
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_front_driver-1773320950097.jpg> (referer: None)
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20480470
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20025955
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 19072079
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20478414
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720478414%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Scrape type for 20478414: 1
2026-03-29 20:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20390094
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20355039
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 19897967
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20416855
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720416855%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Scrape type for 20416855: 1
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20036264
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20463207
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720463207%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Scrape type for 20463207: 1
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7568/20127568/docs_service_history-1774452109610.jpg?ixlib=js-3.8.0&auto=format&s=649e1826c4d05711b59e6f7fab39136c> (referer: None)
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0670/20490670/docs_service_history-1774714636345.jpg?ixlib=js-3.8.0&auto=format&s=deb0d386857660c2b3f13607e1661f1d> (referer: None)
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 18730909
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20382318
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720382318%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Scrape type for 20382318: 1
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2589/20372589/exterior_front_driver-1774772616113.jpg> (referer: None)
2026-03-29 20:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20398514
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20484917
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484917%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Scrape type for 20484917: 1
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0670/20490670/docs_service_history-1774714608840.jpg?ixlib=js-3.8.0&auto=format&s=1d2266e63d33f276781e5abb0523f14b> (referer: None)
2026-03-29 20:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 18872105
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718872105%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Scrape type for 18872105: 1
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d75dc50>
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7813%252F20087813%252Fexterior_front_driver-1773320950097.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_front_driver-1773320950097.jpg saved to cache
2026-03-29 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 19791860
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 18667851
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 9844685
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 16823030
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20408961
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20296127
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720296127%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Scrape type for 20296127: 1
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_rear_driver-1774715869993.jpg> (referer: None)
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_front_driver-1774715854160.jpg> (referer: None)
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20222166
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20474874
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 12127571
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20483047
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 17857405
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717857405%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Scrape type for 17857405: 1
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_rear_driver-1773320933793.jpg> (referer: None)
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 17585425
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20401950
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 15315241
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20394022
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20239538
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20066529
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720066529%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Scrape type for 20066529: 1
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d281610>
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57266667-a7ea-5f5b-9b23-a7839f0bff3f/57266667-a7ea-5f5b-9b23-a7839f0bff3f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7568%252F20127568%252Fdocs_service_history-1774452109610.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D649e1826c4d05711b59e6f7fab39136c') HTTP/1.1" 204 0
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7568/20127568/docs_service_history-1774452109610.jpg?ixlib=js-3.8.0&auto=format&s=649e1826c4d05711b59e6f7fab39136c saved to cache
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57266667-a7ea-5f5b-9b23-a7839f0bff3f
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x048'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\t`'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 46 - Data Location: 74 - value: <table: 41 bytes>
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00s'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6f8d50>
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328fb3ca-2b51-57eb-86d0-510e6deb32ae/328fb3ca-2b51-57eb-86d0-510e6deb32ae_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0670%252F20490670%252Fdocs_service_history-1774714636345.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddeb0d386857660c2b3f13607e1661f1d') HTTP/1.1" 204 0
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0670/20490670/docs_service_history-1774714636345.jpg?ixlib=js-3.8.0&auto=format&s=deb0d386857660c2b3f13607e1661f1d saved to cache
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 328fb3ca-2b51-57eb-86d0-510e6deb32ae
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de54190>
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2589%252F20372589%252Fexterior_front_driver-1774772616113.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2589/20372589/exterior_front_driver-1774772616113.jpg saved to cache
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1dca530e-49ed-53ab-98d9-22b256fd4813
2026-03-29 20:08:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1dca530e-49ed-53ab-98d9-22b256fd4813, skipping ID generation
2026-03-29 20:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dca530e-49ed-53ab-98d9-22b256fd4813 with scrape type 1
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1dca530e-49ed-53ab-98d9-22b256fd4813 sending to next pipeline
2026-03-29 20:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1dca530e-49ed-53ab-98d9-22b256fd4813, identifier: 20372589
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x048'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\t`'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 46 - Data Location: 74 - value: <table: 41 bytes>
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00s'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f473f50>
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328fb3ca-2b51-57eb-86d0-510e6deb32ae/328fb3ca-2b51-57eb-86d0-510e6deb32ae_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0670%252F20490670%252Fdocs_service_history-1774714608840.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1d2266e63d33f276781e5abb0523f14b') HTTP/1.1" 204 0
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0670/20490670/docs_service_history-1774714608840.jpg?ixlib=js-3.8.0&auto=format&s=1d2266e63d33f276781e5abb0523f14b saved to cache
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 328fb3ca-2b51-57eb-86d0-510e6deb32ae
2026-03-29 20:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1dca530e-49ed-53ab-98d9-22b256fd4813 with identifier: 20372589
2026-03-29 20:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1dca530e-49ed-53ab-98d9-22b256fd4813 with identifier: 20372589
2026-03-29 20:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1dca530e-49ed-53ab-98d9-22b256fd4813 with identifier: 20372589 to the API
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/2589/20372589/exterior_front_driver-1774772616113.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '1dca530e-49ed-53ab-98d9-22b256fd4813',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT73 PNF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20372589',
'listing': 'auction',
'location': 'Hertfordshire Royston',
'make': 'Cupra',
'model': 'Leon',
'odometer': 20000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1424487,
'Height': 2180,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2589/20372589/exterior_front_driver-1774772616113.jpg',
'Width': 2907},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1668006,
'Height': 2302,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2589/20372589/exterior_rear_driver-1774771959388.jpg',
'Width': 3069},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1444742,
'Height': 2171,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2589/20372589/exterior_front_passenger-1774772277173.jpg',
'Width': 2895},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1653060,
'Height': 2282,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2589/20372589/exterior_rear_passenger-1774771982420.jpg',
'Width': 3043},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1622335,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2589/20372589/interior_front_seats-1774722457944.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4712554,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/2589/20372589/interior_rear_seats-1774112349311.jpg',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1322544,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2589/20372589/interior_dashboard-1774771607322.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4124822,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2589/20372589/instrument_cluster-1774112352534.jpg',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4247380,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/2589/20372589/interior_boot-1774112343928.jpg',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dca530e-49ed-53ab-98d9-22b256fd4813/1dca530e-49ed-53ab-98d9-22b256fd4813_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43599,
'Height': 1263,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2589/20372589/docs_service_history-1774260565899-1.jpeg?ixlib=js-3.8.0&auto=format&s=284a4342c0791cda7bf4ada444ce9258',
'Width': 892}],
'price': 21142,
'price_includes_vat': False,
'registration_date': '2023-09-11',
'seats_number': None,
'seller_name': None,
'title': 'Cupra Leon VZ1 TSI S-A',
'transmission': 'automatic',
'trim': 'VZ1 TSI S-A',
'vin': 'VSSZZZKL1PR034963',
'year': 2023}
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720372589%27 HTTP/1.1" 200 None
2026-03-29 20:08:40 [motorway.uk] INFO: Saving data for 20372589: {'created_time': 1774814920.705548, 'last_price_update_time': 1774814920.705557, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20372589') HTTP/1.1" 204 0
2026-03-29 20:08:40 [motorway.uk] INFO: Found listing with ID: 2726366
2026-03-29 20:08:40 [motorway.uk] INFO: Found listing with ID: 20047376
2026-03-29 20:08:40 [motorway.uk] INFO: Found listing with ID: 19669988
2026-03-29 20:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2558/18732558/exterior_rear_driver-1769769291226.jpg> (referer: None)
2026-03-29 20:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7568/20127568/docs_service_history-1774782126095.jpg?ixlib=js-3.8.0&auto=format&s=ba0ec2afd3e9183f377a35123948405a> (referer: None)
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d114690>
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9772%252F16989772%252Fexterior_rear_driver-1774715869993.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_rear_driver-1774715869993.jpg saved to cache
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55fff08f-3215-512b-a76a-96e171430300
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f621c10>
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9772%252F16989772%252Fexterior_front_driver-1774715854160.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_front_driver-1774715854160.jpg saved to cache
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55fff08f-3215-512b-a76a-96e171430300
2026-03-29 20:08:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55fff08f-3215-512b-a76a-96e171430300, skipping ID generation
2026-03-29 20:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55fff08f-3215-512b-a76a-96e171430300 with scrape type 1
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55fff08f-3215-512b-a76a-96e171430300 sending to next pipeline
2026-03-29 20:08:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 55fff08f-3215-512b-a76a-96e171430300, identifier: 16989772
2026-03-29 20:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d214e90>
2026-03-29 20:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7813%252F20087813%252Fexterior_rear_driver-1773320933793.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_rear_driver-1773320933793.jpg saved to cache
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37
2026-03-29 20:08:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b34c870-ec72-5ac0-8f68-cb6ac0649f37, skipping ID generation
2026-03-29 20:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37 with scrape type 1
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b34c870-ec72-5ac0-8f68-cb6ac0649f37 sending to next pipeline
2026-03-29 20:08:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9b34c870-ec72-5ac0-8f68-cb6ac0649f37, identifier: 20087813
2026-03-29 20:08:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 55fff08f-3215-512b-a76a-96e171430300 with identifier: 16989772
2026-03-29 20:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 55fff08f-3215-512b-a76a-96e171430300 with identifier: 16989772
2026-03-29 20:08:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 55fff08f-3215-512b-a76a-96e171430300 with identifier: 16989772 to the API
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_front_driver-1774715854160.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '55fff08f-3215-512b-a76a-96e171430300',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RE22 KDX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16989772',
'listing': 'auction',
'location': 'Hampshire Hook',
'make': 'Audi',
'model': 'A3',
'odometer': 46400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1866161,
'Height': 2438,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_front_driver-1774715854160.jpg',
'Width': 3251},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1353758,
'Height': 2279,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_rear_driver-1774715869993.jpg',
'Width': 3039},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1605923,
'Height': 2417,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_front_passenger-1774715927807.jpg',
'Width': 3223},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1531885,
'Height': 2323,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9772/16989772/exterior_rear_passenger-1774715898111.jpg',
'Width': 3097},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3698203,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9772/16989772/interior_front_seats-1774716433939.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3782099,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9772/16989772/interior_rear_seats-1774716464985.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3266023,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9772/16989772/interior_dashboard-1774716496401.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3036439,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9772/16989772/instrument_cluster-1774716509975.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3790734,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9772/16989772/interior_boot-1774716511030.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff08f-3215-512b-a76a-96e171430300/55fff08f-3215-512b-a76a-96e171430300_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285755,
'Height': 2436,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9772/16989772/docs_service_history-1774716920596.jpg?ixlib=js-3.8.0&auto=format&s=74a6e56930c91a3dd2e64cbe8fde7b24',
'Width': 1125}],
'price': 20136,
'price_includes_vat': False,
'registration_date': '2022-05-21',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 S Line Edition 1 35 TDI S-A',
'transmission': 'automatic',
'trim': 'S Line Edition 1 35 TDI S-A',
'vin': 'WAUZZZGY1NA065029',
'year': 2022}
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716989772%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [motorway.uk] INFO: Saving data for 16989772: {'created_time': 1774814921.743704, 'last_price_update_time': 1774814921.743715, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16989772') HTTP/1.1" 204 0
2026-03-29 20:08:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9b34c870-ec72-5ac0-8f68-cb6ac0649f37 with identifier: 20087813
2026-03-29 20:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9b34c870-ec72-5ac0-8f68-cb6ac0649f37 with identifier: 20087813
2026-03-29 20:08:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9b34c870-ec72-5ac0-8f68-cb6ac0649f37 with identifier: 20087813 to the API
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_rear_driver-1773320933793.jpg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9b34c870-ec72-5ac0-8f68-cb6ac0649f37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK71 XEF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20087813',
'listing': 'auction',
'location': 'Kent Ashford',
'make': 'Citroen',
'model': 'C1',
'odometer': 36814,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1469481,
'Height': 2398,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_front_driver-1773320950097.jpg',
'Width': 3197},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1537084,
'Height': 2446,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_rear_driver-1773320933793.jpg',
'Width': 3261},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1217050,
'Height': 2227,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_front_passenger-1773320887389.jpg',
'Width': 2969},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1272546,
'Height': 2186,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7813/20087813/exterior_rear_passenger-1773320913798.jpg',
'Width': 2915},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6505227,
'Height': 4608,
'OriginUrl': 'https://motorway-photos.imgix.net/7813/20087813/interior_front_seats-1773321665560.jpg',
'Width': 3456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6708464,
'Height': 4608,
'OriginUrl': 'https://motorway-photos.imgix.net/7813/20087813/interior_rear_seats-1773321662284.jpg',
'Width': 3456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1715458,
'Height': 4608,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7813/20087813/interior_dashboard-1773321788474.jpg',
'Width': 3456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5799918,
'Height': 4608,
'OriginUrl': 'https://motorway-photos.imgix.net/7813/20087813/interior_boot-1773321663523.jpg',
'Width': 3456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109155,
'Height': 908,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7813/20087813/docs_service_history-1774626637351.jpg?ixlib=js-3.8.0&auto=format&s=c6eef0a0211c74bfc0d94f72eaf5677c',
'Width': 1210},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b34c870-ec72-5ac0-8f68-cb6ac0649f37/9b34c870-ec72-5ac0-8f68-cb6ac0649f37_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 56199,
'Height': 179,
'OriginUrl': 'https://motorway-photos.imgix.net/7813/20087813/damage_missing_trims-1774629197426.png',
'Width': 196}],
'price': 7284,
'price_includes_vat': False,
'registration_date': '2021-11-30',
'seats_number': None,
'seller_name': None,
'title': 'Citroen C1 Shine',
'transmission': 'manual',
'trim': 'Shine',
'vin': 'VF7PSCFB7MR595386',
'year': 2021}
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720087813%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [motorway.uk] INFO: Saving data for 20087813: {'created_time': 1774814922.117603, 'last_price_update_time': 1774814922.117615, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20087813') HTTP/1.1" 204 0
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f623d50>
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2558%252F18732558%252Fexterior_rear_driver-1769769291226.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2558/18732558/exterior_rear_driver-1769769291226.jpg saved to cache
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52e4ec49-2446-5b4d-bcdb-705910774bb0
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d71a350>
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57266667-a7ea-5f5b-9b23-a7839f0bff3f/57266667-a7ea-5f5b-9b23-a7839f0bff3f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7568%252F20127568%252Fdocs_service_history-1774782126095.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dba0ec2afd3e9183f377a35123948405a') HTTP/1.1" 204 0
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7568/20127568/docs_service_history-1774782126095.jpg?ixlib=js-3.8.0&auto=format&s=ba0ec2afd3e9183f377a35123948405a saved to cache
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57266667-a7ea-5f5b-9b23-a7839f0bff3f
2026-03-29 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_front_driver-1774711708881.jpg> (referer: None)
2026-03-29 20:08:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2558/18732558/exterior_front_driver-1769769271395.jpg> (referer: None)
2026-03-29 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7824/20447824/instrument_cluster-1774519978121.jpg> (referer: None)
2026-03-29 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2352/18832352/instrument_cluster-1774780751976.jpg> (referer: None)
2026-03-29 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6049/20286049/interior_boot-1774709162052.jpg> (referer: None)
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d692990>
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8213%252F16608213%252Fexterior_front_driver-1774711708881.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_front_driver-1774711708881.jpg saved to cache
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c
2026-03-29 20:08:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c, skipping ID generation
2026-03-29 20:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c with scrape type 1
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c sending to next pipeline
2026-03-29 20:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c, identifier: 16608213
2026-03-29 20:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c with identifier: 16608213
2026-03-29 20:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c with identifier: 16608213
2026-03-29 20:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3f3c93c3-3f86-5812-8e5e-47fbc9852b3c with identifier: 16608213 to the API
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_front_driver-1774711708881.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '3f3c93c3-3f86-5812-8e5e-47fbc9852b3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RP11 MCC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16608213',
'listing': 'auction',
'location': 'Armagh City, Banbridge And Craigavon Craigavon',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 73410,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2221122,
'Height': 2740,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_front_driver-1774711708881.jpg',
'Width': 3653},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1937049,
'Height': 2645,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_rear_driver-1774711733665.jpg',
'Width': 3526},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1526980,
'Height': 2621,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_front_passenger-1774711767290.jpg',
'Width': 3495},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2342080,
'Height': 2840,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8213/16608213/exterior_rear_passenger-1774711748469.jpg',
'Width': 3786},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3541299,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8213/16608213/interior_front_seats-1774712140589.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3898071,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8213/16608213/interior_rear_seats-1774712161288.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2837695,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8213/16608213/interior_dashboard-1774712192839.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2191600,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8213/16608213/instrument_cluster-1774712240665.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3734366,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8213/16608213/interior_boot-1774712201133.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3c93c3-3f86-5812-8e5e-47fbc9852b3c/3f3c93c3-3f86-5812-8e5e-47fbc9852b3c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533720,
'Height': 1403,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8213/16608213/16608213-docs_service_history-modified-1751562141198.jpeg?ixlib=js-3.8.0&auto=format&s=ff1ce210d0402d5236c7914189f30494',
'Width': 1871}],
'price': 17123,
'price_includes_vat': False,
'registration_date': '2016-09-21',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Vogue TDV6 Auto',
'transmission': 'automatic',
'trim': 'Vogue TDV6 Auto',
'vin': 'SALGA2KE6GA302793',
'year': 2016}
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716608213%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [motorway.uk] INFO: Saving data for 16608213: {'created_time': 1774814923.096664, 'last_price_update_time': 1774814923.096675, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16608213') HTTP/1.1" 204 0
2026-03-29 20:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20211024.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e192c90>
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2558%252F18732558%252Fexterior_front_driver-1769769271395.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2558/18732558/exterior_front_driver-1769769271395.jpg saved to cache
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52e4ec49-2446-5b4d-bcdb-705910774bb0
2026-03-29 20:08:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52e4ec49-2446-5b4d-bcdb-705910774bb0, skipping ID generation
2026-03-29 20:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52e4ec49-2446-5b4d-bcdb-705910774bb0 with scrape type 1
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52e4ec49-2446-5b4d-bcdb-705910774bb0 sending to next pipeline
2026-03-29 20:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 52e4ec49-2446-5b4d-bcdb-705910774bb0, identifier: 18732558
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d719c50>
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b/a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7824%252F20447824%252Finstrument_cluster-1774519978121.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7824/20447824/instrument_cluster-1774519978121.jpg saved to cache
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d217850>
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a9cc52-84ce-57f2-b289-5a209e195aa5/c6a9cc52-84ce-57f2-b289-5a209e195aa5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2352%252F18832352%252Finstrument_cluster-1774780751976.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2352/18832352/instrument_cluster-1774780751976.jpg saved to cache
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6a9cc52-84ce-57f2-b289-5a209e195aa5
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4736d0>
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040161ab-964b-5100-877d-b6ed73aba9d3/040161ab-964b-5100-877d-b6ed73aba9d3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F20286049%252Finterior_boot-1774709162052.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/20286049/interior_boot-1774709162052.jpg saved to cache
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 040161ab-964b-5100-877d-b6ed73aba9d3
2026-03-29 20:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 52e4ec49-2446-5b4d-bcdb-705910774bb0 with identifier: 18732558
2026-03-29 20:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 52e4ec49-2446-5b4d-bcdb-705910774bb0 with identifier: 18732558
2026-03-29 20:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 52e4ec49-2446-5b4d-bcdb-705910774bb0 with identifier: 18732558 to the API
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2558/18732558/exterior_front_driver-1769769271395.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '52e4ec49-2446-5b4d-bcdb-705910774bb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PN72 WPD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18732558',
'listing': 'auction',
'location': 'Lancashire Thornton-Cleveleys',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 21268,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2538904,
'Height': 2717,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2558/18732558/exterior_front_driver-1769769271395.jpg',
'Width': 3623},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1993796,
'Height': 2600,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2558/18732558/exterior_rear_driver-1769769291226.jpg',
'Width': 3467},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2307432,
'Height': 2749,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2558/18732558/exterior_front_passenger-1769769320968.jpg',
'Width': 3665},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2352548,
'Height': 2666,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2558/18732558/exterior_rear_passenger-1774715670430.jpg',
'Width': 3555},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3841544,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2558/18732558/interior_front_seats-1769769613465.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3429987,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2558/18732558/interior_rear_seats-1769769641571.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2050930,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2558/18732558/interior_dashboard-1774715695248.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2899682,
'Height': 2763,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2558/18732558/interior_boot-1774715710736.jpg',
'Width': 3684},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2139687,
'Height': 3188,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/2558/18732558/docs_service_history-1769858687182.jpg?ixlib=js-3.8.0&auto=format&s=600b3a36f24e24b760f272f71411effe',
'Width': 4250},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52e4ec49-2446-5b4d-bcdb-705910774bb0/52e4ec49-2446-5b4d-bcdb-705910774bb0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1221299,
'Height': 2309,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2558/18732558/wheels_front_driver-1769769348628.jpg',
'Width': 3079}],
'price': 26275,
'price_includes_vat': False,
'registration_date': '2022-09-07',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen T-Roc R TSI 4MOTION S-A',
'transmission': 'automatic',
'trim': 'R TSI 4MOTION S-A',
'vin': 'WVGZZZA1ZPV524116',
'year': 2022}
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718732558%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [motorway.uk] INFO: Saving data for 18732558: {'created_time': 1774814924.196438, 'last_price_update_time': 1774814924.196451, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18732558') HTTP/1.1" 204 0
2026-03-29 20:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0018e481-c0d6-54f4-8d9e-fd78358b769d with identifier: 20211024
2026-03-29 20:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0018e481-c0d6-54f4-8d9e-fd78358b769d with scrape type 1
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0018e481-c0d6-54f4-8d9e-fd78358b769d
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1024%252F20211024%252Fexterior_front_driver-1774096675771.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1024/20211024/exterior_front_driver-1774096675771.jpg already downloaded
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1024%252F20211024%252Fexterior_rear_driver-1774096711563.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1024/20211024/exterior_rear_driver-1774096711563.jpg already downloaded
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1024%252F20211024%252Fexterior_front_passenger-1774096501790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1024/20211024/exterior_front_passenger-1774096501790.jpg already downloaded
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1024%252F20211024%252Fexterior_rear_passenger-1774096754511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1024/20211024/exterior_rear_passenger-1774096754511.jpg already downloaded
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1024%252F20211024%252Finterior_front_seats-1774097587315.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1024/20211024/interior_front_seats-1774097587315.jpg already downloaded
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1024%252F20211024%252Finterior_rear_seats-1774097492357.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1024/20211024/interior_rear_seats-1774097492357.jpg already downloaded
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1024%252F20211024%252Finterior_dashboard-1774097545557.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1024/20211024/interior_dashboard-1774097545557.jpg already downloaded
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1024%252F20211024%252Finterior_boot-1774097560820.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1024/20211024/interior_boot-1774097560820.jpg already downloaded
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1024%252F20211024%252Fdocs_service_history-1774097965572.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4dbf4c4ee65fec310e553c7338783f43%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1024/20211024/docs_service_history-1774097965572.jpg?ixlib=js-3.8.0&auto=format&s=4dbf4c4ee65fec310e553c7338783f43 already downloaded
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1024%252F20211024%252Fdocs_service_history-1774097966364.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D43d1ee08cf73a3a98771796a4a369b62%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1024/20211024/docs_service_history-1774097966364.jpg?ixlib=js-3.8.0&auto=format&s=43d1ee08cf73a3a98771796a4a369b62 already downloaded
2026-03-29 20:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0018e481-c0d6-54f4-8d9e-fd78358b769d, identifier: 20211024
2026-03-29 20:08:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0018e481-c0d6-54f4-8d9e-fd78358b769d with identifier: 20211024
2026-03-29 20:08:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0018e481-c0d6-54f4-8d9e-fd78358b769d with identifier: 20211024
2026-03-29 20:08:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0018e481-c0d6-54f4-8d9e-fd78358b769d with identifier: 20211024 to the API
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20211024.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '0018e481-c0d6-54f4-8d9e-fd78358b769d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BT69 HKV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20211024',
'listing': 'auction',
'location': 'Suffolk Felixstowe',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 50950,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/1024/20211024/exterior_front_driver-1774096675771.jpg',
'https://motorway-photos-redacted.imgix.net/1024/20211024/exterior_rear_driver-1774096711563.jpg',
'https://motorway-photos-redacted.imgix.net/1024/20211024/exterior_front_passenger-1774096501790.jpg',
'https://motorway-photos-redacted.imgix.net/1024/20211024/exterior_rear_passenger-1774096754511.jpg',
'https://motorway-photos.imgix.net/1024/20211024/interior_front_seats-1774097587315.jpg',
'https://motorway-photos.imgix.net/1024/20211024/interior_rear_seats-1774097492357.jpg',
'https://motorway-photos-redacted.imgix.net/1024/20211024/interior_dashboard-1774097545557.jpg',
'https://motorway-photos.imgix.net/1024/20211024/interior_boot-1774097560820.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/1024/20211024/docs_service_history-1774097965572.jpg?ixlib=js-3.8.0&auto=format&s=4dbf4c4ee65fec310e553c7338783f43',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/1024/20211024/docs_service_history-1774097966364.jpg?ixlib=js-3.8.0&auto=format&s=43d1ee08cf73a3a98771796a4a369b62'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0018e481-c0d6-54f4-8d9e-fd78358b769d/0018e481-c0d6-54f4-8d9e-fd78358b769d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1601782,
'Height': 2626,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1024/20211024/exterior_front_driver-1774096675771.jpg',
'Width': 3501},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0018e481-c0d6-54f4-8d9e-fd78358b769d/0018e481-c0d6-54f4-8d9e-fd78358b769d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1773656,
'Height': 2649,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1024/20211024/exterior_rear_driver-1774096711563.jpg',
'Width': 3532},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0018e481-c0d6-54f4-8d9e-fd78358b769d/0018e481-c0d6-54f4-8d9e-fd78358b769d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 901699,
'Height': 2215,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1024/20211024/exterior_front_passenger-1774096501790.jpg',
'Width': 2953},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0018e481-c0d6-54f4-8d9e-fd78358b769d/0018e481-c0d6-54f4-8d9e-fd78358b769d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2025566,
'Height': 2666,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1024/20211024/exterior_rear_passenger-1774096754511.jpg',
'Width': 3555},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0018e481-c0d6-54f4-8d9e-fd78358b769d/0018e481-c0d6-54f4-8d9e-fd78358b769d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3414809,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1024/20211024/interior_front_seats-1774097587315.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0018e481-c0d6-54f4-8d9e-fd78358b769d/0018e481-c0d6-54f4-8d9e-fd78358b769d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3611060,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1024/20211024/interior_rear_seats-1774097492357.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0018e481-c0d6-54f4-8d9e-fd78358b769d/0018e481-c0d6-54f4-8d9e-fd78358b769d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2918245,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1024/20211024/interior_dashboard-1774097545557.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0018e481-c0d6-54f4-8d9e-fd78358b769d/0018e481-c0d6-54f4-8d9e-fd78358b769d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4642242,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1024/20211024/interior_boot-1774097560820.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0018e481-c0d6-54f4-8d9e-fd78358b769d/0018e481-c0d6-54f4-8d9e-fd78358b769d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 905480,
'Height': 2507,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1024/20211024/docs_service_history-1774097965572.jpg?ixlib=js-3.8.0&auto=format&s=4dbf4c4ee65fec310e553c7338783f43',
'Width': 3136},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0018e481-c0d6-54f4-8d9e-fd78358b769d/0018e481-c0d6-54f4-8d9e-fd78358b769d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558415,
'Height': 2538,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1024/20211024/docs_service_history-1774097966364.jpg?ixlib=js-3.8.0&auto=format&s=43d1ee08cf73a3a98771796a4a369b62',
'Width': 2020}],
'price': 10519,
'price_includes_vat': False,
'registration_date': '2019-10-29',
'seats_number': None,
'seller_name': None,
'title': 'Ford Mondeo Titanium Edition Eblue',
'transmission': 'manual',
'trim': 'Titanium Edition Eblue',
'vin': 'WF0EXXWPCEKD40776',
'year': 2019}
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720211024%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [motorway.uk] INFO: Saving data for 20211024: {'created_time': 1774814925.46974, 'last_price_update_time': 1774814925.469751, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20211024') HTTP/1.1" 204 0
2026-03-29 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20416855.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20478414.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20301561.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20463207.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20382318.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2352/18832352/interior_dashboard-1774778269557.jpg> (referer: None)
2026-03-29 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3443/18663443/interior_dashboard-1774551564030.jpg> (referer: None)
2026-03-29 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7824/20447824/interior_dashboard-1774520393898.jpg> (referer: None)
2026-03-29 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6049/20286049/instrument_cluster-1774709149805.jpg> (referer: None)
2026-03-29 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7568/20127568/interior_boot-1774451561399.jpg> (referer: None)
2026-03-29 20:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e48682f2-30aa-54d8-9b4c-dca8852ec209 with identifier: 20416855
2026-03-29 20:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e48682f2-30aa-54d8-9b4c-dca8852ec209 with scrape type 1
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e48682f2-30aa-54d8-9b4c-dca8852ec209
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6855%252F20416855%252Fexterior_front_driver-1774689166752.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6855/20416855/exterior_front_driver-1774689166752.jpg not downloaded yet
2026-03-29 20:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a with identifier: 20478414
2026-03-29 20:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a with scrape type 1
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8414%252F20478414%252Fexterior_front_driver-1774704419563.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8414/20478414/exterior_front_driver-1774704419563.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6855%252F20416855%252Fexterior_rear_driver-1774689084910.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6855/20416855/exterior_rear_driver-1774689084910.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8414%252F20478414%252Fexterior_rear_driver-1774704421886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8414/20478414/exterior_rear_driver-1774704421886.jpg not downloaded yet
2026-03-29 20:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e58422d5-8d92-5a29-8a01-0b5869ec7133 with identifier: 20301561
2026-03-29 20:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e58422d5-8d92-5a29-8a01-0b5869ec7133 with scrape type 1
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e58422d5-8d92-5a29-8a01-0b5869ec7133
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1561%252F20301561%252Fexterior_front_driver-1774277209523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1561/20301561/exterior_front_driver-1774277209523.jpg not downloaded yet
2026-03-29 20:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0de82f31-65ac-5200-8520-505df4741d00 with identifier: 20463207
2026-03-29 20:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0de82f31-65ac-5200-8520-505df4741d00 with scrape type 1
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0de82f31-65ac-5200-8520-505df4741d00
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3207%252F20463207%252Fexterior_front_driver-1774701813710.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3207/20463207/exterior_front_driver-1774701813710.jpg not downloaded yet
2026-03-29 20:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5f2c947-3c53-5741-bd45-01de559a45ec with identifier: 20382318
2026-03-29 20:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5f2c947-3c53-5741-bd45-01de559a45ec with scrape type 1
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5f2c947-3c53-5741-bd45-01de559a45ec
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2318%252F20382318%252Fexterior_front_driver-1774267016611.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2318/20382318/exterior_front_driver-1774267016611.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6855%252F20416855%252Fexterior_front_passenger-1774689454815.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6855/20416855/exterior_front_passenger-1774689454815.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8414%252F20478414%252Fexterior_front_passenger-1774704541065.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8414/20478414/exterior_front_passenger-1774704541065.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1561%252F20301561%252Fexterior_rear_driver-1774277221762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1561/20301561/exterior_rear_driver-1774277221762.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3207%252F20463207%252Fexterior_rear_driver-1774701822370.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3207/20463207/exterior_rear_driver-1774701822370.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2318%252F20382318%252Fexterior_rear_driver-1774267107132.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2318/20382318/exterior_rear_driver-1774267107132.jpg not downloaded yet
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1dbc90>
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a9cc52-84ce-57f2-b289-5a209e195aa5/c6a9cc52-84ce-57f2-b289-5a209e195aa5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2352%252F18832352%252Finterior_dashboard-1774778269557.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2352/18832352/interior_dashboard-1774778269557.jpg saved to cache
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6a9cc52-84ce-57f2-b289-5a209e195aa5
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d48d990>
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fed97f66-d218-5c4b-8f4b-bb24e241aceb/fed97f66-d218-5c4b-8f4b-bb24e241aceb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3443%252F18663443%252Finterior_dashboard-1774551564030.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3443/18663443/interior_dashboard-1774551564030.jpg saved to cache
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fed97f66-d218-5c4b-8f4b-bb24e241aceb
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d47ce50>
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b/a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7824%252F20447824%252Finterior_dashboard-1774520393898.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7824/20447824/interior_dashboard-1774520393898.jpg saved to cache
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d48e9d0>
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040161ab-964b-5100-877d-b6ed73aba9d3/040161ab-964b-5100-877d-b6ed73aba9d3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F20286049%252Finstrument_cluster-1774709149805.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/20286049/instrument_cluster-1774709149805.jpg saved to cache
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 040161ab-964b-5100-877d-b6ed73aba9d3
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d476ad0>
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57266667-a7ea-5f5b-9b23-a7839f0bff3f/57266667-a7ea-5f5b-9b23-a7839f0bff3f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7568%252F20127568%252Finterior_boot-1774451561399.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7568/20127568/interior_boot-1774451561399.jpg saved to cache
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57266667-a7ea-5f5b-9b23-a7839f0bff3f
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6855%252F20416855%252Fexterior_rear_passenger-1774689398623.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6855/20416855/exterior_rear_passenger-1774689398623.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8414%252F20478414%252Fexterior_rear_passenger-1774704525015.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8414/20478414/exterior_rear_passenger-1774704525015.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1561%252F20301561%252Fexterior_front_passenger-1774277244810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1561/20301561/exterior_front_passenger-1774277244810.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3207%252F20463207%252Fexterior_front_passenger-1774701870966.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3207/20463207/exterior_front_passenger-1774701870966.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2318%252F20382318%252Fexterior_front_passenger-1774267085623.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2318/20382318/exterior_front_passenger-1774267085623.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6855%252F20416855%252Finterior_front_seats-1774688973861.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6855/20416855/interior_front_seats-1774688973861.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8414%252F20478414%252Finterior_front_seats-1774704913647.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8414/20478414/interior_front_seats-1774704913647.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1561%252F20301561%252Fexterior_rear_passenger-1774277242198.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1561/20301561/exterior_rear_passenger-1774277242198.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3207%252F20463207%252Fexterior_rear_passenger-1774701836774.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3207/20463207/exterior_rear_passenger-1774701836774.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2318%252F20382318%252Fexterior_rear_passenger-1774267070254.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2318/20382318/exterior_rear_passenger-1774267070254.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6855%252F20416855%252Finterior_rear_seats-1774689295814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6855/20416855/interior_rear_seats-1774689295814.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8414%252F20478414%252Finterior_rear_seats-1774704921879.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8414/20478414/interior_rear_seats-1774704921879.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1561%252F20301561%252Finterior_front_seats-1774277600399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1561/20301561/interior_front_seats-1774277600399.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3207%252F20463207%252Finterior_front_seats-1774702535380.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3207/20463207/interior_front_seats-1774702535380.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2318%252F20382318%252Finterior_front_seats-1774268000417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2318/20382318/interior_front_seats-1774268000417.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6855%252F20416855%252Finterior_dashboard-1774692722004.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6855/20416855/interior_dashboard-1774692722004.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8414%252F20478414%252Finterior_dashboard-1774710569217.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8414/20478414/interior_dashboard-1774710569217.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1561%252F20301561%252Finterior_rear_seats-1774277671260.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1561/20301561/interior_rear_seats-1774277671260.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3207%252F20463207%252Finterior_dashboard-1774702580467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3207/20463207/interior_dashboard-1774702580467.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2318%252F20382318%252Finterior_rear_seats-1774268028411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2318/20382318/interior_rear_seats-1774268028411.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6855%252F20416855%252Finterior_boot-1774689126943.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6855/20416855/interior_boot-1774689126943.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8414%252F20478414%252Finstrument_cluster-1774705012491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8414/20478414/instrument_cluster-1774705012491.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1561%252F20301561%252Finterior_dashboard-1774277652915.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1561/20301561/interior_dashboard-1774277652915.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3207%252F20463207%252Finstrument_cluster-1774702603209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3207/20463207/instrument_cluster-1774702603209.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2318%252F20382318%252Finterior_dashboard-1774267958496.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2318/20382318/interior_dashboard-1774267958496.jpg not downloaded yet
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20066529.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6855%252F20416855%252Fdocs_service_history-1774699756316.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9a082001ac5c162ae5d01d8de8f3a28c%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6855/20416855/docs_service_history-1774699756316.jpg?ixlib=js-3.8.0&auto=format&s=9a082001ac5c162ae5d01d8de8f3a28c not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8414%252F20478414%252Finterior_boot-1774704949074.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8414/20478414/interior_boot-1774704949074.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1561%252F20301561%252Finstrument_cluster-1774277720076.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1561/20301561/instrument_cluster-1774277720076.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3207%252F20463207%252Finterior_boot-1774702634222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3207/20463207/interior_boot-1774702634222.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2318%252F20382318%252Finstrument_cluster-1774268003352.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2318/20382318/instrument_cluster-1774268003352.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6855%252F20416855%252Fwheels_front_driver-1774689023363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6855/20416855/wheels_front_driver-1774689023363.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8414%252F20478414%252Fdocs_service_history-1774710605729.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9863eca1163131ffb03491b59370d466%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8414/20478414/docs_service_history-1774710605729.jpg?ixlib=js-3.8.0&auto=format&s=9863eca1163131ffb03491b59370d466 not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1561%252F20301561%252Finterior_boot-1774277648925.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1561/20301561/interior_boot-1774277648925.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3207%252F20463207%252Fdamage_scratches-1774701908759.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3207/20463207/damage_scratches-1774701908759.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2318%252F20382318%252Finterior_boot-1774267971504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2318/20382318/interior_boot-1774267971504.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1561%252F20301561%252Fdocs_service_history-1774277928264.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D03e2b6e19b793b3cd60c06ecc3d3c29d%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1561/20301561/docs_service_history-1774277928264.jpg?ixlib=js-3.8.0&auto=format&s=03e2b6e19b793b3cd60c06ecc3d3c29d not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3207%252F20463207%252Fdamage_scratches-1774701986563.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3207/20463207/damage_scratches-1774701986563.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2318%252F20382318%252Fwheels_front_driver-1774267213140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2318/20382318/wheels_front_driver-1774267213140.jpg not downloaded yet
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17857405.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6acc6ba6-a218-5979-9d92-77f448605d23 with identifier: 20066529
2026-03-29 20:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6acc6ba6-a218-5979-9d92-77f448605d23 with scrape type 1
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6acc6ba6-a218-5979-9d92-77f448605d23
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6529%252F20066529%252Fexterior_front_driver-1772459622275.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_front_driver-1772459622275.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6529%252F20066529%252Fexterior_rear_driver-1772459563449.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_rear_driver-1772459563449.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6529%252F20066529%252Fexterior_front_passenger-1772459580938.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_front_passenger-1772459580938.jpg not downloaded yet
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0670/20490670/interior_boot-1774712028018.jpg> (referer: None)
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6529%252F20066529%252Fexterior_rear_passenger-1772459604740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_rear_passenger-1772459604740.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6529%252F20066529%252Finterior_front_seats-1774786415648.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6529/20066529/interior_front_seats-1774786415648.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6529%252F20066529%252Finterior_rear_seats-1774786420521.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6529/20066529/interior_rear_seats-1774786420521.jpg not downloaded yet
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1561/20301561/exterior_front_passenger-1774277244810.jpg> (referer: None)
2026-03-29 20:08:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 735cafb8-c25f-5064-a680-ded38bf37994 with identifier: 17857405
2026-03-29 20:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 735cafb8-c25f-5064-a680-ded38bf37994 with scrape type 1
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 735cafb8-c25f-5064-a680-ded38bf37994
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7405%252F17857405%252Fexterior_front_driver-1774631809352.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_front_driver-1774631809352.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6529%252F20066529%252Finterior_dashboard-1774796221079.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6529/20066529/interior_dashboard-1774796221079.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7405%252F17857405%252Fexterior_rear_driver-1774631835226.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_rear_driver-1774631835226.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6529%252F20066529%252Finstrument_cluster-1774796238906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6529/20066529/instrument_cluster-1774796238906.jpg not downloaded yet
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1a9590>
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328fb3ca-2b51-57eb-86d0-510e6deb32ae/328fb3ca-2b51-57eb-86d0-510e6deb32ae_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0670%252F20490670%252Finterior_boot-1774712028018.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0670/20490670/interior_boot-1774712028018.jpg saved to cache
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 328fb3ca-2b51-57eb-86d0-510e6deb32ae
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3443/18663443/interior_rear_seats-1774551400122.jpg> (referer: None)
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7405%252F17857405%252Fexterior_front_passenger-1774631878399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_front_passenger-1774631878399.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6529%252F20066529%252Finterior_boot-1774786438417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6529/20066529/interior_boot-1774786438417.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7405%252F17857405%252Fexterior_rear_passenger-1774631863118.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_rear_passenger-1774631863118.jpg not downloaded yet
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6529%252F20066529%252Fdocs_service_history-1774796204162.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D19b4c20c1b2cc07ea0bc85fba4cb0682%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6529/20066529/docs_service_history-1774796204162.jpg?ixlib=js-3.8.0&auto=format&s=19b4c20c1b2cc07ea0bc85fba4cb0682 not downloaded yet
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8e6e90>
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58422d5-8d92-5a29-8a01-0b5869ec7133/e58422d5-8d92-5a29-8a01-0b5869ec7133_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1561%252F20301561%252Fexterior_front_passenger-1774277244810.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1561/20301561/exterior_front_passenger-1774277244810.jpg saved to cache
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e58422d5-8d92-5a29-8a01-0b5869ec7133
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7405%252F17857405%252Finterior_front_seats-1774632382331.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7405/17857405/interior_front_seats-1774632382331.jpg not downloaded yet
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3207/20463207/exterior_front_passenger-1774701870966.jpg> (referer: None)
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7405%252F17857405%252Finterior_rear_seats-1774632442072.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7405/17857405/interior_rear_seats-1774632442072.jpg not downloaded yet
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8414/20478414/exterior_rear_passenger-1774704525015.jpg> (referer: None)
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7345d0>
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fed97f66-d218-5c4b-8f4b-bb24e241aceb/fed97f66-d218-5c4b-8f4b-bb24e241aceb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3443%252F18663443%252Finterior_rear_seats-1774551400122.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3443/18663443/interior_rear_seats-1774551400122.jpg saved to cache
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fed97f66-d218-5c4b-8f4b-bb24e241aceb
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7405%252F17857405%252Finterior_dashboard-1774632496450.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7405/17857405/interior_dashboard-1774632496450.jpg not downloaded yet
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_front_driver-1772459622275.jpg> (referer: None)
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7405%252F17857405%252Finstrument_cluster-1774632441317.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7405/17857405/instrument_cluster-1774632441317.jpg not downloaded yet
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2318/20382318/exterior_front_passenger-1774267085623.jpg> (referer: None)
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7350d0>
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de82f31-65ac-5200-8520-505df4741d00/0de82f31-65ac-5200-8520-505df4741d00_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3207%252F20463207%252Fexterior_front_passenger-1774701870966.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3207/20463207/exterior_front_passenger-1774701870966.jpg saved to cache
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0de82f31-65ac-5200-8520-505df4741d00
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6ddad0>
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a/c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8414%252F20478414%252Fexterior_rear_passenger-1774704525015.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8414/20478414/exterior_rear_passenger-1774704525015.jpg saved to cache
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7405%252F17857405%252Finterior_boot-1774632610989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7405/17857405/interior_boot-1774632610989.jpg not downloaded yet
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7824/20447824/interior_rear_seats-1774520357513.jpg> (referer: None)
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6049/20286049/interior_dashboard-1774709123702.jpg> (referer: None)
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7405%252F17857405%252Fdocs_service_history-1774698768129.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D036614c865d0895e619c5b4c407e61af%27 HTTP/1.1" 200 None
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7405/17857405/docs_service_history-1774698768129.jpg?ixlib=js-3.8.0&auto=format&s=036614c865d0895e619c5b4c407e61af not downloaded yet
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7568/20127568/interior_dashboard-1774782172349.jpg> (referer: None)
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_rear_driver-1772459563449.jpg> (referer: None)
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d97f890>
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6529%252F20066529%252Fexterior_front_driver-1772459622275.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_front_driver-1772459622275.jpg saved to cache
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6acc6ba6-a218-5979-9d92-77f448605d23
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dafaa10>
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f2c947-3c53-5741-bd45-01de559a45ec/b5f2c947-3c53-5741-bd45-01de559a45ec_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2318%252F20382318%252Fexterior_front_passenger-1774267085623.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2318/20382318/exterior_front_passenger-1774267085623.jpg saved to cache
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5f2c947-3c53-5741-bd45-01de559a45ec
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2352/18832352/interior_rear_seats-1774778207461.jpg> (referer: None)
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20484917.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20296127.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd3ce10>
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b/a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7824%252F20447824%252Finterior_rear_seats-1774520357513.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7824/20447824/interior_rear_seats-1774520357513.jpg saved to cache
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0983e3c-4633-5fe0-8d53-b8fa3dc38a3b
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7865d0>
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040161ab-964b-5100-877d-b6ed73aba9d3/040161ab-964b-5100-877d-b6ed73aba9d3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F20286049%252Finterior_dashboard-1774709123702.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/20286049/interior_dashboard-1774709123702.jpg saved to cache
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 040161ab-964b-5100-877d-b6ed73aba9d3
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a2950>
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57266667-a7ea-5f5b-9b23-a7839f0bff3f/57266667-a7ea-5f5b-9b23-a7839f0bff3f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7568%252F20127568%252Finterior_dashboard-1774782172349.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7568/20127568/interior_dashboard-1774782172349.jpg saved to cache
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57266667-a7ea-5f5b-9b23-a7839f0bff3f
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dee4990>
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6529%252F20066529%252Fexterior_rear_driver-1772459563449.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_rear_driver-1772459563449.jpg saved to cache
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6acc6ba6-a218-5979-9d92-77f448605d23
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a37d0>
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a9cc52-84ce-57f2-b289-5a209e195aa5/c6a9cc52-84ce-57f2-b289-5a209e195aa5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2352%252F18832352%252Finterior_rear_seats-1774778207461.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2352/18832352/interior_rear_seats-1774778207461.jpg saved to cache
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6a9cc52-84ce-57f2-b289-5a209e195aa5
2026-03-29 20:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f62a20d4-3435-5e84-b8d6-c8824e0c2391 with identifier: 20484917
2026-03-29 20:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f62a20d4-3435-5e84-b8d6-c8824e0c2391 with scrape type 1
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f62a20d4-3435-5e84-b8d6-c8824e0c2391
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20484917%252Fexterior_front_driver-1774718772874.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_front_driver-1774718772874.jpeg not downloaded yet
2026-03-29 20:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8090cb4d-aacb-5ab2-a3e4-04446e56ded6 with identifier: 20296127
2026-03-29 20:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6 with scrape type 1
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6127%252F20296127%252Fexterior_front_driver-1774703057588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_front_driver-1774703057588.jpg not downloaded yet
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20484917%252Fexterior_rear_driver-1774718818296.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_rear_driver-1774718818296.jpeg not downloaded yet
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6127%252F20296127%252Fexterior_rear_driver-1774703120195.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_rear_driver-1774703120195.jpg not downloaded yet
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18872105.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_front_passenger-1774631878399.jpg> (referer: None)
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20484917%252Fexterior_front_passenger-1774718788234.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_front_passenger-1774718788234.jpeg not downloaded yet
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6127%252F20296127%252Fexterior_front_passenger-1774703144746.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_front_passenger-1774703144746.jpg not downloaded yet
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20484917%252Fexterior_rear_passenger-1774718805881.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_rear_passenger-1774718805881.jpeg not downloaded yet
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6127%252F20296127%252Fexterior_rear_passenger-1774703132702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_rear_passenger-1774703132702.jpg not downloaded yet
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4917%252F20484917%252Finterior_front_seats-1774718845725.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4917/20484917/interior_front_seats-1774718845725.jpeg not downloaded yet
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6127%252F20296127%252Finterior_front_seats-1774703511670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6127/20296127/interior_front_seats-1774703511670.jpg not downloaded yet
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4917%252F20484917%252Finterior_rear_seats-1774718921037.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4917/20484917/interior_rear_seats-1774718921037.jpeg not downloaded yet
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6127%252F20296127%252Finterior_rear_seats-1774703541564.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6127/20296127/interior_rear_seats-1774703541564.jpg not downloaded yet
2026-03-29 20:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf6e30f6-230e-5dc2-bf11-bafb5c30cd74 with identifier: 18872105
2026-03-29 20:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74 with scrape type 1
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2105%252F18872105%252Fexterior_front_driver-1774704510319.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_front_driver-1774704510319.jpg not downloaded yet
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d239610>
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7405%252F17857405%252Fexterior_front_passenger-1774631878399.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_front_passenger-1774631878399.jpg saved to cache
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 735cafb8-c25f-5064-a680-ded38bf37994
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4917%252F20484917%252F20484917-interior_dashboard-modified-1774782072575.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4917/20484917/20484917-interior_dashboard-modified-1774782072575.jpeg not downloaded yet
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6127%252F20296127%252Finterior_dashboard-1774703665058.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6127/20296127/interior_dashboard-1774703665058.jpg not downloaded yet
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2105%252F18872105%252Fexterior_rear_driver-1774704529177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_rear_driver-1774704529177.jpg not downloaded yet
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2318/20382318/interior_dashboard-1774267958496.jpg> (referer: None)
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7405/17857405/docs_service_history-1774698768129.jpg?ixlib=js-3.8.0&auto=format&s=036614c865d0895e619c5b4c407e61af> (referer: None)
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4917%252F20484917%252F20484917-instrument_cluster-modified-1774782109108.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4917/20484917/20484917-instrument_cluster-modified-1774782109108.jpeg not downloaded yet
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6127%252F20296127%252Finstrument_cluster-1774703606410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6127/20296127/instrument_cluster-1774703606410.jpg not downloaded yet
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2105%252F18872105%252Fexterior_front_passenger-1774704580311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_front_passenger-1774704580311.jpg not downloaded yet
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4917%252F20484917%252Finterior_boot-1774719001606.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4917/20484917/interior_boot-1774719001606.jpeg not downloaded yet
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6127%252F20296127%252Finterior_boot-1774703630383.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6127/20296127/interior_boot-1774703630383.jpg not downloaded yet
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2105%252F18872105%252Fexterior_rear_passenger-1774704545112.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_rear_passenger-1774704545112.jpg not downloaded yet
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4917%252F20484917%252Fdocs_service_history-1774720169553.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D415e70e7eb8952c9f77cd29d0d58609c%27 HTTP/1.1" 200 None
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4917/20484917/docs_service_history-1774720169553.jpeg?ixlib=js-3.8.0&auto=format&s=415e70e7eb8952c9f77cd29d0d58609c not downloaded yet
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6127%252F20296127%252Fdocs_service_history-1774704008347.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1e2093c8e1d09f8cee8b9b57b3c742c7%27 HTTP/1.1" 200 None
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6127/20296127/docs_service_history-1774704008347.jpg?ixlib=js-3.8.0&auto=format&s=1e2093c8e1d09f8cee8b9b57b3c742c7 not downloaded yet
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2105%252F18872105%252Finterior_front_seats-1774705234337.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2105/18872105/interior_front_seats-1774705234337.jpg not downloaded yet
2026-03-29 20:08:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4df2d0>
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f2c947-3c53-5741-bd45-01de559a45ec/b5f2c947-3c53-5741-bd45-01de559a45ec_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2318%252F20382318%252Finterior_dashboard-1774267958496.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2318/20382318/interior_dashboard-1774267958496.jpg saved to cache
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5f2c947-3c53-5741-bd45-01de559a45ec
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d181f90>
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7405%252F17857405%252Fdocs_service_history-1774698768129.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D036614c865d0895e619c5b4c407e61af') HTTP/1.1" 204 0
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7405/17857405/docs_service_history-1774698768129.jpg?ixlib=js-3.8.0&auto=format&s=036614c865d0895e619c5b4c407e61af saved to cache
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 735cafb8-c25f-5064-a680-ded38bf37994
2026-03-29 20:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6529/20066529/instrument_cluster-1774796238906.jpg> (referer: None)
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2105%252F18872105%252Finterior_rear_seats-1774705253731.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2105/18872105/interior_rear_seats-1774705253731.jpg not downloaded yet
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2105%252F18872105%252Finterior_dashboard-1774706772816.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2105/18872105/interior_dashboard-1774706772816.jpg not downloaded yet
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2105%252F18872105%252Finterior_boot-1774705290400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2105/18872105/interior_boot-1774705290400.jpg not downloaded yet
2026-03-29 20:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6529/20066529/interior_front_seats-1774786415648.jpg> (referer: None)
2026-03-29 20:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6529/20066529/docs_service_history-1774796204162.jpg?ixlib=js-3.8.0&auto=format&s=19b4c20c1b2cc07ea0bc85fba4cb0682> (referer: None)
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2105%252F18872105%252Fdamage_dents-1774706240265.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2105/18872105/damage_dents-1774706240265.jpg not downloaded yet
2026-03-29 20:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6529/20066529/interior_boot-1774786438417.jpg> (referer: None)
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2105%252F18872105%252Fdamage_dents-1774706264339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2105/18872105/damage_dents-1774706264339.jpg not downloaded yet
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dafbd10>
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6529%252F20066529%252Finstrument_cluster-1774796238906.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6529/20066529/instrument_cluster-1774796238906.jpg saved to cache
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6acc6ba6-a218-5979-9d92-77f448605d23
2026-03-29 20:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_front_driver-1774718772874.jpeg> (referer: None)
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5277d0>
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6529%252F20066529%252Finterior_front_seats-1774786415648.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6529/20066529/interior_front_seats-1774786415648.jpg saved to cache
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6acc6ba6-a218-5979-9d92-77f448605d23
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d138f90>
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6529%252F20066529%252Fdocs_service_history-1774796204162.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D19b4c20c1b2cc07ea0bc85fba4cb0682') HTTP/1.1" 204 0
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6529/20066529/docs_service_history-1774796204162.jpg?ixlib=js-3.8.0&auto=format&s=19b4c20c1b2cc07ea0bc85fba4cb0682 saved to cache
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6acc6ba6-a218-5979-9d92-77f448605d23
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d13bd50>
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6529%252F20066529%252Finterior_boot-1774786438417.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6529/20066529/interior_boot-1774786438417.jpg saved to cache
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6acc6ba6-a218-5979-9d92-77f448605d23
2026-03-29 20:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7405/17857405/interior_dashboard-1774632496450.jpg> (referer: None)
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d160590>
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20484917%252Fexterior_front_driver-1774718772874.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_front_driver-1774718772874.jpeg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f62a20d4-3435-5e84-b8d6-c8824e0c2391
2026-03-29 20:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_front_driver-1774703057588.jpg> (referer: None)
2026-03-29 20:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7405/17857405/instrument_cluster-1774632441317.jpg> (referer: None)
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7bf510>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7405%252F17857405%252Finterior_dashboard-1774632496450.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7405/17857405/interior_dashboard-1774632496450.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 735cafb8-c25f-5064-a680-ded38bf37994
2026-03-29 20:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7405/17857405/interior_rear_seats-1774632442072.jpg> (referer: None)
2026-03-29 20:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6127/20296127/interior_dashboard-1774703665058.jpg> (referer: None)
2026-03-29 20:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_rear_passenger-1774631863118.jpg> (referer: None)
2026-03-29 20:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7405/17857405/interior_front_seats-1774632382331.jpg> (referer: None)
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d668510>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6127%252F20296127%252Fexterior_front_driver-1774703057588.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_front_driver-1774703057588.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d189f90>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7405%252F17857405%252Finstrument_cluster-1774632441317.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7405/17857405/instrument_cluster-1774632441317.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 735cafb8-c25f-5064-a680-ded38bf37994
2026-03-29 20:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_rear_driver-1774631835226.jpg> (referer: None)
2026-03-29 20:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2105/18872105/damage_dents-1774706240265.jpg> (referer: None)
2026-03-29 20:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2105/18872105/damage_dents-1774706264339.jpg> (referer: None)
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d18db10>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7405%252F17857405%252Finterior_rear_seats-1774632442072.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7405/17857405/interior_rear_seats-1774632442072.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 735cafb8-c25f-5064-a680-ded38bf37994
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc98750>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6127%252F20296127%252Finterior_dashboard-1774703665058.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6127/20296127/interior_dashboard-1774703665058.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35734990>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7405%252F17857405%252Fexterior_rear_passenger-1774631863118.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_rear_passenger-1774631863118.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 735cafb8-c25f-5064-a680-ded38bf37994
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f68ed90>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7405%252F17857405%252Finterior_front_seats-1774632382331.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7405/17857405/interior_front_seats-1774632382331.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 735cafb8-c25f-5064-a680-ded38bf37994
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f357346d0>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7405%252F17857405%252Fexterior_rear_driver-1774631835226.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_rear_driver-1774631835226.jpg saved to cache
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 735cafb8-c25f-5064-a680-ded38bf37994
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7bcb10>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2105%252F18872105%252Fdamage_dents-1774706240265.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2105/18872105/damage_dents-1774706240265.jpg saved to cache
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d166290>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2105%252F18872105%252Fdamage_dents-1774706264339.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2105/18872105/damage_dents-1774706264339.jpg saved to cache
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74
2026-03-29 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4917/20484917/20484917-interior_dashboard-modified-1774782072575.jpeg> (referer: None)
2026-03-29 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2105/18872105/interior_dashboard-1774706772816.jpg> (referer: None)
2026-03-29 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2105/18872105/interior_front_seats-1774705234337.jpg> (referer: None)
2026-03-29 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7405/17857405/interior_boot-1774632610989.jpg> (referer: None)
2026-03-29 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2105/18872105/interior_boot-1774705290400.jpg> (referer: None)
2026-03-29 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2105/18872105/interior_rear_seats-1774705253731.jpg> (referer: None)
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6682d0>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4917%252F20484917%252F20484917-interior_dashboard-modified-1774782072575.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4917/20484917/20484917-interior_dashboard-modified-1774782072575.jpeg saved to cache
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f62a20d4-3435-5e84-b8d6-c8824e0c2391
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2deb3290>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2105%252F18872105%252Finterior_dashboard-1774706772816.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2105/18872105/interior_dashboard-1774706772816.jpg saved to cache
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da00210>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2105%252F18872105%252Finterior_front_seats-1774705234337.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2105/18872105/interior_front_seats-1774705234337.jpg saved to cache
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5553d0>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7405%252F17857405%252Finterior_boot-1774632610989.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7405/17857405/interior_boot-1774632610989.jpg saved to cache
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 735cafb8-c25f-5064-a680-ded38bf37994
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e13f150>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2105%252F18872105%252Finterior_boot-1774705290400.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2105/18872105/interior_boot-1774705290400.jpg saved to cache
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da01390>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2105%252F18872105%252Finterior_rear_seats-1774705253731.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2105/18872105/interior_rear_seats-1774705253731.jpg saved to cache
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=576&page=16&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6127/20296127/docs_service_history-1774704008347.jpg?ixlib=js-3.8.0&auto=format&s=1e2093c8e1d09f8cee8b9b57b3c742c7> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_rear_passenger-1774704545112.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4917/20484917/20484917-instrument_cluster-modified-1774782109108.jpeg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_rear_driver-1774704529177.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_front_passenger-1774704580311.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_front_driver-1774704510319.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4917/20484917/docs_service_history-1774720169553.jpeg?ixlib=js-3.8.0&auto=format&s=415e70e7eb8952c9f77cd29d0d58609c> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6127/20296127/instrument_cluster-1774703606410.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6127/20296127/interior_boot-1774703630383.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6127/20296127/interior_rear_seats-1774703541564.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4917/20484917/interior_boot-1774719001606.jpeg> (referer: None)
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 19821442
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 14648195
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20442579
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 19708166
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20460964
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20264228
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720264228%27 HTTP/1.1" 200 None
2026-03-29 20:08:53 [motorway.uk] INFO: Scrape type for 20264228: 1
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 15594477
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20307515
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20481960
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 15910710
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 19313899
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20338223
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 18332731
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20355749
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720355749%27 HTTP/1.1" 200 None
2026-03-29 20:08:53 [motorway.uk] INFO: Scrape type for 20355749: 1
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 10308764
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20467839
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 17807552
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20191585
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20484266
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 18989112
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20444774
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 13523395
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 18011097
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 5866923
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20468575
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 11768479
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 14717398
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20455953
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720455953%27 HTTP/1.1" 200 None
2026-03-29 20:08:53 [motorway.uk] INFO: Scrape type for 20455953: 1
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f37f650>
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6127%252F20296127%252Fdocs_service_history-1774704008347.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1e2093c8e1d09f8cee8b9b57b3c742c7') HTTP/1.1" 204 0
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6127/20296127/docs_service_history-1774704008347.jpg?ixlib=js-3.8.0&auto=format&s=1e2093c8e1d09f8cee8b9b57b3c742c7 saved to cache
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20240624
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 18507220
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 17656743
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717656743%27 HTTP/1.1" 200 None
2026-03-29 20:08:53 [motorway.uk] INFO: Scrape type for 17656743: 1
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20131585
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20444590
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20396560
2026-03-29 20:08:53 [motorway.uk] INFO: Found listing with ID: 20484632
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484632%27 HTTP/1.1" 200 None
2026-03-29 20:08:53 [motorway.uk] INFO: Scrape type for 20484632: 1
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d164b10>
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2105%252F18872105%252Fexterior_rear_passenger-1774704545112.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_rear_passenger-1774704545112.jpg saved to cache
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d16ca50>
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4917%252F20484917%252F20484917-instrument_cluster-modified-1774782109108.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4917/20484917/20484917-instrument_cluster-modified-1774782109108.jpeg saved to cache
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f62a20d4-3435-5e84-b8d6-c8824e0c2391
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1af6d0>
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2105%252F18872105%252Fexterior_rear_driver-1774704529177.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_rear_driver-1774704529177.jpg saved to cache
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6b2e10>
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2105%252F18872105%252Fexterior_front_passenger-1774704580311.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_front_passenger-1774704580311.jpg saved to cache
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e16d390>
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2105%252F18872105%252Fexterior_front_driver-1774704510319.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_front_driver-1774704510319.jpg saved to cache
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74
2026-03-29 20:08:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf6e30f6-230e-5dc2-bf11-bafb5c30cd74, skipping ID generation
2026-03-29 20:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74 with scrape type 1
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf6e30f6-230e-5dc2-bf11-bafb5c30cd74 sending to next pipeline
2026-03-29 20:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cf6e30f6-230e-5dc2-bf11-bafb5c30cd74, identifier: 18872105
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f68d350>
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4917%252F20484917%252Fdocs_service_history-1774720169553.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D415e70e7eb8952c9f77cd29d0d58609c') HTTP/1.1" 204 0
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4917/20484917/docs_service_history-1774720169553.jpeg?ixlib=js-3.8.0&auto=format&s=415e70e7eb8952c9f77cd29d0d58609c saved to cache
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f62a20d4-3435-5e84-b8d6-c8824e0c2391
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f37e790>
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6127%252F20296127%252Finstrument_cluster-1774703606410.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6127/20296127/instrument_cluster-1774703606410.jpg saved to cache
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d669690>
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6127%252F20296127%252Finterior_boot-1774703630383.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6127/20296127/interior_boot-1774703630383.jpg saved to cache
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd1d010>
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6127%252F20296127%252Finterior_rear_seats-1774703541564.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6127/20296127/interior_rear_seats-1774703541564.jpg saved to cache
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00Eep\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\xea\xdd\x00E[^\x00\x00\x00\x00'
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f65de90>
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4917%252F20484917%252Finterior_boot-1774719001606.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4917/20484917/interior_boot-1774719001606.jpeg saved to cache
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f62a20d4-3435-5e84-b8d6-c8824e0c2391
2026-03-29 20:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cf6e30f6-230e-5dc2-bf11-bafb5c30cd74 with identifier: 18872105
2026-03-29 20:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cf6e30f6-230e-5dc2-bf11-bafb5c30cd74 with identifier: 18872105
2026-03-29 20:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cf6e30f6-230e-5dc2-bf11-bafb5c30cd74 with identifier: 18872105 to the API
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_front_driver-1774704510319.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'cf6e30f6-230e-5dc2-bf11-bafb5c30cd74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX17 MDJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18872105',
'listing': 'auction',
'location': 'Greater London Croydon',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 66000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1969837,
'Height': 2752,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_front_driver-1774704510319.jpg',
'Width': 3669},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1651665,
'Height': 2729,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_rear_driver-1774704529177.jpg',
'Width': 3639},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1688080,
'Height': 2287,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_front_passenger-1774704580311.jpg',
'Width': 3049},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1590461,
'Height': 2479,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2105/18872105/exterior_rear_passenger-1774704545112.jpg',
'Width': 3305},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3633003,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2105/18872105/interior_front_seats-1774705234337.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3358507,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2105/18872105/interior_rear_seats-1774705253731.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1941317,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2105/18872105/interior_dashboard-1774706772816.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4406696,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2105/18872105/interior_boot-1774705290400.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44489,
'Height': 404,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2105/18872105/damage_dents-1774706240265.jpg',
'Width': 538},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6e30f6-230e-5dc2-bf11-bafb5c30cd74/cf6e30f6-230e-5dc2-bf11-bafb5c30cd74_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222656,
'Height': 903,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2105/18872105/damage_dents-1774706264339.jpg',
'Width': 1204}],
'price': 6870,
'price_includes_vat': False,
'registration_date': '2017-03-16',
'seats_number': None,
'seller_name': None,
'title': 'Mazda CX-5 SE-L NAV D Auto',
'transmission': 'automatic',
'trim': 'SE-L NAV D Auto',
'vin': 'JMZKEF91800548236',
'year': 2017}
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718872105%27 HTTP/1.1" 200 None
2026-03-29 20:08:55 [motorway.uk] INFO: Saving data for 18872105: {'created_time': 1774814935.677027, 'last_price_update_time': 1774814935.677038, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18872105') HTTP/1.1" 204 0
2026-03-29 20:08:55 [motorway.uk] INFO: Found listing with ID: 2939803
2026-03-29 20:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_front_passenger-1774718788234.jpeg> (referer: None)
2026-03-29 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_rear_driver-1774703120195.jpg> (referer: None)
2026-03-29 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_rear_passenger-1774703132702.jpg> (referer: None)
2026-03-29 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_rear_passenger-1774718805881.jpeg> (referer: None)
2026-03-29 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_front_passenger-1774703144746.jpg> (referer: None)
2026-03-29 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4917/20484917/interior_rear_seats-1774718921037.jpeg> (referer: None)
2026-03-29 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4917/20484917/interior_front_seats-1774718845725.jpeg> (referer: None)
2026-03-29 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6127/20296127/interior_front_seats-1774703511670.jpg> (referer: None)
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f473d10>
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20484917%252Fexterior_front_passenger-1774718788234.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_front_passenger-1774718788234.jpeg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f62a20d4-3435-5e84-b8d6-c8824e0c2391
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da87810>
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6127%252F20296127%252Fexterior_rear_driver-1774703120195.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_rear_driver-1774703120195.jpg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f43e450>
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6127%252F20296127%252Fexterior_rear_passenger-1774703132702.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_rear_passenger-1774703132702.jpg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35735b10>
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20484917%252Fexterior_rear_passenger-1774718805881.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_rear_passenger-1774718805881.jpeg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f62a20d4-3435-5e84-b8d6-c8824e0c2391
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6aa710>
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6127%252F20296127%252Fexterior_front_passenger-1774703144746.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_front_passenger-1774703144746.jpg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00.\x97#\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02y\x86\x00.\x8d\x11\x00\x00\x00\x00'
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d135c50>
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4917%252F20484917%252Finterior_rear_seats-1774718921037.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4917/20484917/interior_rear_seats-1774718921037.jpeg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f62a20d4-3435-5e84-b8d6-c8824e0c2391
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003\xc9d\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xb6\x92\x003\xbfR\x00\x00\x00\x00'
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da86ad0>
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4917%252F20484917%252Finterior_front_seats-1774718845725.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4917/20484917/interior_front_seats-1774718845725.jpeg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f62a20d4-3435-5e84-b8d6-c8824e0c2391
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc9b6d0>
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6127%252F20296127%252Finterior_front_seats-1774703511670.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6127/20296127/interior_front_seats-1774703511670.jpg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6
2026-03-29 20:08:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8090cb4d-aacb-5ab2-a3e4-04446e56ded6, skipping ID generation
2026-03-29 20:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6 with scrape type 1
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8090cb4d-aacb-5ab2-a3e4-04446e56ded6 sending to next pipeline
2026-03-29 20:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8090cb4d-aacb-5ab2-a3e4-04446e56ded6, identifier: 20296127
2026-03-29 20:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8090cb4d-aacb-5ab2-a3e4-04446e56ded6 with identifier: 20296127
2026-03-29 20:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8090cb4d-aacb-5ab2-a3e4-04446e56ded6 with identifier: 20296127
2026-03-29 20:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8090cb4d-aacb-5ab2-a3e4-04446e56ded6 with identifier: 20296127 to the API
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6127/20296127/interior_front_seats-1774703511670.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '8090cb4d-aacb-5ab2-a3e4-04446e56ded6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MK72 NWN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20296127',
'listing': 'auction',
'location': 'Warrington Lymm',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 42150,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2139541,
'Height': 2524,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_front_driver-1774703057588.jpg',
'Width': 3365},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1794674,
'Height': 2462,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_rear_driver-1774703120195.jpg',
'Width': 3283},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2240860,
'Height': 2601,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_front_passenger-1774703144746.jpg',
'Width': 3468},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2025534,
'Height': 2578,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6127/20296127/exterior_rear_passenger-1774703132702.jpg',
'Width': 3437},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3691385,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6127/20296127/interior_front_seats-1774703511670.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4068261,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6127/20296127/interior_rear_seats-1774703541564.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1628367,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6127/20296127/interior_dashboard-1774703665058.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2468779,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6127/20296127/instrument_cluster-1774703606410.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3847520,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6127/20296127/interior_boot-1774703630383.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8090cb4d-aacb-5ab2-a3e4-04446e56ded6/8090cb4d-aacb-5ab2-a3e4-04446e56ded6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693468,
'Height': 2886,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6127/20296127/docs_service_history-1774704008347.jpg?ixlib=js-3.8.0&auto=format&s=1e2093c8e1d09f8cee8b9b57b3c742c7',
'Width': 2020}],
'price': 19071,
'price_includes_vat': False,
'registration_date': '2022-09-02',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Tucson Ultimate T-GDi HEV Auto',
'transmission': 'automatic',
'trim': 'Ultimate T-GDi HEV Auto',
'vin': 'TMAJE811MNJ120792',
'year': 2022}
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720296127%27 HTTP/1.1" 200 None
2026-03-29 20:08:57 [motorway.uk] INFO: Saving data for 20296127: {'created_time': 1774814937.303313, 'last_price_update_time': 1774814937.303324, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20296127') HTTP/1.1" 204 0
2026-03-29 20:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6529/20066529/interior_dashboard-1774796221079.jpg> (referer: None)
2026-03-29 20:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_front_driver-1774631809352.jpg> (referer: None)
2026-03-29 20:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_rear_driver-1774718818296.jpeg> (referer: None)
2026-03-29 20:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6529/20066529/interior_rear_seats-1774786420521.jpg> (referer: None)
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc8e690>
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6529%252F20066529%252Finterior_dashboard-1774796221079.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6529/20066529/interior_dashboard-1774796221079.jpg saved to cache
2026-03-29 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6acc6ba6-a218-5979-9d92-77f448605d23
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc8f690>
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7405%252F17857405%252Fexterior_front_driver-1774631809352.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_front_driver-1774631809352.jpg saved to cache
2026-03-29 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 735cafb8-c25f-5064-a680-ded38bf37994
2026-03-29 20:08:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 735cafb8-c25f-5064-a680-ded38bf37994, skipping ID generation
2026-03-29 20:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 735cafb8-c25f-5064-a680-ded38bf37994 with scrape type 1
2026-03-29 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 735cafb8-c25f-5064-a680-ded38bf37994 sending to next pipeline
2026-03-29 20:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 735cafb8-c25f-5064-a680-ded38bf37994, identifier: 17857405
2026-03-29 20:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 735cafb8-c25f-5064-a680-ded38bf37994 with identifier: 17857405
2026-03-29 20:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 735cafb8-c25f-5064-a680-ded38bf37994 with identifier: 17857405
2026-03-29 20:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 735cafb8-c25f-5064-a680-ded38bf37994 with identifier: 17857405 to the API
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_front_driver-1774631809352.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '4.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '735cafb8-c25f-5064-a680-ded38bf37994',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LIL 7642',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17857405',
'listing': 'auction',
'location': 'Shropshire Shifnal',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 85601,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1777848,
'Height': 2631,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_front_driver-1774631809352.jpg',
'Width': 3508},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2540809,
'Height': 2704,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_rear_driver-1774631835226.jpg',
'Width': 3605},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1285734,
'Height': 2637,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_front_passenger-1774631878399.jpg',
'Width': 3516},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2166100,
'Height': 2669,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7405/17857405/exterior_rear_passenger-1774631863118.jpg',
'Width': 3558},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3810740,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7405/17857405/interior_front_seats-1774632382331.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3416401,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7405/17857405/interior_rear_seats-1774632442072.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2973348,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7405/17857405/interior_dashboard-1774632496450.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2083430,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7405/17857405/instrument_cluster-1774632441317.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5228406,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7405/17857405/interior_boot-1774632610989.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735cafb8-c25f-5064-a680-ded38bf37994/735cafb8-c25f-5064-a680-ded38bf37994_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472497,
'Height': 1710,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7405/17857405/docs_service_history-1774698768129.jpg?ixlib=js-3.8.0&auto=format&s=036614c865d0895e619c5b4c407e61af',
'Width': 2280}],
'price': 12276,
'price_includes_vat': False,
'registration_date': '2012-10-19',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Vogue SE SDV8 Auto',
'transmission': 'automatic',
'trim': 'Vogue SE SDV8 Auto',
'vin': 'SALGA2JE5DA100105',
'year': 2012}
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717857405%27 HTTP/1.1" 200 None
2026-03-29 20:08:58 [motorway.uk] INFO: Saving data for 17857405: {'created_time': 1774814938.236048, 'last_price_update_time': 1774814938.23606, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17857405') HTTP/1.1" 204 0
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f35edd0>
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20484917%252Fexterior_rear_driver-1774718818296.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_rear_driver-1774718818296.jpeg saved to cache
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f62a20d4-3435-5e84-b8d6-c8824e0c2391
2026-03-29 20:08:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f62a20d4-3435-5e84-b8d6-c8824e0c2391, skipping ID generation
2026-03-29 20:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f62a20d4-3435-5e84-b8d6-c8824e0c2391 with scrape type 1
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f62a20d4-3435-5e84-b8d6-c8824e0c2391 sending to next pipeline
2026-03-29 20:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f62a20d4-3435-5e84-b8d6-c8824e0c2391, identifier: 20484917
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f43d190>
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6529%252F20066529%252Finterior_rear_seats-1774786420521.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6529/20066529/interior_rear_seats-1774786420521.jpg saved to cache
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6acc6ba6-a218-5979-9d92-77f448605d23
2026-03-29 20:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f62a20d4-3435-5e84-b8d6-c8824e0c2391 with identifier: 20484917
2026-03-29 20:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f62a20d4-3435-5e84-b8d6-c8824e0c2391 with identifier: 20484917
2026-03-29 20:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f62a20d4-3435-5e84-b8d6-c8824e0c2391 with identifier: 20484917 to the API
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_rear_driver-1774718818296.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f62a20d4-3435-5e84-b8d6-c8824e0c2391',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PG73 XZX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20484917',
'listing': 'auction',
'location': 'Lancashire Preston',
'make': 'Audi',
'model': 'Q3',
'odometer': 27700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1507652,
'Height': 2197,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_front_driver-1774718772874.jpeg',
'Width': 2929},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1865743,
'Height': 2516,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_rear_driver-1774718818296.jpeg',
'Width': 3354},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1576551,
'Height': 2618,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_front_passenger-1774718788234.jpeg',
'Width': 3491},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2098453,
'Height': 2675,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4917/20484917/exterior_rear_passenger-1774718805881.jpeg',
'Width': 3567},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3571702,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4917/20484917/interior_front_seats-1774718845725.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3215529,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4917/20484917/interior_rear_seats-1774718921037.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2391928,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4917/20484917/20484917-interior_dashboard-modified-1774782072575.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1554378,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4917/20484917/20484917-instrument_cluster-modified-1774782109108.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4804685,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4917/20484917/interior_boot-1774719001606.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f62a20d4-3435-5e84-b8d6-c8824e0c2391/f62a20d4-3435-5e84-b8d6-c8824e0c2391_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2217433,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4917/20484917/docs_service_history-1774720169553.jpeg?ixlib=js-3.8.0&auto=format&s=415e70e7eb8952c9f77cd29d0d58609c',
'Width': 4032}],
'price': 27495,
'price_includes_vat': False,
'registration_date': '2023-09-28',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q3 S LN BLK ED 35 TFSI MHEV SA',
'transmission': 'automatic',
'trim': 'S LN BLK ED 35 TFSI MHEV SA',
'vin': 'WAUZZZF31R1023844',
'year': 2023}
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484917%27 HTTP/1.1" 200 None
2026-03-29 20:08:58 [motorway.uk] INFO: Saving data for 20484917: {'created_time': 1774814938.898102, 'last_price_update_time': 1774814938.898113, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20484917') HTTP/1.1" 204 0
2026-03-29 20:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1561/20301561/docs_service_history-1774277928264.jpg?ixlib=js-3.8.0&auto=format&s=03e2b6e19b793b3cd60c06ecc3d3c29d> (referer: None)
2026-03-29 20:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2318/20382318/wheels_front_driver-1774267213140.jpg> (referer: None)
2026-03-29 20:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_rear_passenger-1772459604740.jpg> (referer: None)
2026-03-29 20:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_front_passenger-1772459580938.jpg> (referer: None)
2026-03-29 20:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3207/20463207/damage_scratches-1774701908759.jpg> (referer: None)
2026-03-29 20:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3207/20463207/damage_scratches-1774701986563.jpg> (referer: None)
2026-03-29 20:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1561/20301561/interior_boot-1774277648925.jpg> (referer: None)
2026-03-29 20:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2318/20382318/interior_boot-1774267971504.jpg> (referer: None)
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db682d0>
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58422d5-8d92-5a29-8a01-0b5869ec7133/e58422d5-8d92-5a29-8a01-0b5869ec7133_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1561%252F20301561%252Fdocs_service_history-1774277928264.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D03e2b6e19b793b3cd60c06ecc3d3c29d') HTTP/1.1" 204 0
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1561/20301561/docs_service_history-1774277928264.jpg?ixlib=js-3.8.0&auto=format&s=03e2b6e19b793b3cd60c06ecc3d3c29d saved to cache
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e58422d5-8d92-5a29-8a01-0b5869ec7133
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db6bf10>
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f2c947-3c53-5741-bd45-01de559a45ec/b5f2c947-3c53-5741-bd45-01de559a45ec_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2318%252F20382318%252Fwheels_front_driver-1774267213140.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2318/20382318/wheels_front_driver-1774267213140.jpg saved to cache
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5f2c947-3c53-5741-bd45-01de559a45ec
2026-03-29 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20355749.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20484632.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20264228.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20455953.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d300f50>
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6529%252F20066529%252Fexterior_rear_passenger-1772459604740.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_rear_passenger-1772459604740.jpg saved to cache
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6acc6ba6-a218-5979-9d92-77f448605d23
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd03650>
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6529%252F20066529%252Fexterior_front_passenger-1772459580938.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_front_passenger-1772459580938.jpg saved to cache
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6acc6ba6-a218-5979-9d92-77f448605d23
2026-03-29 20:08:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6acc6ba6-a218-5979-9d92-77f448605d23, skipping ID generation
2026-03-29 20:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6acc6ba6-a218-5979-9d92-77f448605d23 with scrape type 1
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6acc6ba6-a218-5979-9d92-77f448605d23 sending to next pipeline
2026-03-29 20:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6acc6ba6-a218-5979-9d92-77f448605d23, identifier: 20066529
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d75df10>
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de82f31-65ac-5200-8520-505df4741d00/0de82f31-65ac-5200-8520-505df4741d00_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3207%252F20463207%252Fdamage_scratches-1774701908759.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3207/20463207/damage_scratches-1774701908759.jpg saved to cache
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0de82f31-65ac-5200-8520-505df4741d00
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4b1cd0>
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de82f31-65ac-5200-8520-505df4741d00/0de82f31-65ac-5200-8520-505df4741d00_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3207%252F20463207%252Fdamage_scratches-1774701986563.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3207/20463207/damage_scratches-1774701986563.jpg saved to cache
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0de82f31-65ac-5200-8520-505df4741d00
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddab690>
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58422d5-8d92-5a29-8a01-0b5869ec7133/e58422d5-8d92-5a29-8a01-0b5869ec7133_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1561%252F20301561%252Finterior_boot-1774277648925.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1561/20301561/interior_boot-1774277648925.jpg saved to cache
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e58422d5-8d92-5a29-8a01-0b5869ec7133
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd02c90>
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f2c947-3c53-5741-bd45-01de559a45ec/b5f2c947-3c53-5741-bd45-01de559a45ec_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2318%252F20382318%252Finterior_boot-1774267971504.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2318/20382318/interior_boot-1774267971504.jpg saved to cache
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5f2c947-3c53-5741-bd45-01de559a45ec
2026-03-29 20:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6acc6ba6-a218-5979-9d92-77f448605d23 with identifier: 20066529
2026-03-29 20:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6acc6ba6-a218-5979-9d92-77f448605d23 with identifier: 20066529
2026-03-29 20:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6acc6ba6-a218-5979-9d92-77f448605d23 with identifier: 20066529 to the API
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_front_passenger-1772459580938.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '6acc6ba6-a218-5979-9d92-77f448605d23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MV19 OJJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20066529',
'listing': 'auction',
'location': 'South Yorkshire Barnsley',
'make': 'Jaguar',
'model': 'F-PACE',
'odometer': 55002,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 924229,
'Height': 2204,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_front_driver-1772459622275.jpg',
'Width': 2939},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 984070,
'Height': 2165,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_rear_driver-1772459563449.jpg',
'Width': 2886},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 988233,
'Height': 2180,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_front_passenger-1772459580938.jpg',
'Width': 2906},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1001729,
'Height': 2092,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6529/20066529/exterior_rear_passenger-1772459604740.jpg',
'Width': 2789},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2960746,
'Height': 3635,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6529/20066529/interior_front_seats-1774786415648.jpg',
'Width': 4846},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2695474,
'Height': 3108,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6529/20066529/interior_rear_seats-1774786420521.jpg',
'Width': 4144},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1615042,
'Height': 2589,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6529/20066529/interior_dashboard-1774796221079.jpg',
'Width': 3451},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457183,
'Height': 1589,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6529/20066529/instrument_cluster-1774796238906.jpg',
'Width': 2119},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1079300,
'Height': 2592,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6529/20066529/interior_boot-1774786438417.jpg',
'Width': 3456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acc6ba6-a218-5979-9d92-77f448605d23/6acc6ba6-a218-5979-9d92-77f448605d23_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1001873,
'Height': 2285,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6529/20066529/docs_service_history-1774796204162.jpg?ixlib=js-3.8.0&auto=format&s=19b4c20c1b2cc07ea0bc85fba4cb0682',
'Width': 3046}],
'price': 13735,
'price_includes_vat': False,
'registration_date': '2019-03-09',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar F-PACE R-Sport AWD D Auto',
'transmission': 'automatic',
'trim': 'R-Sport AWD D Auto',
'vin': 'SADCA2AN8KA392050',
'year': 2019}
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720066529%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [motorway.uk] INFO: Saving data for 20066529: {'created_time': 1774814940.32906, 'last_price_update_time': 1774814940.329071, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20066529') HTTP/1.1" 204 0
2026-03-29 20:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6855/20416855/wheels_front_driver-1774689023363.jpg> (referer: None)
2026-03-29 20:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82700581-49db-5d9b-b068-4b5d2f3fabf7 with identifier: 20355749
2026-03-29 20:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82700581-49db-5d9b-b068-4b5d2f3fabf7 with scrape type 1
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82700581-49db-5d9b-b068-4b5d2f3fabf7
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5749%252F20355749%252Fexterior_front_driver-1774013927467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5749/20355749/exterior_front_driver-1774013927467.jpg not downloaded yet
2026-03-29 20:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e885f1ab-cbd6-5810-b545-f63db45b4c49 with identifier: 20484632
2026-03-29 20:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e885f1ab-cbd6-5810-b545-f63db45b4c49 with scrape type 1
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e885f1ab-cbd6-5810-b545-f63db45b4c49
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4632%252F20484632%252Fexterior_front_driver-1774691973644.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4632/20484632/exterior_front_driver-1774691973644.jpg not downloaded yet
2026-03-29 20:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f044364-7a5c-59e3-9665-8b6f9810bbce with identifier: 20264228
2026-03-29 20:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f044364-7a5c-59e3-9665-8b6f9810bbce with scrape type 1
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f044364-7a5c-59e3-9665-8b6f9810bbce
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4228%252F20264228%252Fexterior_front_driver-1774782202083.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_front_driver-1774782202083.jpg not downloaded yet
2026-03-29 20:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5 with identifier: 20455953
2026-03-29 20:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5 with scrape type 1
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5953%252F20455953%252F20455953-exterior_front_driver-modified-1774706685557.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5953/20455953/20455953-exterior_front_driver-modified-1774706685557.jpeg not downloaded yet
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5749%252F20355749%252Fexterior_rear_driver-1774013943111.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5749/20355749/exterior_rear_driver-1774013943111.jpg not downloaded yet
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4632%252F20484632%252Fexterior_rear_driver-1774691992676.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4632/20484632/exterior_rear_driver-1774691992676.jpg not downloaded yet
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4228%252F20264228%252Fexterior_rear_driver-1774782212926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_rear_driver-1774782212926.jpg not downloaded yet
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F20455953%252Fexterior_rear_driver-1774703420929.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/20455953/exterior_rear_driver-1774703420929.jpeg not downloaded yet
2026-03-29 20:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17656743.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8414/20478414/docs_service_history-1774710605729.jpg?ixlib=js-3.8.0&auto=format&s=9863eca1163131ffb03491b59370d466> (referer: None)
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5749%252F20355749%252Fexterior_front_passenger-1774013973280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5749/20355749/exterior_front_passenger-1774013973280.jpg not downloaded yet
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4632%252F20484632%252Fexterior_front_passenger-1774697030293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4632/20484632/exterior_front_passenger-1774697030293.jpg not downloaded yet
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4228%252F20264228%252Fexterior_front_passenger-1774782245868.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_front_passenger-1774782245868.jpg not downloaded yet
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F20455953%252Fexterior_front_passenger-1774703184466.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/20455953/exterior_front_passenger-1774703184466.jpeg not downloaded yet
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db6bc90>
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e48682f2-30aa-54d8-9b4c-dca8852ec209/e48682f2-30aa-54d8-9b4c-dca8852ec209_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6855%252F20416855%252Fwheels_front_driver-1774689023363.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6855/20416855/wheels_front_driver-1774689023363.jpg saved to cache
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e48682f2-30aa-54d8-9b4c-dca8852ec209
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5749%252F20355749%252Fexterior_rear_passenger-1774013954123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5749/20355749/exterior_rear_passenger-1774013954123.jpg not downloaded yet
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4632%252F20484632%252Fexterior_rear_passenger-1774692004890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4632/20484632/exterior_rear_passenger-1774692004890.jpg not downloaded yet
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4228%252F20264228%252Fexterior_rear_passenger-1774782235064.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_rear_passenger-1774782235064.jpg not downloaded yet
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5953%252F20455953%252F20455953-exterior_rear_passenger-modified-1774706712067.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5953/20455953/20455953-exterior_rear_passenger-modified-1774706712067.jpeg not downloaded yet
2026-03-29 20:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34cf45f5-de5b-588f-a34f-ca6e3020d257 with identifier: 17656743
2026-03-29 20:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34cf45f5-de5b-588f-a34f-ca6e3020d257 with scrape type 1
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34cf45f5-de5b-588f-a34f-ca6e3020d257
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6743%252F17656743%252Fexterior_front_driver-1774525013727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_front_driver-1774525013727.jpg not downloaded yet
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d20eb50>
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a/c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8414%252F20478414%252Fdocs_service_history-1774710605729.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9863eca1163131ffb03491b59370d466') HTTP/1.1" 204 0
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8414/20478414/docs_service_history-1774710605729.jpg?ixlib=js-3.8.0&auto=format&s=9863eca1163131ffb03491b59370d466 saved to cache
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5749%252F20355749%252Finterior_front_seats-1774609743961.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5749/20355749/interior_front_seats-1774609743961.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4632%252F20484632%252Finterior_front_seats-1774692411375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4632/20484632/interior_front_seats-1774692411375.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4228%252F20264228%252Finterior_front_seats-1774782572474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4228/20264228/interior_front_seats-1774782572474.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5953%252F20455953%252Finterior_front_seats-1774703958284.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5953/20455953/interior_front_seats-1774703958284.jpeg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6743%252F17656743%252Fexterior_rear_driver-1774525031672.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_rear_driver-1774525031672.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5749%252F20355749%252Finterior_rear_seats-1774609750933.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5749/20355749/interior_rear_seats-1774609750933.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4632%252F20484632%252Finterior_rear_seats-1774692659275.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4632/20484632/interior_rear_seats-1774692659275.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4228%252F20264228%252Finterior_rear_seats-1774782587387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4228/20264228/interior_rear_seats-1774782587387.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5953%252F20455953%252F20455953-interior_rear_seats-default-1774706750569.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5953/20455953/20455953-interior_rear_seats-default-1774706750569.jpg not downloaded yet
2026-03-29 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1561/20301561/instrument_cluster-1774277720076.jpg> (referer: None)
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6743%252F17656743%252Fexterior_front_passenger-1774525217421.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_front_passenger-1774525217421.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5749%252F20355749%252Finterior_dashboard-1774609759194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5749/20355749/interior_dashboard-1774609759194.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4632%252F20484632%252Finterior_dashboard-1774697047373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4632/20484632/interior_dashboard-1774697047373.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4228%252F20264228%252Finterior_dashboard-1774782620252.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4228/20264228/interior_dashboard-1774782620252.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F20455953%252Finterior_dashboard-1774703997465.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/20455953/interior_dashboard-1774703997465.jpeg not downloaded yet
2026-03-29 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6855/20416855/docs_service_history-1774699756316.jpg?ixlib=js-3.8.0&auto=format&s=9a082001ac5c162ae5d01d8de8f3a28c> (referer: None)
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6743%252F17656743%252Fexterior_rear_passenger-1774525048968.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_rear_passenger-1774525048968.jpg not downloaded yet
2026-03-29 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2318/20382318/instrument_cluster-1774268003352.jpg> (referer: None)
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5749%252F20355749%252Finstrument_cluster-1774609278381.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5749/20355749/instrument_cluster-1774609278381.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4632%252F20484632%252Finstrument_cluster-1774692730575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4632/20484632/instrument_cluster-1774692730575.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4228%252F20264228%252Finstrument_cluster-1774782670227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4228/20264228/instrument_cluster-1774782670227.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F20455953%252F20455953-instrument_cluster-default-1774695634100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/20455953/20455953-instrument_cluster-default-1774695634100.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6743%252F17656743%252Finterior_front_seats-1774526316635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6743/17656743/interior_front_seats-1774526316635.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5749%252F20355749%252Finterior_boot-1774609765228.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5749/20355749/interior_boot-1774609765228.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4632%252F20484632%252Finterior_boot-1774692552760.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4632/20484632/interior_boot-1774692552760.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4228%252F20264228%252Finterior_boot-1774782617815.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4228/20264228/interior_boot-1774782617815.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F20455953%252Fwheels_front_driver-1774703456810.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/20455953/wheels_front_driver-1774703456810.jpeg not downloaded yet
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d235cd0>
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58422d5-8d92-5a29-8a01-0b5869ec7133/e58422d5-8d92-5a29-8a01-0b5869ec7133_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1561%252F20301561%252Finstrument_cluster-1774277720076.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1561/20301561/instrument_cluster-1774277720076.jpg saved to cache
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e58422d5-8d92-5a29-8a01-0b5869ec7133
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6743%252F17656743%252Finterior_rear_seats-1774526329536.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6743/17656743/interior_rear_seats-1774526329536.jpg not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5749%252F20355749%252Fdocs_service_history-1774609335806.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D14bebc49303ea7f5226176697d6e514a%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5749/20355749/docs_service_history-1774609335806.jpg?ixlib=js-3.8.0&auto=format&s=14bebc49303ea7f5226176697d6e514a not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4632%252F20484632%252Fdocs_service_history-1774693368898.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8f77e2f8c4938122b7341b3a8a0013dd%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4632/20484632/docs_service_history-1774693368898.jpg?ixlib=js-3.8.0&auto=format&s=8f77e2f8c4938122b7341b3a8a0013dd not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4228%252F20264228%252Fdocs_service_history-1774782899351.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc905602c3c1c4d80e74bc413b9c3526d%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4228/20264228/docs_service_history-1774782899351.jpg?ixlib=js-3.8.0&auto=format&s=c905602c3c1c4d80e74bc413b9c3526d not downloaded yet
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F20455953%252Fwheels_rear_driver-1774703651326.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/20455953/wheels_rear_driver-1774703651326.jpeg not downloaded yet
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e07ff50>
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e48682f2-30aa-54d8-9b4c-dca8852ec209/e48682f2-30aa-54d8-9b4c-dca8852ec209_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6855%252F20416855%252Fdocs_service_history-1774699756316.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9a082001ac5c162ae5d01d8de8f3a28c') HTTP/1.1" 204 0
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6855/20416855/docs_service_history-1774699756316.jpg?ixlib=js-3.8.0&auto=format&s=9a082001ac5c162ae5d01d8de8f3a28c saved to cache
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e48682f2-30aa-54d8-9b4c-dca8852ec209
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2eb050>
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f2c947-3c53-5741-bd45-01de559a45ec/b5f2c947-3c53-5741-bd45-01de559a45ec_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2318%252F20382318%252Finstrument_cluster-1774268003352.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2318/20382318/instrument_cluster-1774268003352.jpg saved to cache
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5f2c947-3c53-5741-bd45-01de559a45ec
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6743%252F17656743%252Finterior_dashboard-1774533615352.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6743/17656743/interior_dashboard-1774533615352.jpg not downloaded yet
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6743%252F17656743%252Finstrument_cluster-1774526408888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6743/17656743/instrument_cluster-1774526408888.jpg not downloaded yet
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6743%252F17656743%252Finterior_boot-1774526367897.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6743/17656743/interior_boot-1774526367897.jpg not downloaded yet
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6743%252F17656743%252Fdocs_service_history-1774531998831.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0f2e84ed91492c485024e21d8d6b19f9%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6743/17656743/docs_service_history-1774531998831.jpg?ixlib=js-3.8.0&auto=format&s=0f2e84ed91492c485024e21d8d6b19f9 not downloaded yet
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1561/20301561/interior_dashboard-1774277652915.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3207/20463207/interior_dashboard-1774702580467.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6855/20416855/interior_boot-1774689126943.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8414/20478414/instrument_cluster-1774705012491.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8414/20478414/interior_dashboard-1774710569217.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1561/20301561/interior_rear_seats-1774277671260.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_rear_driver-1774782212926.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3207/20463207/interior_boot-1774702634222.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_rear_driver-1774525031672.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3207/20463207/instrument_cluster-1774702603209.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5953/20455953/exterior_rear_driver-1774703420929.jpeg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8414/20478414/interior_boot-1774704949074.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2318/20382318/interior_rear_seats-1774268028411.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6743/17656743/docs_service_history-1774531998831.jpg?ixlib=js-3.8.0&auto=format&s=0f2e84ed91492c485024e21d8d6b19f9> (referer: None)
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c3e50>
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58422d5-8d92-5a29-8a01-0b5869ec7133/e58422d5-8d92-5a29-8a01-0b5869ec7133_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1561%252F20301561%252Finterior_dashboard-1774277652915.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1561/20301561/interior_dashboard-1774277652915.jpg saved to cache
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e58422d5-8d92-5a29-8a01-0b5869ec7133
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d253ed0>
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de82f31-65ac-5200-8520-505df4741d00/0de82f31-65ac-5200-8520-505df4741d00_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3207%252F20463207%252Finterior_dashboard-1774702580467.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3207/20463207/interior_dashboard-1774702580467.jpg saved to cache
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0de82f31-65ac-5200-8520-505df4741d00
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8db710>
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e48682f2-30aa-54d8-9b4c-dca8852ec209/e48682f2-30aa-54d8-9b4c-dca8852ec209_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6855%252F20416855%252Finterior_boot-1774689126943.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6855/20416855/interior_boot-1774689126943.jpg saved to cache
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e48682f2-30aa-54d8-9b4c-dca8852ec209
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1045d0>
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a/c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8414%252F20478414%252Finstrument_cluster-1774705012491.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8414/20478414/instrument_cluster-1774705012491.jpg saved to cache
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d232410>
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a/c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8414%252F20478414%252Finterior_dashboard-1774710569217.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8414/20478414/interior_dashboard-1774710569217.jpg saved to cache
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e107e50>
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58422d5-8d92-5a29-8a01-0b5869ec7133/e58422d5-8d92-5a29-8a01-0b5869ec7133_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1561%252F20301561%252Finterior_rear_seats-1774277671260.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1561/20301561/interior_rear_seats-1774277671260.jpg saved to cache
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e58422d5-8d92-5a29-8a01-0b5869ec7133
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d972d10>
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4228%252F20264228%252Fexterior_rear_driver-1774782212926.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_rear_driver-1774782212926.jpg saved to cache
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f044364-7a5c-59e3-9665-8b6f9810bbce
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e105dd0>
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de82f31-65ac-5200-8520-505df4741d00/0de82f31-65ac-5200-8520-505df4741d00_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3207%252F20463207%252Finterior_boot-1774702634222.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3207/20463207/interior_boot-1774702634222.jpg saved to cache
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0de82f31-65ac-5200-8520-505df4741d00
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e105410>
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6743%252F17656743%252Fexterior_rear_driver-1774525031672.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_rear_driver-1774525031672.jpg saved to cache
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34cf45f5-de5b-588f-a34f-ca6e3020d257
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8db090>
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0de82f31-65ac-5200-8520-505df4741d00/0de82f31-65ac-5200-8520-505df4741d00_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3207%252F20463207%252Finstrument_cluster-1774702603209.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3207/20463207/instrument_cluster-1774702603209.jpg saved to cache
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0de82f31-65ac-5200-8520-505df4741d00
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8da810>
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F20455953%252Fexterior_rear_driver-1774703420929.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/20455953/exterior_rear_driver-1774703420929.jpeg saved to cache
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db7c550>
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a/c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8414%252F20478414%252Finterior_boot-1774704949074.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8414/20478414/interior_boot-1774704949074.jpg saved to cache
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8f42fdd-b720-52a5-9ae8-cf2a0bbfe59a
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e105890>
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f2c947-3c53-5741-bd45-01de559a45ec/b5f2c947-3c53-5741-bd45-01de559a45ec_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2318%252F20382318%252Finterior_rear_seats-1774268028411.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2318/20382318/interior_rear_seats-1774268028411.jpg saved to cache
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5f2c947-3c53-5741-bd45-01de559a45ec
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8da490>
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6743%252F17656743%252Fdocs_service_history-1774531998831.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0f2e84ed91492c485024e21d8d6b19f9') HTTP/1.1" 204 0
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6743/17656743/docs_service_history-1774531998831.jpg?ixlib=js-3.8.0&auto=format&s=0f2e84ed91492c485024e21d8d6b19f9 saved to cache
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34cf45f5-de5b-588f-a34f-ca6e3020d257
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5953/20455953/wheels_front_driver-1774703456810.jpeg> (referer: None)
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6743/17656743/interior_rear_seats-1774526329536.jpg> (referer: None)
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6743/17656743/interior_boot-1774526367897.jpg> (referer: None)
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5749/20355749/docs_service_history-1774609335806.jpg?ixlib=js-3.8.0&auto=format&s=14bebc49303ea7f5226176697d6e514a> (referer: None)
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5953/20455953/20455953-instrument_cluster-default-1774695634100.jpg> (referer: None)
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4b6b50>
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F20455953%252Fwheels_front_driver-1774703456810.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/20455953/wheels_front_driver-1774703456810.jpeg saved to cache
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4228/20264228/docs_service_history-1774782899351.jpg?ixlib=js-3.8.0&auto=format&s=c905602c3c1c4d80e74bc413b9c3526d> (referer: None)
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4b7550>
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6743%252F17656743%252Finterior_rear_seats-1774526329536.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6743/17656743/interior_rear_seats-1774526329536.jpg saved to cache
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34cf45f5-de5b-588f-a34f-ca6e3020d257
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d448150>
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6743%252F17656743%252Finterior_boot-1774526367897.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6743/17656743/interior_boot-1774526367897.jpg saved to cache
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34cf45f5-de5b-588f-a34f-ca6e3020d257
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d58c610>
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82700581-49db-5d9b-b068-4b5d2f3fabf7/82700581-49db-5d9b-b068-4b5d2f3fabf7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5749%252F20355749%252Fdocs_service_history-1774609335806.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D14bebc49303ea7f5226176697d6e514a') HTTP/1.1" 204 0
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5749/20355749/docs_service_history-1774609335806.jpg?ixlib=js-3.8.0&auto=format&s=14bebc49303ea7f5226176697d6e514a saved to cache
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82700581-49db-5d9b-b068-4b5d2f3fabf7
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x01\xe4P\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xa9/\x00\x01\xc4u\x00\x00\x00\x00'
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d448fd0>
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F20455953%252F20455953-instrument_cluster-default-1774695634100.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/20455953/20455953-instrument_cluster-default-1774695634100.jpg saved to cache
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d26bc90>
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4228%252F20264228%252Fdocs_service_history-1774782899351.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc905602c3c1c4d80e74bc413b9c3526d') HTTP/1.1" 204 0
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4228/20264228/docs_service_history-1774782899351.jpg?ixlib=js-3.8.0&auto=format&s=c905602c3c1c4d80e74bc413b9c3526d saved to cache
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f044364-7a5c-59e3-9665-8b6f9810bbce
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4632/20484632/docs_service_history-1774693368898.jpg?ixlib=js-3.8.0&auto=format&s=8f77e2f8c4938122b7341b3a8a0013dd> (referer: None)
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5953/20455953/wheels_rear_driver-1774703651326.jpeg> (referer: None)
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4632/20484632/instrument_cluster-1774692730575.jpg> (referer: None)
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5749/20355749/interior_boot-1774609765228.jpg> (referer: None)
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4632/20484632/interior_boot-1774692552760.jpg> (referer: None)
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4228/20264228/instrument_cluster-1774782670227.jpg> (referer: None)
2026-03-29 20:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6743/17656743/interior_dashboard-1774533615352.jpg> (referer: None)
2026-03-29 20:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6743/17656743/instrument_cluster-1774526408888.jpg> (referer: None)
2026-03-29 20:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4228/20264228/interior_boot-1774782617815.jpg> (referer: None)
2026-03-29 20:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6743/17656743/interior_front_seats-1774526316635.jpg> (referer: None)
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5f36d0>
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e885f1ab-cbd6-5810-b545-f63db45b4c49/e885f1ab-cbd6-5810-b545-f63db45b4c49_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4632%252F20484632%252Fdocs_service_history-1774693368898.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8f77e2f8c4938122b7341b3a8a0013dd') HTTP/1.1" 204 0
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4632/20484632/docs_service_history-1774693368898.jpg?ixlib=js-3.8.0&auto=format&s=8f77e2f8c4938122b7341b3a8a0013dd saved to cache
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e885f1ab-cbd6-5810-b545-f63db45b4c49
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dabdb90>
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F20455953%252Fwheels_rear_driver-1774703651326.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/20455953/wheels_rear_driver-1774703651326.jpeg saved to cache
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca6e7d0>
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e885f1ab-cbd6-5810-b545-f63db45b4c49/e885f1ab-cbd6-5810-b545-f63db45b4c49_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4632%252F20484632%252Finstrument_cluster-1774692730575.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4632/20484632/instrument_cluster-1774692730575.jpg saved to cache
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e885f1ab-cbd6-5810-b545-f63db45b4c49
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2e0550>
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82700581-49db-5d9b-b068-4b5d2f3fabf7/82700581-49db-5d9b-b068-4b5d2f3fabf7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5749%252F20355749%252Finterior_boot-1774609765228.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5749/20355749/interior_boot-1774609765228.jpg saved to cache
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82700581-49db-5d9b-b068-4b5d2f3fabf7
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6a0e90>
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e885f1ab-cbd6-5810-b545-f63db45b4c49/e885f1ab-cbd6-5810-b545-f63db45b4c49_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4632%252F20484632%252Finterior_boot-1774692552760.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4632/20484632/interior_boot-1774692552760.jpg saved to cache
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e885f1ab-cbd6-5810-b545-f63db45b4c49
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5f2a10>
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4228%252F20264228%252Finstrument_cluster-1774782670227.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4228/20264228/instrument_cluster-1774782670227.jpg saved to cache
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f044364-7a5c-59e3-9665-8b6f9810bbce
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c755f50>
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6743%252F17656743%252Finterior_dashboard-1774533615352.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6743/17656743/interior_dashboard-1774533615352.jpg saved to cache
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34cf45f5-de5b-588f-a34f-ca6e3020d257
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d26a890>
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6743%252F17656743%252Finstrument_cluster-1774526408888.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6743/17656743/instrument_cluster-1774526408888.jpg saved to cache
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34cf45f5-de5b-588f-a34f-ca6e3020d257
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f355f9c10>
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4228%252F20264228%252Finterior_boot-1774782617815.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4228/20264228/interior_boot-1774782617815.jpg saved to cache
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f044364-7a5c-59e3-9665-8b6f9810bbce
2026-03-29 20:09:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1dbad0>
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6743%252F17656743%252Finterior_front_seats-1774526316635.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6743/17656743/interior_front_seats-1774526316635.jpg saved to cache
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34cf45f5-de5b-588f-a34f-ca6e3020d257
2026-03-29 20:09:06 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12683837) larger than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/5953/20455953/interior_dashboard-1774703997465.jpeg>.
2026-03-29 20:09:06 [scrapy.extensions.logstats] INFO: Crawled 140 pages (at 24 pages/min), scraped 92 items (at 25 items/min)
2026-03-29 20:09:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 302MiB
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=612&page=17&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:06 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (13286661) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5953/20455953/interior_front_seats-1774703958284.jpeg>.
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4632/20484632/interior_dashboard-1774697047373.jpg> (referer: None)
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_rear_passenger-1774525048968.jpg> (referer: None)
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5749/20355749/interior_dashboard-1774609759194.jpg> (referer: None)
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5749/20355749/instrument_cluster-1774609278381.jpg> (referer: None)
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_front_passenger-1774525217421.jpg> (referer: None)
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4228/20264228/interior_dashboard-1774782620252.jpg> (referer: None)
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5953/20455953/20455953-interior_rear_seats-default-1774706750569.jpg> (referer: None)
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 20176261
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720176261%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [motorway.uk] INFO: Scrape type for 20176261: 1
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 17331668
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717331668%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [motorway.uk] INFO: Scrape type for 17331668: 1
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 20454066
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 18631801
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718631801%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [motorway.uk] INFO: Scrape type for 18631801: 1
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 3620067
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 20010331
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720010331%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [motorway.uk] INFO: Scrape type for 20010331: 1
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2e0f90>
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e885f1ab-cbd6-5810-b545-f63db45b4c49/e885f1ab-cbd6-5810-b545-f63db45b4c49_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4632%252F20484632%252Finterior_dashboard-1774697047373.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4632/20484632/interior_dashboard-1774697047373.jpg saved to cache
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e885f1ab-cbd6-5810-b545-f63db45b4c49
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f292390>
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6743%252F17656743%252Fexterior_rear_passenger-1774525048968.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_rear_passenger-1774525048968.jpg saved to cache
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34cf45f5-de5b-588f-a34f-ca6e3020d257
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2f7790>
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82700581-49db-5d9b-b068-4b5d2f3fabf7/82700581-49db-5d9b-b068-4b5d2f3fabf7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5749%252F20355749%252Finterior_dashboard-1774609759194.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5749/20355749/interior_dashboard-1774609759194.jpg saved to cache
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82700581-49db-5d9b-b068-4b5d2f3fabf7
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2f5350>
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82700581-49db-5d9b-b068-4b5d2f3fabf7/82700581-49db-5d9b-b068-4b5d2f3fabf7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5749%252F20355749%252Finstrument_cluster-1774609278381.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5749/20355749/instrument_cluster-1774609278381.jpg saved to cache
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82700581-49db-5d9b-b068-4b5d2f3fabf7
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d178b50>
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6743%252F17656743%252Fexterior_front_passenger-1774525217421.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_front_passenger-1774525217421.jpg saved to cache
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34cf45f5-de5b-588f-a34f-ca6e3020d257
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 6110693
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276110693%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [motorway.uk] INFO: Scrape type for 6110693: 1
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d11b610>
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4228%252F20264228%252Finterior_dashboard-1774782620252.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4228/20264228/interior_dashboard-1774782620252.jpg saved to cache
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f044364-7a5c-59e3-9665-8b6f9810bbce
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d19e790>
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5953%252F20455953%252F20455953-interior_rear_seats-default-1774706750569.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5953/20455953/20455953-interior_rear_seats-default-1774706750569.jpg saved to cache
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 20212993
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 18599819
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718599819%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [motorway.uk] INFO: Scrape type for 18599819: 1
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 20478024
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720478024%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [motorway.uk] INFO: Scrape type for 20478024: 1
2026-03-29 20:09:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 20476322
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 19989124
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 20485342
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 19346587
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 18465053
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 17446512
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 19535676
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 20106291
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 18846555
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 19650847
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 16887046
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 18297776
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718297776%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [motorway.uk] INFO: Scrape type for 18297776: 1
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 19443439
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 20249715
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 18285367
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 18824482
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 19548326
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719548326%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [motorway.uk] INFO: Scrape type for 19548326: 1
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 19976408
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 17967491
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 8192755
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 20357594
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 20469292
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 20467785
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467785%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [motorway.uk] INFO: Scrape type for 20467785: 1
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 20488132
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 20001461
2026-03-29 20:09:07 [motorway.uk] INFO: Found listing with ID: 19942570
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_front_driver-1774525013727.jpg> (referer: None)
2026-03-29 20:09:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5749/20355749/interior_rear_seats-1774609750933.jpg> (referer: None)
2026-03-29 20:09:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:07 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/5953/20455953/interior_dashboard-1774703997465.jpeg>.
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_rear_passenger-1774782235064.jpg> (referer: None)
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5749/20355749/interior_front_seats-1774609743961.jpg> (referer: None)
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4632/20484632/interior_front_seats-1774692411375.jpg> (referer: None)
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4632/20484632/interior_rear_seats-1774692659275.jpg> (referer: None)
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4228/20264228/interior_front_seats-1774782572474.jpg> (referer: None)
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4228/20264228/interior_rear_seats-1774782587387.jpg> (referer: None)
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5953/20455953/20455953-exterior_rear_passenger-modified-1774706712067.jpeg> (referer: None)
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5953/20455953/interior_dashboard-1774703997465.jpeg> (referer: None)
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca71f90>
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6743%252F17656743%252Fexterior_front_driver-1774525013727.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_front_driver-1774525013727.jpg saved to cache
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34cf45f5-de5b-588f-a34f-ca6e3020d257
2026-03-29 20:09:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34cf45f5-de5b-588f-a34f-ca6e3020d257, skipping ID generation
2026-03-29 20:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34cf45f5-de5b-588f-a34f-ca6e3020d257 with scrape type 1
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34cf45f5-de5b-588f-a34f-ca6e3020d257 sending to next pipeline
2026-03-29 20:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 34cf45f5-de5b-588f-a34f-ca6e3020d257, identifier: 17656743
2026-03-29 20:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 34cf45f5-de5b-588f-a34f-ca6e3020d257 with identifier: 17656743
2026-03-29 20:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 34cf45f5-de5b-588f-a34f-ca6e3020d257 with identifier: 17656743
2026-03-29 20:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 34cf45f5-de5b-588f-a34f-ca6e3020d257 with identifier: 17656743 to the API
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_front_driver-1774525013727.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '34cf45f5-de5b-588f-a34f-ca6e3020d257',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF14 RXA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17656743',
'listing': 'auction',
'location': 'Buckinghamshire Maidenhead',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 119000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2083566,
'Height': 2576,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_front_driver-1774525013727.jpg',
'Width': 3434},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2169280,
'Height': 2468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_rear_driver-1774525031672.jpg',
'Width': 3290},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2656445,
'Height': 2956,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_front_passenger-1774525217421.jpg',
'Width': 3941},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2122377,
'Height': 2495,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6743/17656743/exterior_rear_passenger-1774525048968.jpg',
'Width': 3327},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4554208,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6743/17656743/interior_front_seats-1774526316635.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4170609,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6743/17656743/interior_rear_seats-1774526329536.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3100934,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6743/17656743/interior_dashboard-1774533615352.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3278354,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6743/17656743/instrument_cluster-1774526408888.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4899054,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6743/17656743/interior_boot-1774526367897.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34cf45f5-de5b-588f-a34f-ca6e3020d257/34cf45f5-de5b-588f-a34f-ca6e3020d257_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652301,
'Height': 3098,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6743/17656743/docs_service_history-1774531998831.jpg?ixlib=js-3.8.0&auto=format&s=0f2e84ed91492c485024e21d8d6b19f9',
'Width': 2102}],
'price': 1435,
'price_includes_vat': False,
'registration_date': '2014-04-01',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo Match Edition',
'transmission': 'manual',
'trim': 'Match Edition',
'vin': 'WVWZZZ6RZEU040431',
'year': 2014}
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717656743%27 HTTP/1.1" 200 None
2026-03-29 20:09:08 [motorway.uk] INFO: Saving data for 17656743: {'created_time': 1774814948.907606, 'last_price_update_time': 1774814948.907618, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17656743') HTTP/1.1" 204 0
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d255410>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82700581-49db-5d9b-b068-4b5d2f3fabf7/82700581-49db-5d9b-b068-4b5d2f3fabf7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5749%252F20355749%252Finterior_rear_seats-1774609750933.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5749/20355749/interior_rear_seats-1774609750933.jpg saved to cache
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82700581-49db-5d9b-b068-4b5d2f3fabf7
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca719d0>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4228%252F20264228%252Fexterior_rear_passenger-1774782235064.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_rear_passenger-1774782235064.jpg saved to cache
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f044364-7a5c-59e3-9665-8b6f9810bbce
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d183dd0>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82700581-49db-5d9b-b068-4b5d2f3fabf7/82700581-49db-5d9b-b068-4b5d2f3fabf7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5749%252F20355749%252Finterior_front_seats-1774609743961.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5749/20355749/interior_front_seats-1774609743961.jpg saved to cache
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82700581-49db-5d9b-b068-4b5d2f3fabf7
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c31d0>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e885f1ab-cbd6-5810-b545-f63db45b4c49/e885f1ab-cbd6-5810-b545-f63db45b4c49_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4632%252F20484632%252Finterior_front_seats-1774692411375.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4632/20484632/interior_front_seats-1774692411375.jpg saved to cache
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e885f1ab-cbd6-5810-b545-f63db45b4c49
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2c4e90>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e885f1ab-cbd6-5810-b545-f63db45b4c49/e885f1ab-cbd6-5810-b545-f63db45b4c49_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4632%252F20484632%252Finterior_rear_seats-1774692659275.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4632/20484632/interior_rear_seats-1774692659275.jpg saved to cache
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e885f1ab-cbd6-5810-b545-f63db45b4c49
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d180d10>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4228%252F20264228%252Finterior_front_seats-1774782572474.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4228/20264228/interior_front_seats-1774782572474.jpg saved to cache
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f044364-7a5c-59e3-9665-8b6f9810bbce
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de0cf90>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4228%252F20264228%252Finterior_rear_seats-1774782587387.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4228/20264228/interior_rear_seats-1774782587387.jpg saved to cache
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f044364-7a5c-59e3-9665-8b6f9810bbce
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c2d10>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5953%252F20455953%252F20455953-exterior_rear_passenger-modified-1774706712067.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5953/20455953/20455953-exterior_rear_passenger-modified-1774706712067.jpeg saved to cache
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:09 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xb9g\xb9\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08"\x84\x00\xb9]9\x00\x00\x00\x00'
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da8df90>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F20455953%252Finterior_dashboard-1774703997465.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/20455953/interior_dashboard-1774703997465.jpeg saved to cache
2026-03-29 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5
2026-03-29 20:09:10 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5953/20455953/interior_front_seats-1774703958284.jpeg>.
2026-03-29 20:09:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5953/20455953/interior_front_seats-1774703958284.jpeg> (referer: None)
2026-03-29 20:09:10 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:10 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:10 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xc0\x18\x16\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\n\xa4\xef\x00\xc0\r\x96\x00\x00\x00\x00'
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2e6a10>
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5953%252F20455953%252Finterior_front_seats-1774703958284.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5953/20455953/interior_front_seats-1774703958284.jpeg saved to cache
2026-03-29 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5
2026-03-29 20:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4632/20484632/exterior_rear_passenger-1774692004890.jpg> (referer: None)
2026-03-29 20:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_front_passenger-1774782245868.jpg> (referer: None)
2026-03-29 20:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5749/20355749/exterior_rear_passenger-1774013954123.jpg> (referer: None)
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a5890>
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e885f1ab-cbd6-5810-b545-f63db45b4c49/e885f1ab-cbd6-5810-b545-f63db45b4c49_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4632%252F20484632%252Fexterior_rear_passenger-1774692004890.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4632/20484632/exterior_rear_passenger-1774692004890.jpg saved to cache
2026-03-29 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e885f1ab-cbd6-5810-b545-f63db45b4c49
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d924250>
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4228%252F20264228%252Fexterior_front_passenger-1774782245868.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_front_passenger-1774782245868.jpg saved to cache
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f044364-7a5c-59e3-9665-8b6f9810bbce
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1a38d0>
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82700581-49db-5d9b-b068-4b5d2f3fabf7/82700581-49db-5d9b-b068-4b5d2f3fabf7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5749%252F20355749%252Fexterior_rear_passenger-1774013954123.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5749/20355749/exterior_rear_passenger-1774013954123.jpg saved to cache
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82700581-49db-5d9b-b068-4b5d2f3fabf7
2026-03-29 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18599819.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4632/20484632/exterior_front_passenger-1774697030293.jpg> (referer: None)
2026-03-29 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5953/20455953/exterior_front_passenger-1774703184466.jpeg> (referer: None)
2026-03-29 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5749/20355749/exterior_front_passenger-1774013973280.jpg> (referer: None)
2026-03-29 20:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87d734ea-eae0-5f94-ae87-d1fb2f160903 with identifier: 18599819
2026-03-29 20:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87d734ea-eae0-5f94-ae87-d1fb2f160903 with scrape type 1
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87d734ea-eae0-5f94-ae87-d1fb2f160903
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18599819%252Fexterior_front_driver-1774691607594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18599819/exterior_front_driver-1774691607594.jpg not downloaded yet
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18599819%252Fexterior_rear_driver-1774691614006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18599819/exterior_rear_driver-1774691614006.jpg not downloaded yet
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18599819%252Fexterior_front_passenger-1774691608901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18599819/exterior_front_passenger-1774691608901.jpg not downloaded yet
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6a0b50>
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e885f1ab-cbd6-5810-b545-f63db45b4c49/e885f1ab-cbd6-5810-b545-f63db45b4c49_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4632%252F20484632%252Fexterior_front_passenger-1774697030293.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4632/20484632/exterior_front_passenger-1774697030293.jpg saved to cache
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e885f1ab-cbd6-5810-b545-f63db45b4c49
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7a63d0>
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F20455953%252Fexterior_front_passenger-1774703184466.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/20455953/exterior_front_passenger-1774703184466.jpeg saved to cache
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18599819%252Fexterior_rear_passenger-1774691610546.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18599819/exterior_rear_passenger-1774691610546.jpg not downloaded yet
2026-03-29 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20010331.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=648&page=18&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce1ee90>
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82700581-49db-5d9b-b068-4b5d2f3fabf7/82700581-49db-5d9b-b068-4b5d2f3fabf7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5749%252F20355749%252Fexterior_front_passenger-1774013973280.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5749/20355749/exterior_front_passenger-1774013973280.jpg saved to cache
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82700581-49db-5d9b-b068-4b5d2f3fabf7
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9819%252F18599819%252Finterior_front_seats-1774693847135.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9819/18599819/interior_front_seats-1774693847135.jpg not downloaded yet
2026-03-29 20:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9819%252F18599819%252Finterior_rear_seats-1774693333906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9819/18599819/interior_rear_seats-1774693333906.jpg not downloaded yet
2026-03-29 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18631801.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2e2b0bd-86a9-5c96-a6e6-337d513187fd with identifier: 20010331
2026-03-29 20:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2e2b0bd-86a9-5c96-a6e6-337d513187fd with scrape type 1
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2e2b0bd-86a9-5c96-a6e6-337d513187fd
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0331%252F20010331%252Fexterior_front_driver-1772980922589.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0331/20010331/exterior_front_driver-1772980922589.jpg not downloaded yet
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18599819%252Finterior_dashboard-1774693350592.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18599819/interior_dashboard-1774693350592.jpg not downloaded yet
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0331%252F20010331%252Fexterior_rear_driver-1772979701201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0331/20010331/exterior_rear_driver-1772979701201.jpg not downloaded yet
2026-03-29 20:09:11 [motorway.uk] INFO: Found listing with ID: 18832294
2026-03-29 20:09:11 [motorway.uk] INFO: Found listing with ID: 20381843
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720381843%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [motorway.uk] INFO: Scrape type for 20381843: 1
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9819%252F18599819%252Finterior_boot-1774693337428.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9819/18599819/interior_boot-1774693337428.jpg not downloaded yet
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0331%252F20010331%252Fexterior_front_passenger-1772979707267.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0331/20010331/exterior_front_passenger-1772979707267.jpg not downloaded yet
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20258462
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 18895198
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20482892
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20403490
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 16057618
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 17828032
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717828032%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [motorway.uk] INFO: Scrape type for 17828032: 1
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9819%252F18599819%252Fdocs_service_history-1774695884706.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5d9115323bfdd9ec1a782dda6f566344%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9819/18599819/docs_service_history-1774695884706.jpg?ixlib=js-3.8.0&auto=format&s=5d9115323bfdd9ec1a782dda6f566344 not downloaded yet
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0331%252F20010331%252Fexterior_rear_passenger-1772979690885.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0331/20010331/exterior_rear_passenger-1772979690885.jpg not downloaded yet
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 19514884
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20140691
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20484845
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20376881
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20297983
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20488223
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20471931
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20493721
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720493721%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [motorway.uk] INFO: Scrape type for 20493721: 1
2026-03-29 20:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fee4d7a-ee59-5bfd-827d-e584f7d591d3 with identifier: 18631801
2026-03-29 20:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fee4d7a-ee59-5bfd-827d-e584f7d591d3 with scrape type 1
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4fee4d7a-ee59-5bfd-827d-e584f7d591d3
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1801%252F18631801%252Fexterior_front_driver-1772638810009.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1801/18631801/exterior_front_driver-1772638810009.jpg already downloaded
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1801%252F18631801%252Fexterior_rear_driver-1772638812296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1801/18631801/exterior_rear_driver-1772638812296.jpg already downloaded
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1801%252F18631801%252Fexterior_front_passenger-1772638813500.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1801/18631801/exterior_front_passenger-1772638813500.jpg already downloaded
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1801%252F18631801%252Fexterior_rear_passenger-1772638816014.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1801/18631801/exterior_rear_passenger-1772638816014.jpg already downloaded
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1801%252F18631801%252Finterior_front_seats-1772708274463.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1801/18631801/interior_front_seats-1772708274463.jpg already downloaded
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1801%252F18631801%252Finterior_rear_seats-1772708218483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1801/18631801/interior_rear_seats-1772708218483.jpg already downloaded
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1801%252F18631801%252F18631801-interior_dashboard-modified-1772714544745.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1801/18631801/18631801-interior_dashboard-modified-1772714544745.jpeg already downloaded
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1801%252F18631801%252F18631801-instrument_cluster-modified-1772714483020.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1801/18631801/18631801-instrument_cluster-modified-1772714483020.jpeg already downloaded
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1801%252F18631801%252Finterior_boot-1772708221693.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1801/18631801/interior_boot-1772708221693.jpg already downloaded
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F1801%252F18631801%252Fdocs_service_history-1772712921419.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D64bf9d7379aa1f3d1536329c0db68db1%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/1801/18631801/docs_service_history-1772712921419.jpg?ixlib=js-3.8.0&auto=format&s=64bf9d7379aa1f3d1536329c0db68db1 already downloaded
2026-03-29 20:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4fee4d7a-ee59-5bfd-827d-e584f7d591d3, identifier: 18631801
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9819%252F18599819%252Fdocs_service_history-1774694394447.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfe8ff598c47fed45bb1050881875393f%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9819/18599819/docs_service_history-1774694394447.jpg?ixlib=js-3.8.0&auto=format&s=fe8ff598c47fed45bb1050881875393f not downloaded yet
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0331%252F20010331%252Finterior_front_seats-1773305760425.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0331/20010331/interior_front_seats-1773305760425.jpg not downloaded yet
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20422784
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 3287660
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 16290111
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 14508639
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 18349158
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 5286387
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 17747789
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20215364
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20407647
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 20115042
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 11558331
2026-03-29 20:09:12 [motorway.uk] INFO: Found listing with ID: 18342530
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718342530%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [motorway.uk] INFO: Scrape type for 18342530: 1
2026-03-29 20:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4fee4d7a-ee59-5bfd-827d-e584f7d591d3 with identifier: 18631801
2026-03-29 20:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4fee4d7a-ee59-5bfd-827d-e584f7d591d3 with identifier: 18631801
2026-03-29 20:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4fee4d7a-ee59-5bfd-827d-e584f7d591d3 with identifier: 18631801 to the API
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18631801.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '4fee4d7a-ee59-5bfd-827d-e584f7d591d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT69 ELL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18631801',
'listing': 'auction',
'location': 'Cumbria Millom',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 41770,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/1801/18631801/exterior_front_driver-1772638810009.jpg',
'https://motorway-photos-redacted.imgix.net/1801/18631801/exterior_rear_driver-1772638812296.jpg',
'https://motorway-photos-redacted.imgix.net/1801/18631801/exterior_front_passenger-1772638813500.jpg',
'https://motorway-photos-redacted.imgix.net/1801/18631801/exterior_rear_passenger-1772638816014.jpg',
'https://motorway-photos.imgix.net/1801/18631801/interior_front_seats-1772708274463.jpg',
'https://motorway-photos.imgix.net/1801/18631801/interior_rear_seats-1772708218483.jpg',
'https://motorway-photos-modified.imgix.net/1801/18631801/18631801-interior_dashboard-modified-1772714544745.jpeg',
'https://motorway-photos-modified.imgix.net/1801/18631801/18631801-instrument_cluster-modified-1772714483020.jpeg',
'https://motorway-photos.imgix.net/1801/18631801/interior_boot-1772708221693.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/1801/18631801/docs_service_history-1772712921419.jpg?ixlib=js-3.8.0&auto=format&s=64bf9d7379aa1f3d1536329c0db68db1'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89fa5cab-0cba-5c8b-a96c-28f1b752d545/89fa5cab-0cba-5c8b-a96c-28f1b752d545_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1356708,
'Height': 2203,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1801/18631801/exterior_front_driver-1772638810009.jpg',
'Width': 2937},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89fa5cab-0cba-5c8b-a96c-28f1b752d545/89fa5cab-0cba-5c8b-a96c-28f1b752d545_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1016084,
'Height': 2149,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1801/18631801/exterior_rear_driver-1772638812296.jpg',
'Width': 2865},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89fa5cab-0cba-5c8b-a96c-28f1b752d545/89fa5cab-0cba-5c8b-a96c-28f1b752d545_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693331,
'Height': 2029,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1801/18631801/exterior_front_passenger-1772638813500.jpg',
'Width': 2705},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89fa5cab-0cba-5c8b-a96c-28f1b752d545/89fa5cab-0cba-5c8b-a96c-28f1b752d545_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1014116,
'Height': 2117,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1801/18631801/exterior_rear_passenger-1772638816014.jpg',
'Width': 2823},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89fa5cab-0cba-5c8b-a96c-28f1b752d545/89fa5cab-0cba-5c8b-a96c-28f1b752d545_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8372083,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/1801/18631801/interior_front_seats-1772708274463.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89fa5cab-0cba-5c8b-a96c-28f1b752d545/89fa5cab-0cba-5c8b-a96c-28f1b752d545_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 9683284,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/1801/18631801/interior_rear_seats-1772708218483.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89fa5cab-0cba-5c8b-a96c-28f1b752d545/89fa5cab-0cba-5c8b-a96c-28f1b752d545_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1127524,
'Height': 2289,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1801/18631801/18631801-interior_dashboard-modified-1772714544745.jpeg',
'Width': 3052},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89fa5cab-0cba-5c8b-a96c-28f1b752d545/89fa5cab-0cba-5c8b-a96c-28f1b752d545_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504487,
'Height': 2267,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1801/18631801/18631801-instrument_cluster-modified-1772714483020.jpeg',
'Width': 3022},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89fa5cab-0cba-5c8b-a96c-28f1b752d545/89fa5cab-0cba-5c8b-a96c-28f1b752d545_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8566881,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/1801/18631801/interior_boot-1772708221693.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89fa5cab-0cba-5c8b-a96c-28f1b752d545/89fa5cab-0cba-5c8b-a96c-28f1b752d545_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7279197,
'Height': 3060,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/1801/18631801/docs_service_history-1772712921419.jpg?ixlib=js-3.8.0&auto=format&s=64bf9d7379aa1f3d1536329c0db68db1',
'Width': 4080}],
'price': 27225,
'price_includes_vat': False,
'registration_date': '2021-09-27',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf R TSI 4MOTION S-A',
'transmission': 'automatic',
'trim': 'R TSI 4MOTION S-A',
'vin': 'WVWZZZCDZNW103147',
'year': 2021}
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718631801%27 HTTP/1.1" 200 None
2026-03-29 20:09:12 [motorway.uk] INFO: Saving data for 18631801: {'created_time': 1774814952.981429, 'last_price_update_time': 1774814952.981442, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18631801') HTTP/1.1" 204 0
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0331%252F20010331%252Finterior_rear_seats-1772981464732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0331/20010331/interior_rear_seats-1772981464732.jpg not downloaded yet
2026-03-29 20:09:13 [motorway.uk] INFO: Found listing with ID: 12851017
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712851017%27 HTTP/1.1" 200 None
2026-03-29 20:09:13 [motorway.uk] INFO: Scrape type for 12851017: 1
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0331%252F20010331%252Finterior_dashboard-1772981477783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0331/20010331/interior_dashboard-1772981477783.jpg not downloaded yet
2026-03-29 20:09:13 [motorway.uk] INFO: Found listing with ID: 20248084
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720248084%27 HTTP/1.1" 200 None
2026-03-29 20:09:13 [motorway.uk] INFO: Scrape type for 20248084: 1
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0331%252F20010331%252Finstrument_cluster-1774715397960.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0331/20010331/instrument_cluster-1774715397960.jpg not downloaded yet
2026-03-29 20:09:13 [motorway.uk] INFO: Found listing with ID: 15064019
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715064019%27 HTTP/1.1" 200 None
2026-03-29 20:09:13 [motorway.uk] INFO: Scrape type for 15064019: 1
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0331%252F20010331%252Finterior_boot-1772981468157.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0331/20010331/interior_boot-1772981468157.jpg not downloaded yet
2026-03-29 20:09:13 [motorway.uk] INFO: Found listing with ID: 16160235
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716160235%27 HTTP/1.1" 200 None
2026-03-29 20:09:13 [motorway.uk] INFO: Scrape type for 16160235: 1
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0331%252F20010331%252Fdocs_service_history-1773305844055.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D336002fdfe01a96cddfef4c37e02567e%27 HTTP/1.1" 200 None
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0331/20010331/docs_service_history-1773305844055.jpg?ixlib=js-3.8.0&auto=format&s=336002fdfe01a96cddfef4c37e02567e not downloaded yet
2026-03-29 20:09:13 [motorway.uk] INFO: Found listing with ID: 3081875
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273081875%27 HTTP/1.1" 200 None
2026-03-29 20:09:13 [motorway.uk] INFO: Scrape type for 3081875: 2
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0331/20010331/exterior_front_driver-1772980922589.jpg> (referer: None)
2026-03-29 20:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4632/20484632/exterior_rear_driver-1774691992676.jpg> (referer: None)
2026-03-29 20:09:13 [motorway.uk] INFO: Found listing with ID: 20429308
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720429308%27 HTTP/1.1" 200 None
2026-03-29 20:09:13 [motorway.uk] INFO: Scrape type for 20429308: 1
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/6110693.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:13 [motorway.uk] INFO: Found listing with ID: 20485771
2026-03-29 20:09:13 [motorway.uk] INFO: Found listing with ID: 18505969
2026-03-29 20:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5749/20355749/exterior_rear_driver-1774013943111.jpg> (referer: None)
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9819/18599819/exterior_front_driver-1774691607594.jpg> (referer: None)
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_front_driver-1774782202083.jpg> (referer: None)
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9819/18599819/exterior_rear_driver-1774691614006.jpg> (referer: None)
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9819/18599819/exterior_rear_passenger-1774691610546.jpg> (referer: None)
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9819/18599819/exterior_front_passenger-1774691608901.jpg> (referer: None)
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5953/20455953/20455953-exterior_front_driver-modified-1774706685557.jpeg> (referer: None)
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17331668.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f44ba90>
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2e2b0bd-86a9-5c96-a6e6-337d513187fd/b2e2b0bd-86a9-5c96-a6e6-337d513187fd_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0331%252F20010331%252Fexterior_front_driver-1772980922589.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0331/20010331/exterior_front_driver-1772980922589.jpg saved to cache
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2e2b0bd-86a9-5c96-a6e6-337d513187fd
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f46dc50>
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e885f1ab-cbd6-5810-b545-f63db45b4c49/e885f1ab-cbd6-5810-b545-f63db45b4c49_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4632%252F20484632%252Fexterior_rear_driver-1774691992676.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4632/20484632/exterior_rear_driver-1774691992676.jpg saved to cache
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e885f1ab-cbd6-5810-b545-f63db45b4c49
2026-03-29 20:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bb26f49-99a6-522a-818d-c375d6c717cc with identifier: 6110693
2026-03-29 20:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bb26f49-99a6-522a-818d-c375d6c717cc with scrape type 1
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bb26f49-99a6-522a-818d-c375d6c717cc
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0693%252F6110693%252Fexterior_front_driver-1774791384996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0693/6110693/exterior_front_driver-1774791384996.jpg not downloaded yet
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8b3f90>
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82700581-49db-5d9b-b068-4b5d2f3fabf7/82700581-49db-5d9b-b068-4b5d2f3fabf7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5749%252F20355749%252Fexterior_rear_driver-1774013943111.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5749/20355749/exterior_rear_driver-1774013943111.jpg saved to cache
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82700581-49db-5d9b-b068-4b5d2f3fabf7
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2a8d50>
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d734ea-eae0-5f94-ae87-d1fb2f160903/87d734ea-eae0-5f94-ae87-d1fb2f160903_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18599819%252Fexterior_front_driver-1774691607594.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18599819/exterior_front_driver-1774691607594.jpg saved to cache
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87d734ea-eae0-5f94-ae87-d1fb2f160903
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e101d90>
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4228%252F20264228%252Fexterior_front_driver-1774782202083.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_front_driver-1774782202083.jpg saved to cache
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f044364-7a5c-59e3-9665-8b6f9810bbce
2026-03-29 20:09:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f044364-7a5c-59e3-9665-8b6f9810bbce, skipping ID generation
2026-03-29 20:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f044364-7a5c-59e3-9665-8b6f9810bbce with scrape type 1
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f044364-7a5c-59e3-9665-8b6f9810bbce sending to next pipeline
2026-03-29 20:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0f044364-7a5c-59e3-9665-8b6f9810bbce, identifier: 20264228
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5e4dd0>
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d734ea-eae0-5f94-ae87-d1fb2f160903/87d734ea-eae0-5f94-ae87-d1fb2f160903_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18599819%252Fexterior_rear_driver-1774691614006.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18599819/exterior_rear_driver-1774691614006.jpg saved to cache
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87d734ea-eae0-5f94-ae87-d1fb2f160903
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d479710>
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d734ea-eae0-5f94-ae87-d1fb2f160903/87d734ea-eae0-5f94-ae87-d1fb2f160903_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18599819%252Fexterior_rear_passenger-1774691610546.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18599819/exterior_rear_passenger-1774691610546.jpg saved to cache
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87d734ea-eae0-5f94-ae87-d1fb2f160903
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d593750>
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87d734ea-eae0-5f94-ae87-d1fb2f160903/87d734ea-eae0-5f94-ae87-d1fb2f160903_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18599819%252Fexterior_front_passenger-1774691608901.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18599819/exterior_front_passenger-1774691608901.jpg saved to cache
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87d734ea-eae0-5f94-ae87-d1fb2f160903
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1cf910>
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5953%252F20455953%252F20455953-exterior_front_driver-modified-1774706685557.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5953/20455953/20455953-exterior_front_driver-modified-1774706685557.jpeg saved to cache
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5
2026-03-29 20:09:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5, skipping ID generation
2026-03-29 20:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5 with scrape type 1
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5 sending to next pipeline
2026-03-29 20:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5, identifier: 20455953
2026-03-29 20:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8470f48c-abd0-535c-9c0b-06e086fbfed7 with identifier: 17331668
2026-03-29 20:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8470f48c-abd0-535c-9c0b-06e086fbfed7 with scrape type 1
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8470f48c-abd0-535c-9c0b-06e086fbfed7
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1668%252F17331668%252Fexterior_front_driver-1774608216802.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1668/17331668/exterior_front_driver-1774608216802.jpeg not downloaded yet
2026-03-29 20:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0f044364-7a5c-59e3-9665-8b6f9810bbce with identifier: 20264228
2026-03-29 20:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0f044364-7a5c-59e3-9665-8b6f9810bbce with identifier: 20264228
2026-03-29 20:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0f044364-7a5c-59e3-9665-8b6f9810bbce with identifier: 20264228 to the API
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_front_driver-1774782202083.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '0f044364-7a5c-59e3-9665-8b6f9810bbce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AD19 NEJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20264228',
'listing': 'auction',
'location': 'Surrey Banstead',
'make': 'MINI',
'model': 'Cooper',
'odometer': 54500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2077762,
'Height': 2564,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_front_driver-1774782202083.jpg',
'Width': 3418},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2246418,
'Height': 2753,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_rear_driver-1774782212926.jpg',
'Width': 3670},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1802518,
'Height': 2668,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_front_passenger-1774782245868.jpg',
'Width': 3557},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2520119,
'Height': 2963,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4228/20264228/exterior_rear_passenger-1774782235064.jpg',
'Width': 3950},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3894566,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4228/20264228/interior_front_seats-1774782572474.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4117622,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4228/20264228/interior_rear_seats-1774782587387.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3519677,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4228/20264228/interior_dashboard-1774782620252.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2644777,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4228/20264228/instrument_cluster-1774782670227.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3744359,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4228/20264228/interior_boot-1774782617815.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f044364-7a5c-59e3-9665-8b6f9810bbce/0f044364-7a5c-59e3-9665-8b6f9810bbce_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1193565,
'Height': 1111,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4228/20264228/docs_service_history-1774782899351.jpg?ixlib=js-3.8.0&auto=format&s=c905602c3c1c4d80e74bc413b9c3526d',
'Width': 1969}],
'price': 9678,
'price_includes_vat': False,
'registration_date': '2019-06-21',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper Sport',
'transmission': 'manual',
'trim': 'Sport',
'vin': 'WMWXR320902L22771',
'year': 2019}
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720264228%27 HTTP/1.1" 200 None
2026-03-29 20:09:15 [motorway.uk] INFO: Saving data for 20264228: {'created_time': 1774814955.340425, 'last_price_update_time': 1774814955.340437, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20264228') HTTP/1.1" 204 0
2026-03-29 20:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5 with identifier: 20455953
2026-03-29 20:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5 with identifier: 20455953
2026-03-29 20:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5 with identifier: 20455953 to the API
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/5953/20455953/20455953-exterior_front_driver-modified-1774706685557.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KX11 EKY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20455953',
'listing': 'auction',
'location': 'Staffordshire Stafford',
'make': 'Fiat',
'model': 'Ducato',
'odometer': 28216,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7334168,
'Height': 5195,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5953/20455953/20455953-exterior_front_driver-modified-1774706685557.jpeg',
'Width': 6927},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2842834,
'Height': 4705,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5953/20455953/exterior_rear_driver-1774703420929.jpeg',
'Width': 6273},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5875597,
'Height': 5753,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5953/20455953/exterior_front_passenger-1774703184466.jpeg',
'Width': 7671},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4553525,
'Height': 5195,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5953/20455953/20455953-exterior_rear_passenger-modified-1774706712067.jpeg',
'Width': 6927},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 13286661,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/5953/20455953/interior_front_seats-1774703958284.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4212417,
'Height': 5195,
'OriginUrl': 'https://motorway-photos.imgix.net/5953/20455953/20455953-interior_rear_seats-default-1774706750569.jpg',
'Width': 6927},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 12683837,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5953/20455953/interior_dashboard-1774703997465.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 167295,
'Height': 480,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5953/20455953/20455953-instrument_cluster-default-1774695634100.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1840690,
'Height': 3559,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5953/20455953/wheels_front_driver-1774703456810.jpeg',
'Width': 4745},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5/b4c5e250-9d01-5ac0-a6bd-35cf4b97ead5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1161994,
'Height': 3168,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5953/20455953/wheels_rear_driver-1774703651326.jpeg',
'Width': 4224}],
'price': 24850,
'price_includes_vat': False,
'registration_date': '2011-04-01',
'seats_number': None,
'seller_name': None,
'title': 'Fiat Ducato 40 Maxi 160 M-JET',
'transmission': 'manual',
'trim': '40 Maxi 160 M-JET',
'vin': 'ZFA25000001871755',
'year': 2011}
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720455953%27 HTTP/1.1" 200 None
2026-03-29 20:09:15 [motorway.uk] INFO: Saving data for 20455953: {'created_time': 1774814955.724155, 'last_price_update_time': 1774814955.724167, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20455953') HTTP/1.1" 204 0
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0693%252F6110693%252Fexterior_rear_driver-1774791398663.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0693/6110693/exterior_rear_driver-1774791398663.jpg not downloaded yet
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1668%252F17331668%252Fexterior_rear_driver-1774608270185.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1668/17331668/exterior_rear_driver-1774608270185.jpeg not downloaded yet
2026-03-29 20:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20467785.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0693%252F6110693%252Fexterior_front_passenger-1774787079637.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0693/6110693/exterior_front_passenger-1774787079637.jpg not downloaded yet
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1668%252F17331668%252Fexterior_front_passenger-1774608237348.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1668/17331668/exterior_front_passenger-1774608237348.jpeg not downloaded yet
2026-03-29 20:09:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0693%252F6110693%252Fexterior_rear_passenger-1774791417371.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0693/6110693/exterior_rear_passenger-1774791417371.jpg not downloaded yet
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1668%252F17331668%252Fexterior_rear_passenger-1774608257752.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1668/17331668/exterior_rear_passenger-1774608257752.jpeg not downloaded yet
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0693%252F6110693%252Finterior_front_seats-1774787294704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0693/6110693/interior_front_seats-1774787294704.jpg not downloaded yet
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1668%252F17331668%252Finterior_front_seats-1774608489220.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1668/17331668/interior_front_seats-1774608489220.jpeg not downloaded yet
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0693%252F6110693%252Finterior_rear_seats-1774787313762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0693/6110693/interior_rear_seats-1774787313762.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1668%252F17331668%252Finterior_rear_seats-1774608383954.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1668/17331668/interior_rear_seats-1774608383954.jpeg not downloaded yet
2026-03-29 20:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19548326.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9392b136-07e0-58af-831f-9bd64520e231 with identifier: 20467785
2026-03-29 20:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9392b136-07e0-58af-831f-9bd64520e231 with scrape type 1
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9392b136-07e0-58af-831f-9bd64520e231
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7785%252F20467785%252Fexterior_front_driver-1774616737430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7785/20467785/exterior_front_driver-1774616737430.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0693%252F6110693%252Finterior_dashboard-1774791364828.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0693/6110693/interior_dashboard-1774791364828.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1668%252F17331668%252Finterior_dashboard-1774608625487.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1668/17331668/interior_dashboard-1774608625487.jpeg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7785%252F20467785%252Fexterior_rear_driver-1774616746444.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7785/20467785/exterior_rear_driver-1774616746444.jpg not downloaded yet
2026-03-29 20:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20176261.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0693%252F6110693%252Finstrument_cluster-1774787404140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0693/6110693/instrument_cluster-1774787404140.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1668%252F17331668%252F17331668-instrument_cluster-modified-1774690094388.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1668/17331668/17331668-instrument_cluster-modified-1774690094388.jpeg not downloaded yet
2026-03-29 20:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18297776.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7785%252F20467785%252Fexterior_front_passenger-1774616780206.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7785/20467785/exterior_front_passenger-1774616780206.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0693%252F6110693%252Finterior_boot-1774787348648.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0693/6110693/interior_boot-1774787348648.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1668%252F17331668%252Finterior_boot-1774608465172.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1668/17331668/interior_boot-1774608465172.jpeg not downloaded yet
2026-03-29 20:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20478024.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74e07290-1f53-5117-b94b-aa31ebceb398 with identifier: 19548326
2026-03-29 20:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74e07290-1f53-5117-b94b-aa31ebceb398 with scrape type 1
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74e07290-1f53-5117-b94b-aa31ebceb398
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8326%252F19548326%252Fexterior_front_driver-1774530200761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8326/19548326/exterior_front_driver-1774530200761.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7785%252F20467785%252Fexterior_rear_passenger-1774616767696.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7785/20467785/exterior_rear_passenger-1774616767696.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0693%252F6110693%252Fdocs_service_history-1774789004416.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5d9ce165cb5a296625ed81ef2a024fd7%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0693/6110693/docs_service_history-1774789004416.jpg?ixlib=js-3.8.0&auto=format&s=5d9ce165cb5a296625ed81ef2a024fd7 not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1668%252F17331668%252Fdocs_service_history-1774638687116.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da77313b5e31a3e136222b54c7e2a4e51%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1668/17331668/docs_service_history-1774638687116.jpeg?ixlib=js-3.8.0&auto=format&s=a77313b5e31a3e136222b54c7e2a4e51 not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8326%252F19548326%252Fexterior_rear_driver-1774530223482.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8326/19548326/exterior_rear_driver-1774530223482.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7785%252F20467785%252Finterior_front_seats-1774617079340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7785/20467785/interior_front_seats-1774617079340.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8326%252F19548326%252Fexterior_front_passenger-1774530232502.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8326/19548326/exterior_front_passenger-1774530232502.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7785%252F20467785%252Finterior_rear_seats-1774617090342.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7785/20467785/interior_rear_seats-1774617090342.jpg not downloaded yet
2026-03-29 20:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4fed8ef-db1c-59d9-a15e-2d05094cf7e0 with identifier: 20176261
2026-03-29 20:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4fed8ef-db1c-59d9-a15e-2d05094cf7e0 with scrape type 1
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4fed8ef-db1c-59d9-a15e-2d05094cf7e0
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6261%252F20176261%252Fexterior_front_driver-1774717615692.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6261/20176261/exterior_front_driver-1774717615692.jpg not downloaded yet
2026-03-29 20:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b17d1ef7-4720-5dd5-abf5-8e9b0cba0392 with identifier: 18297776
2026-03-29 20:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b17d1ef7-4720-5dd5-abf5-8e9b0cba0392 with scrape type 1
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b17d1ef7-4720-5dd5-abf5-8e9b0cba0392
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7776%252F18297776%252Fexterior_front_driver-1774716965080.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7776/18297776/exterior_front_driver-1774716965080.jpeg not downloaded yet
2026-03-29 20:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37cf5ba3-ca90-5e9c-80ce-b14218a3a718 with identifier: 20478024
2026-03-29 20:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37cf5ba3-ca90-5e9c-80ce-b14218a3a718 with scrape type 1
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37cf5ba3-ca90-5e9c-80ce-b14218a3a718
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8024%252F20478024%252Fexterior_front_driver-1774715765638.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8024/20478024/exterior_front_driver-1774715765638.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8326%252F19548326%252Fexterior_rear_passenger-1774530224227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8326/19548326/exterior_rear_passenger-1774530224227.jpg not downloaded yet
2026-03-29 20:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0331/20010331/instrument_cluster-1774715397960.jpg> (referer: None)
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7785%252F20467785%252Finterior_dashboard-1774617100430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7785/20467785/interior_dashboard-1774617100430.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6261%252F20176261%252Fexterior_rear_driver-1774717665165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6261/20176261/exterior_rear_driver-1774717665165.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7776%252F18297776%252Fexterior_rear_driver-1774717717786.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7776/18297776/exterior_rear_driver-1774717717786.jpeg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8024%252F20478024%252Fexterior_rear_driver-1774715791276.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8024/20478024/exterior_rear_driver-1774715791276.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8326%252F19548326%252Finterior_front_seats-1774530505271.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8326/19548326/interior_front_seats-1774530505271.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7785%252F20467785%252Finstrument_cluster-1774617143787.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7785/20467785/instrument_cluster-1774617143787.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6261%252F20176261%252Fexterior_front_passenger-1774717721022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6261/20176261/exterior_front_passenger-1774717721022.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7776%252F18297776%252Fexterior_front_passenger-1774717039371.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7776/18297776/exterior_front_passenger-1774717039371.jpeg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8024%252F20478024%252Fexterior_front_passenger-1774715835032.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8024/20478024/exterior_front_passenger-1774715835032.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8326%252F19548326%252Finterior_rear_seats-1774530515124.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8326/19548326/interior_rear_seats-1774530515124.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7785%252F20467785%252Finterior_boot-1774617086214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7785/20467785/interior_boot-1774617086214.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6261%252F20176261%252Fexterior_rear_passenger-1774717776112.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6261/20176261/exterior_rear_passenger-1774717776112.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7776%252F18297776%252Fexterior_rear_passenger-1774717090619.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7776/18297776/exterior_rear_passenger-1774717090619.jpeg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8024%252F20478024%252Fexterior_rear_passenger-1774715820095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8024/20478024/exterior_rear_passenger-1774715820095.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8326%252F19548326%252Finterior_dashboard-1774623398831.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8326/19548326/interior_dashboard-1774623398831.jpg not downloaded yet
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d66dc50>
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2e2b0bd-86a9-5c96-a6e6-337d513187fd/b2e2b0bd-86a9-5c96-a6e6-337d513187fd_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0331%252F20010331%252Finstrument_cluster-1774715397960.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0331/20010331/instrument_cluster-1774715397960.jpg saved to cache
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2e2b0bd-86a9-5c96-a6e6-337d513187fd
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7785%252F20467785%252Fdocs_service_history-1774617213979.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D74a7e3eff980243a5b7b47a62c856d29%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7785/20467785/docs_service_history-1774617213979.jpg?ixlib=js-3.8.0&auto=format&s=74a7e3eff980243a5b7b47a62c856d29 not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6261%252F20176261%252Finterior_front_seats-1774718384522.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6261/20176261/interior_front_seats-1774718384522.jpg not downloaded yet
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7776%252F18297776%252Finterior_front_seats-1774717865951.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7776/18297776/interior_front_seats-1774717865951.jpeg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8024%252F20478024%252Finterior_front_seats-1774716631350.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8024/20478024/interior_front_seats-1774716631350.jpg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8326%252F19548326%252Finstrument_cluster-1774530622124.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8326/19548326/instrument_cluster-1774530622124.jpg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6261%252F20176261%252Finterior_rear_seats-1774718442597.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6261/20176261/interior_rear_seats-1774718442597.jpg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7776%252F18297776%252Finterior_rear_seats-1774717886914.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7776/18297776/interior_rear_seats-1774717886914.jpeg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8024%252F20478024%252Finterior_rear_seats-1774716647585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8024/20478024/interior_rear_seats-1774716647585.jpg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8326%252F19548326%252Finterior_boot-1774531033885.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8326/19548326/interior_boot-1774531033885.jpg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6261%252F20176261%252Finterior_dashboard-1774718981570.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6261/20176261/interior_dashboard-1774718981570.jpg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7776%252F18297776%252Finterior_dashboard-1774717906850.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7776/18297776/interior_dashboard-1774717906850.jpeg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8024%252F20478024%252Finterior_dashboard-1774716751881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8024/20478024/interior_dashboard-1774716751881.jpg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8326%252F19548326%252Fdocs_service_history-1774530903536.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8d44f0a3368b73123eb8460ab56917ec%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8326/19548326/docs_service_history-1774530903536.jpg?ixlib=js-3.8.0&auto=format&s=8d44f0a3368b73123eb8460ab56917ec not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6261%252F20176261%252Finstrument_cluster-1774718451658.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6261/20176261/instrument_cluster-1774718451658.jpg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7776%252F18297776%252Finterior_boot-1774717906029.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7776/18297776/interior_boot-1774717906029.jpeg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8024%252F20478024%252Finstrument_cluster-1774716723358.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8024/20478024/instrument_cluster-1774716723358.jpg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6261%252F20176261%252Finterior_boot-1774718597168.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6261/20176261/interior_boot-1774718597168.jpg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7776%252F18297776%252F18297776-docs_service_history-modified-1762254369634.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dba8e6b697f06604ca87fb5359e8c93fe%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7776/18297776/18297776-docs_service_history-modified-1762254369634.jpeg?ixlib=js-3.8.0&auto=format&s=ba8e6b697f06604ca87fb5359e8c93fe not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8024%252F20478024%252Finterior_boot-1774716706368.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8024/20478024/interior_boot-1774716706368.jpg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6261%252F20176261%252Fdocs_service_history-1774719170157.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D04267af8cbcf5fec63c51a550d7bc12d%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6261/20176261/docs_service_history-1774719170157.jpg?ixlib=js-3.8.0&auto=format&s=04267af8cbcf5fec63c51a550d7bc12d not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7776%252F18297776%252Fwheels_front_driver-1774717920135.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7776/18297776/wheels_front_driver-1774717920135.jpeg not downloaded yet
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8024%252F20478024%252Fdamage_scratches-1774715975253.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8024/20478024/damage_scratches-1774715975253.jpg not downloaded yet
2026-03-29 20:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=684&page=19&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0693/6110693/exterior_rear_driver-1774791398663.jpg> (referer: None)
2026-03-29 20:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7785/20467785/exterior_rear_driver-1774616746444.jpg> (referer: None)
2026-03-29 20:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0693/6110693/exterior_front_driver-1774791384996.jpg> (referer: None)
2026-03-29 20:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8024/20478024/exterior_front_driver-1774715765638.jpg> (referer: None)
2026-03-29 20:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8326/19548326/exterior_front_driver-1774530200761.jpg> (referer: None)
2026-03-29 20:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1668/17331668/exterior_front_driver-1774608216802.jpeg> (referer: None)
2026-03-29 20:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1668/17331668/exterior_rear_driver-1774608270185.jpeg> (referer: None)
2026-03-29 20:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0331/20010331/docs_service_history-1773305844055.jpg?ixlib=js-3.8.0&auto=format&s=336002fdfe01a96cddfef4c37e02567e> (referer: None)
2026-03-29 20:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1668/17331668/interior_dashboard-1774608625487.jpeg> (referer: None)
2026-03-29 20:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0331/20010331/interior_boot-1772981468157.jpg> (referer: None)
2026-03-29 20:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16160235.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 19564729
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 6226570
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 16486995
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716486995%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [motorway.uk] INFO: Scrape type for 16486995: 1
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 20460973
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 20487463
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 20111851
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 20098217
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720098217%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [motorway.uk] INFO: Scrape type for 20098217: 1
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 19569480
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 20468681
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 14866645
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 13203122
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 15371876
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 17858829
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717858829%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [motorway.uk] INFO: Scrape type for 17858829: 1
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d604a90>
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb26f49-99a6-522a-818d-c375d6c717cc/7bb26f49-99a6-522a-818d-c375d6c717cc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0693%252F6110693%252Fexterior_rear_driver-1774791398663.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0693/6110693/exterior_rear_driver-1774791398663.jpg saved to cache
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bb26f49-99a6-522a-818d-c375d6c717cc
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6cb550>
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9392b136-07e0-58af-831f-9bd64520e231/9392b136-07e0-58af-831f-9bd64520e231_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7785%252F20467785%252Fexterior_rear_driver-1774616746444.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7785/20467785/exterior_rear_driver-1774616746444.jpg saved to cache
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9392b136-07e0-58af-831f-9bd64520e231
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db7bbd0>
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb26f49-99a6-522a-818d-c375d6c717cc/7bb26f49-99a6-522a-818d-c375d6c717cc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0693%252F6110693%252Fexterior_front_driver-1774791384996.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0693/6110693/exterior_front_driver-1774791384996.jpg saved to cache
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bb26f49-99a6-522a-818d-c375d6c717cc
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 8664899
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 14729168
2026-03-29 20:09:17 [motorway.uk] INFO: Found listing with ID: 13365584
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713365584%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [motorway.uk] INFO: Scrape type for 13365584: 1
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d606710>
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cf5ba3-ca90-5e9c-80ce-b14218a3a718/37cf5ba3-ca90-5e9c-80ce-b14218a3a718_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8024%252F20478024%252Fexterior_front_driver-1774715765638.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8024/20478024/exterior_front_driver-1774715765638.jpg saved to cache
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37cf5ba3-ca90-5e9c-80ce-b14218a3a718
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d633690>
2026-03-29 20:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74e07290-1f53-5117-b94b-aa31ebceb398/74e07290-1f53-5117-b94b-aa31ebceb398_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8326%252F19548326%252Fexterior_front_driver-1774530200761.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8326/19548326/exterior_front_driver-1774530200761.jpg saved to cache
2026-03-29 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74e07290-1f53-5117-b94b-aa31ebceb398
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d228dd0>
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470f48c-abd0-535c-9c0b-06e086fbfed7/8470f48c-abd0-535c-9c0b-06e086fbfed7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1668%252F17331668%252Fexterior_front_driver-1774608216802.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1668/17331668/exterior_front_driver-1774608216802.jpeg saved to cache
2026-03-29 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8470f48c-abd0-535c-9c0b-06e086fbfed7
2026-03-29 20:09:18 [motorway.uk] INFO: Found listing with ID: 19518797
2026-03-29 20:09:18 [motorway.uk] INFO: Found listing with ID: 19781742
2026-03-29 20:09:18 [motorway.uk] INFO: Found listing with ID: 18114762
2026-03-29 20:09:18 [motorway.uk] INFO: Found listing with ID: 20484591
2026-03-29 20:09:18 [motorway.uk] INFO: Found listing with ID: 4393703
2026-03-29 20:09:18 [motorway.uk] INFO: Found listing with ID: 19625865
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719625865%27 HTTP/1.1" 200 None
2026-03-29 20:09:18 [motorway.uk] INFO: Scrape type for 19625865: 0
2026-03-29 20:09:18 [motorway.uk] INFO: Found listing with ID: 20021655
2026-03-29 20:09:18 [motorway.uk] INFO: Found listing with ID: 4895685
2026-03-29 20:09:18 [motorway.uk] INFO: Found listing with ID: 20426345
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720426345%27 HTTP/1.1" 200 None
2026-03-29 20:09:18 [motorway.uk] INFO: Scrape type for 20426345: 1
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c82dc10>
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470f48c-abd0-535c-9c0b-06e086fbfed7/8470f48c-abd0-535c-9c0b-06e086fbfed7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1668%252F17331668%252Fexterior_rear_driver-1774608270185.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1668/17331668/exterior_rear_driver-1774608270185.jpeg saved to cache
2026-03-29 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8470f48c-abd0-535c-9c0b-06e086fbfed7
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0f\x00\x00'
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 98 - value: b'Pixel 7a\x00'
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xd0\x0b\x00\x00'
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 58 - Data Location: 107 - value: b'Google\x00'
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x86\x00\x00\x00'
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 114 - value: b'2026:03:12 08:57:13\x00'
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8fc390>
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2e2b0bd-86a9-5c96-a6e6-337d513187fd/b2e2b0bd-86a9-5c96-a6e6-337d513187fd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0331%252F20010331%252Fdocs_service_history-1773305844055.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D336002fdfe01a96cddfef4c37e02567e') HTTP/1.1" 204 0
2026-03-29 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0331/20010331/docs_service_history-1773305844055.jpg?ixlib=js-3.8.0&auto=format&s=336002fdfe01a96cddfef4c37e02567e saved to cache
2026-03-29 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2e2b0bd-86a9-5c96-a6e6-337d513187fd
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c762590>
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470f48c-abd0-535c-9c0b-06e086fbfed7/8470f48c-abd0-535c-9c0b-06e086fbfed7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1668%252F17331668%252Finterior_dashboard-1774608625487.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1668/17331668/interior_dashboard-1774608625487.jpeg saved to cache
2026-03-29 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8470f48c-abd0-535c-9c0b-06e086fbfed7
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0f\x00\x00'
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 98 - value: b'Pixel 7a\x00'
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xd0\x0b\x00\x00'
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 58 - Data Location: 107 - value: b'Google\x00'
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x86\x00\x00\x00'
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:09:18 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 114 - value: b'2026:03:08 14:50:31\x00'
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d574f90>
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2e2b0bd-86a9-5c96-a6e6-337d513187fd/b2e2b0bd-86a9-5c96-a6e6-337d513187fd_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0331%252F20010331%252Finterior_boot-1772981468157.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0331/20010331/interior_boot-1772981468157.jpg saved to cache
2026-03-29 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2e2b0bd-86a9-5c96-a6e6-337d513187fd
2026-03-29 20:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40b97905-f39e-59f3-978d-8420092f23a7 with identifier: 16160235
2026-03-29 20:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40b97905-f39e-59f3-978d-8420092f23a7 with scrape type 1
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40b97905-f39e-59f3-978d-8420092f23a7
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0235%252F16160235%252Fexterior_front_driver-1774629642390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_front_driver-1774629642390.jpg not downloaded yet
2026-03-29 20:09:19 [motorway.uk] INFO: Found listing with ID: 15364589
2026-03-29 20:09:19 [motorway.uk] INFO: Found listing with ID: 20450018
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720450018%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [motorway.uk] INFO: Scrape type for 20450018: 1
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0235%252F16160235%252Fexterior_rear_driver-1774629662899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_rear_driver-1774629662899.jpg not downloaded yet
2026-03-29 20:09:19 [motorway.uk] INFO: Found listing with ID: 17809359
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717809359%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [motorway.uk] INFO: Scrape type for 17809359: 1
2026-03-29 20:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0235%252F16160235%252Fexterior_front_passenger-1774629708892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_front_passenger-1774629708892.jpg not downloaded yet
2026-03-29 20:09:19 [motorway.uk] INFO: Found listing with ID: 20487947
2026-03-29 20:09:19 [motorway.uk] INFO: Found listing with ID: 20346112
2026-03-29 20:09:19 [motorway.uk] INFO: Found listing with ID: 15189137
2026-03-29 20:09:19 [motorway.uk] INFO: Found listing with ID: 20366507
2026-03-29 20:09:19 [motorway.uk] INFO: Found listing with ID: 13105341
2026-03-29 20:09:19 [motorway.uk] INFO: Found listing with ID: 19925177
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719925177%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [motorway.uk] INFO: Scrape type for 19925177: 1
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8024/20478024/damage_scratches-1774715975253.jpg> (referer: None)
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0235%252F16160235%252Fexterior_rear_passenger-1774629691668.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_rear_passenger-1774629691668.jpg not downloaded yet
2026-03-29 20:09:19 [motorway.uk] INFO: Found listing with ID: 19729177
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719729177%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [motorway.uk] INFO: Scrape type for 19729177: 1
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0235%252F16160235%252Finterior_front_seats-1774630170284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0235/16160235/interior_front_seats-1774630170284.jpg not downloaded yet
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15064019.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:19 [motorway.uk] INFO: Found listing with ID: 20387159
2026-03-29 20:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0235%252F16160235%252Finterior_rear_seats-1774630009704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0235/16160235/interior_rear_seats-1774630009704.jpg not downloaded yet
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0235%252F16160235%252Finterior_dashboard-1774630045587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0235/16160235/interior_dashboard-1774630045587.jpg not downloaded yet
2026-03-29 20:09:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8fc850>
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cf5ba3-ca90-5e9c-80ce-b14218a3a718/37cf5ba3-ca90-5e9c-80ce-b14218a3a718_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8024%252F20478024%252Fdamage_scratches-1774715975253.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8024/20478024/damage_scratches-1774715975253.jpg saved to cache
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37cf5ba3-ca90-5e9c-80ce-b14218a3a718
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0235%252F16160235%252Finstrument_cluster-1774630100569.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0235/16160235/instrument_cluster-1774630100569.jpg not downloaded yet
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0235%252F16160235%252Finterior_boot-1774630046878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0235/16160235/interior_boot-1774630046878.jpg not downloaded yet
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3081875.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60a67358-1d64-514b-b6a1-b27d57cf8237 with identifier: 15064019
2026-03-29 20:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a67358-1d64-514b-b6a1-b27d57cf8237 with scrape type 1
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60a67358-1d64-514b-b6a1-b27d57cf8237
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4019%252F15064019%252Fexterior_front_driver-1774709576805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_front_driver-1774709576805.jpg not downloaded yet
2026-03-29 20:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0235%252F16160235%252Fdocs_service_history-1774630318385.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4b565a51a68bf454dd9a6b18c74069d6%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0235/16160235/docs_service_history-1774630318385.jpg?ixlib=js-3.8.0&auto=format&s=4b565a51a68bf454dd9a6b18c74069d6 not downloaded yet
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4019%252F15064019%252Fexterior_rear_driver-1774709663288.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_rear_driver-1774709663288.jpg not downloaded yet
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4019%252F15064019%252Fexterior_front_passenger-1774709710887.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_front_passenger-1774709710887.jpg not downloaded yet
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7776/18297776/wheels_front_driver-1774717920135.jpeg> (referer: None)
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4019%252F15064019%252Fexterior_rear_passenger-1774709693174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_rear_passenger-1774709693174.jpg not downloaded yet
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4019%252F15064019%252Finterior_front_seats-1774710282126.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4019/15064019/interior_front_seats-1774710282126.jpg not downloaded yet
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4019%252F15064019%252Finterior_rear_seats-1774710297574.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4019/15064019/interior_rear_seats-1774710297574.jpg not downloaded yet
2026-03-29 20:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52e17fa8-5885-5e14-8065-292f9f9129d4 with identifier: 3081875
2026-03-29 20:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52e17fa8-5885-5e14-8065-292f9f9129d4 with scrape type 2
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52e17fa8-5885-5e14-8065-292f9f9129d4 with scrape type 2
2026-03-29 20:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 52e17fa8-5885-5e14-8065-292f9f9129d4, identifier: 3081875
2026-03-29 20:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 52e17fa8-5885-5e14-8065-292f9f9129d4 with identifier: 3081875
2026-03-29 20:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 52e17fa8-5885-5e14-8065-292f9f9129d4 with identifier: 3081875
2026-03-29 20:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 52e17fa8-5885-5e14-8065-292f9f9129d4 with identifier: 3081875 to the API
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3081875.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '52e17fa8-5885-5e14-8065-292f9f9129d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'B18 BWN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3081875',
'listing': 'auction',
'location': 'Greater Manchester Stockport',
'make': 'Mercedes',
'model': 'CLA Class',
'odometer': 45702,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 18000,
'price_includes_vat': False,
'registration_date': '2019-09-02',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes CLA 220 AMG Line Premium + D A',
'transmission': 'automatic',
'trim': 'CLA 220 AMG Line Premium + D A',
'vin': 'WDD1183142N035437',
'year': 2019}
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273081875%27 HTTP/1.1" 200 None
2026-03-29 20:09:20 [motorway.uk] INFO: Saving data for 3081875: {'auction_closing_time': 1774884600.0, 'created_time': 1774383380.93501, 'last_price_update_time': 1774814960.422771}
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3081875') HTTP/1.1" 204 0
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4019%252F15064019%252Finterior_dashboard-1774710335871.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4019/15064019/interior_dashboard-1774710335871.jpg not downloaded yet
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4019%252F15064019%252Finstrument_cluster-1774710377705.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4019/15064019/instrument_cluster-1774710377705.jpg not downloaded yet
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3d3990>
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b17d1ef7-4720-5dd5-abf5-8e9b0cba0392/b17d1ef7-4720-5dd5-abf5-8e9b0cba0392_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7776%252F18297776%252Fwheels_front_driver-1774717920135.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7776/18297776/wheels_front_driver-1774717920135.jpeg saved to cache
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b17d1ef7-4720-5dd5-abf5-8e9b0cba0392
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4019%252F15064019%252Finterior_boot-1774710340240.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4019/15064019/interior_boot-1774710340240.jpg not downloaded yet
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4019%252F15064019%252Fdocs_service_history-1774710986683.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D625a323524e66be047950140be995dc9%27 HTTP/1.1" 200 None
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4019/15064019/docs_service_history-1774710986683.jpg?ixlib=js-3.8.0&auto=format&s=625a323524e66be047950140be995dc9 not downloaded yet
2026-03-29 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_front_driver-1774629642390.jpg> (referer: None)
2026-03-29 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_front_passenger-1774629708892.jpg> (referer: None)
2026-03-29 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_front_passenger-1774709710887.jpg> (referer: None)
2026-03-29 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6261/20176261/docs_service_history-1774719170157.jpg?ixlib=js-3.8.0&auto=format&s=04267af8cbcf5fec63c51a550d7bc12d> (referer: None)
2026-03-29 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8024/20478024/interior_boot-1774716706368.jpg> (referer: None)
2026-03-29 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_front_driver-1774709576805.jpg> (referer: None)
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d904b10>
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0235%252F16160235%252Fexterior_front_driver-1774629642390.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_front_driver-1774629642390.jpg saved to cache
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40b97905-f39e-59f3-978d-8420092f23a7
2026-03-29 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4019/15064019/docs_service_history-1774710986683.jpg?ixlib=js-3.8.0&auto=format&s=625a323524e66be047950140be995dc9> (referer: None)
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8a0910>
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0235%252F16160235%252Fexterior_front_passenger-1774629708892.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_front_passenger-1774629708892.jpg saved to cache
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40b97905-f39e-59f3-978d-8420092f23a7
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c831a10>
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4019%252F15064019%252Fexterior_front_passenger-1774709710887.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_front_passenger-1774709710887.jpg saved to cache
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60a67358-1d64-514b-b6a1-b27d57cf8237
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2e1290>
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fed8ef-db1c-59d9-a15e-2d05094cf7e0/e4fed8ef-db1c-59d9-a15e-2d05094cf7e0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6261%252F20176261%252Fdocs_service_history-1774719170157.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D04267af8cbcf5fec63c51a550d7bc12d') HTTP/1.1" 204 0
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6261/20176261/docs_service_history-1774719170157.jpg?ixlib=js-3.8.0&auto=format&s=04267af8cbcf5fec63c51a550d7bc12d saved to cache
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4fed8ef-db1c-59d9-a15e-2d05094cf7e0
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f332650>
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cf5ba3-ca90-5e9c-80ce-b14218a3a718/37cf5ba3-ca90-5e9c-80ce-b14218a3a718_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8024%252F20478024%252Finterior_boot-1774716706368.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8024/20478024/interior_boot-1774716706368.jpg saved to cache
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37cf5ba3-ca90-5e9c-80ce-b14218a3a718
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d06add0>
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4019%252F15064019%252Fexterior_front_driver-1774709576805.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_front_driver-1774709576805.jpg saved to cache
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60a67358-1d64-514b-b6a1-b27d57cf8237
2026-03-29 20:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7776/18297776/18297776-docs_service_history-modified-1762254369634.jpeg?ixlib=js-3.8.0&auto=format&s=ba8e6b697f06604ca87fb5359e8c93fe> (referer: None)
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f26f850>
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4019%252F15064019%252Fdocs_service_history-1774710986683.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D625a323524e66be047950140be995dc9') HTTP/1.1" 204 0
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4019/15064019/docs_service_history-1774710986683.jpg?ixlib=js-3.8.0&auto=format&s=625a323524e66be047950140be995dc9 saved to cache
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60a67358-1d64-514b-b6a1-b27d57cf8237
2026-03-29 20:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4019/15064019/instrument_cluster-1774710377705.jpg> (referer: None)
2026-03-29 20:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4019/15064019/interior_boot-1774710340240.jpg> (referer: None)
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dde42d0>
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b17d1ef7-4720-5dd5-abf5-8e9b0cba0392/b17d1ef7-4720-5dd5-abf5-8e9b0cba0392_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7776%252F18297776%252F18297776-docs_service_history-modified-1762254369634.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dba8e6b697f06604ca87fb5359e8c93fe') HTTP/1.1" 204 0
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7776/18297776/18297776-docs_service_history-modified-1762254369634.jpeg?ixlib=js-3.8.0&auto=format&s=ba8e6b697f06604ca87fb5359e8c93fe saved to cache
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b17d1ef7-4720-5dd5-abf5-8e9b0cba0392
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7fe310>
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4019%252F15064019%252Finstrument_cluster-1774710377705.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4019/15064019/instrument_cluster-1774710377705.jpg saved to cache
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60a67358-1d64-514b-b6a1-b27d57cf8237
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca660d0>
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4019%252F15064019%252Finterior_boot-1774710340240.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4019/15064019/interior_boot-1774710340240.jpg saved to cache
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60a67358-1d64-514b-b6a1-b27d57cf8237
2026-03-29 20:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20450018.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_rear_driver-1774709663288.jpg> (referer: None)
2026-03-29 20:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_rear_passenger-1774709693174.jpg> (referer: None)
2026-03-29 20:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4019/15064019/interior_dashboard-1774710335871.jpg> (referer: None)
2026-03-29 20:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4019/15064019/interior_rear_seats-1774710297574.jpg> (referer: None)
2026-03-29 20:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4019/15064019/interior_front_seats-1774710282126.jpg> (referer: None)
2026-03-29 20:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7cca350-039f-5425-b621-162e14a5dd2b with identifier: 20450018
2026-03-29 20:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7cca350-039f-5425-b621-162e14a5dd2b with scrape type 1
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7cca350-039f-5425-b621-162e14a5dd2b
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F20450018%252Fexterior_front_driver-1774689546319.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_front_driver-1774689546319.jpg not downloaded yet
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F20450018%252Fexterior_rear_driver-1774689556981.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_rear_driver-1774689556981.jpg not downloaded yet
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F20450018%252Fexterior_front_passenger-1774689578611.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_front_passenger-1774689578611.jpg not downloaded yet
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d126910>
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4019%252F15064019%252Fexterior_rear_driver-1774709663288.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_rear_driver-1774709663288.jpg saved to cache
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60a67358-1d64-514b-b6a1-b27d57cf8237
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f607e90>
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4019%252F15064019%252Fexterior_rear_passenger-1774709693174.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_rear_passenger-1774709693174.jpg saved to cache
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60a67358-1d64-514b-b6a1-b27d57cf8237
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c830450>
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4019%252F15064019%252Finterior_dashboard-1774710335871.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4019/15064019/interior_dashboard-1774710335871.jpg saved to cache
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60a67358-1d64-514b-b6a1-b27d57cf8237
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd65c90>
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4019%252F15064019%252Finterior_rear_seats-1774710297574.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4019/15064019/interior_rear_seats-1774710297574.jpg saved to cache
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60a67358-1d64-514b-b6a1-b27d57cf8237
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2deb1310>
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4019%252F15064019%252Finterior_front_seats-1774710282126.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4019/15064019/interior_front_seats-1774710282126.jpg saved to cache
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60a67358-1d64-514b-b6a1-b27d57cf8237
2026-03-29 20:09:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60a67358-1d64-514b-b6a1-b27d57cf8237, skipping ID generation
2026-03-29 20:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a67358-1d64-514b-b6a1-b27d57cf8237 with scrape type 1
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60a67358-1d64-514b-b6a1-b27d57cf8237 sending to next pipeline
2026-03-29 20:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 60a67358-1d64-514b-b6a1-b27d57cf8237, identifier: 15064019
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F20450018%252Fexterior_rear_passenger-1774689569207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_rear_passenger-1774689569207.jpg not downloaded yet
2026-03-29 20:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 60a67358-1d64-514b-b6a1-b27d57cf8237 with identifier: 15064019
2026-03-29 20:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 60a67358-1d64-514b-b6a1-b27d57cf8237 with identifier: 15064019
2026-03-29 20:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 60a67358-1d64-514b-b6a1-b27d57cf8237 with identifier: 15064019 to the API
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4019/15064019/interior_front_seats-1774710282126.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '60a67358-1d64-514b-b6a1-b27d57cf8237',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'A21 SEK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15064019',
'listing': 'auction',
'location': 'Greater London Greenford',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 66675,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2692326,
'Height': 2967,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_front_driver-1774709576805.jpg',
'Width': 3956},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1760204,
'Height': 2523,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_rear_driver-1774709663288.jpg',
'Width': 3364},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1152437,
'Height': 2475,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_front_passenger-1774709710887.jpg',
'Width': 3300},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1822796,
'Height': 2693,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4019/15064019/exterior_rear_passenger-1774709693174.jpg',
'Width': 3590},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3928906,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4019/15064019/interior_front_seats-1774710282126.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3322666,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4019/15064019/interior_rear_seats-1774710297574.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1974343,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4019/15064019/interior_dashboard-1774710335871.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3276614,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4019/15064019/instrument_cluster-1774710377705.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4141898,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4019/15064019/interior_boot-1774710340240.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a67358-1d64-514b-b6a1-b27d57cf8237/60a67358-1d64-514b-b6a1-b27d57cf8237_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468215,
'Height': 1157,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4019/15064019/docs_service_history-1774710986683.jpg?ixlib=js-3.8.0&auto=format&s=625a323524e66be047950140be995dc9',
'Width': 3367}],
'price': 13825,
'price_includes_vat': False,
'registration_date': '2015-11-17',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf R TSI S-A',
'transmission': 'automatic',
'trim': 'R TSI S-A',
'vin': 'WVWZZZAUZGP557261',
'year': 2015}
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715064019%27 HTTP/1.1" 200 None
2026-03-29 20:09:23 [motorway.uk] INFO: Saving data for 15064019: {'created_time': 1774814963.741901, 'last_price_update_time': 1774814963.741911, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15064019') HTTP/1.1" 204 0
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F20450018%252Finterior_front_seats-1774690100210.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/20450018/interior_front_seats-1774690100210.jpg not downloaded yet
2026-03-29 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20098217.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F20450018%252Finterior_rear_seats-1774690045664.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/20450018/interior_rear_seats-1774690045664.jpg not downloaded yet
2026-03-29 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0235/16160235/docs_service_history-1774630318385.jpg?ixlib=js-3.8.0&auto=format&s=4b565a51a68bf454dd9a6b18c74069d6> (referer: None)
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0018%252F20450018%252Finterior_dashboard-1774783390942.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0018/20450018/interior_dashboard-1774783390942.jpg not downloaded yet
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0018%252F20450018%252Finstrument_cluster-1774783372865.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0018/20450018/instrument_cluster-1774783372865.jpg not downloaded yet
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F20450018%252Finterior_boot-1774690079933.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/20450018/interior_boot-1774690079933.jpg not downloaded yet
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F20450018%252Fdamage_scratches-1774689629590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/20450018/damage_scratches-1774689629590.jpg not downloaded yet
2026-03-29 20:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee88e099-3114-51f3-ae60-458f5650744e with identifier: 20098217
2026-03-29 20:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee88e099-3114-51f3-ae60-458f5650744e with scrape type 1
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee88e099-3114-51f3-ae60-458f5650744e
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8217%252F20098217%252Fexterior_front_driver-1774634207262.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_front_driver-1774634207262.jpg not downloaded yet
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8217%252F20098217%252Fexterior_rear_driver-1774634225469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_rear_driver-1774634225469.jpg not downloaded yet
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8217%252F20098217%252Fexterior_front_passenger-1774634253836.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_front_passenger-1774634253836.jpg not downloaded yet
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd64a50>
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0235%252F16160235%252Fdocs_service_history-1774630318385.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4b565a51a68bf454dd9a6b18c74069d6') HTTP/1.1" 204 0
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0235/16160235/docs_service_history-1774630318385.jpg?ixlib=js-3.8.0&auto=format&s=4b565a51a68bf454dd9a6b18c74069d6 saved to cache
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40b97905-f39e-59f3-978d-8420092f23a7
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8217%252F20098217%252Fexterior_rear_passenger-1774634239480.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_rear_passenger-1774634239480.jpg not downloaded yet
2026-03-29 20:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17858829.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16486995.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8217%252F20098217%252Finterior_front_seats-1774708807741.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8217/20098217/interior_front_seats-1774708807741.jpg not downloaded yet
2026-03-29 20:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13365584.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1668/17331668/interior_front_seats-1774608489220.jpeg> (referer: None)
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8217%252F20098217%252Finterior_rear_seats-1774708867451.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8217/20098217/interior_rear_seats-1774708867451.jpg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8217%252F20098217%252Finterior_dashboard-1774708894328.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8217/20098217/interior_dashboard-1774708894328.jpg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8217%252F20098217%252Finstrument_cluster-1774708885802.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8217/20098217/instrument_cluster-1774708885802.jpg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8217%252F20098217%252Finterior_boot-1774709059667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8217/20098217/interior_boot-1774709059667.jpg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8217%252F20098217%252Fdocs_service_history-1774777237344.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D93e3430ec207c7d3afa670896313c1fc%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8217/20098217/docs_service_history-1774777237344.jpg?ixlib=js-3.8.0&auto=format&s=93e3430ec207c7d3afa670896313c1fc not downloaded yet
2026-03-29 20:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1 with identifier: 17858829
2026-03-29 20:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1 with scrape type 1
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8829%252F17858829%252Fexterior_front_driver-1774701267661.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8829/17858829/exterior_front_driver-1774701267661.jpg not downloaded yet
2026-03-29 20:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa663652-c303-56e8-8587-863cb5978554 with identifier: 16486995
2026-03-29 20:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa663652-c303-56e8-8587-863cb5978554 with scrape type 1
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa663652-c303-56e8-8587-863cb5978554
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6995%252F16486995%252Fexterior_front_driver-1774701429319.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_front_driver-1774701429319.jpeg not downloaded yet
2026-03-29 20:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0235/16160235/instrument_cluster-1774630100569.jpg> (referer: None)
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8829%252F17858829%252F17858829-exterior_rear_driver-modified-1774701989436.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8829/17858829/17858829-exterior_rear_driver-modified-1774701989436.jpeg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6995%252F16486995%252Fexterior_rear_driver-1774701408020.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_rear_driver-1774701408020.jpeg not downloaded yet
2026-03-29 20:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 736ead27-f4f2-5741-b43a-bd2aa50120ae with identifier: 13365584
2026-03-29 20:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 736ead27-f4f2-5741-b43a-bd2aa50120ae with scrape type 1
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 736ead27-f4f2-5741-b43a-bd2aa50120ae
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5584%252F13365584%252Fexterior_front_driver-1774781574884.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_front_driver-1774781574884.jpeg not downloaded yet
2026-03-29 20:09:24 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:24 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:24 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00oE\xcd\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\x9a=\x00o;\xd9\x00\x00\x00\x00'
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d973110>
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8470f48c-abd0-535c-9c0b-06e086fbfed7/8470f48c-abd0-535c-9c0b-06e086fbfed7_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1668%252F17331668%252Finterior_front_seats-1774608489220.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1668/17331668/interior_front_seats-1774608489220.jpeg saved to cache
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8470f48c-abd0-535c-9c0b-06e086fbfed7
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8829%252F17858829%252F17858829-exterior_front_passenger-modified-1774702006536.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8829/17858829/17858829-exterior_front_passenger-modified-1774702006536.jpeg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6995%252F16486995%252Fexterior_front_passenger-1774701388791.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_front_passenger-1774701388791.jpeg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5584%252F13365584%252Fexterior_rear_driver-1774781609933.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_rear_driver-1774781609933.jpeg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8829%252F17858829%252F17858829-exterior_rear_passenger-modified-1774702032529.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8829/17858829/17858829-exterior_rear_passenger-modified-1774702032529.jpeg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6995%252F16486995%252Fexterior_rear_passenger-1774701470135.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_rear_passenger-1774701470135.jpeg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5584%252F13365584%252Fexterior_front_passenger-1774781604236.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_front_passenger-1774781604236.jpeg not downloaded yet
2026-03-29 20:09:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d52dc90>
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0235%252F16160235%252Finstrument_cluster-1774630100569.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0235/16160235/instrument_cluster-1774630100569.jpg saved to cache
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40b97905-f39e-59f3-978d-8420092f23a7
2026-03-29 20:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_front_passenger-1774689578611.jpg> (referer: None)
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8829%252F17858829%252Finterior_front_seats-1774701031985.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8829/17858829/interior_front_seats-1774701031985.jpg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6995%252F16486995%252F16486995-interior_front_seats-modified-1774702870538.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6995/16486995/16486995-interior_front_seats-modified-1774702870538.jpeg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5584%252F13365584%252Fexterior_rear_passenger-1774781605256.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_rear_passenger-1774781605256.jpeg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8829%252F17858829%252Finterior_rear_seats-1774701120582.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8829/17858829/interior_rear_seats-1774701120582.jpg not downloaded yet
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6995%252F16486995%252Finterior_rear_seats-1774701642474.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6995/16486995/interior_rear_seats-1774701642474.jpeg not downloaded yet
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5584%252F13365584%252Finterior_front_seats-1774781966217.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5584/13365584/interior_front_seats-1774781966217.jpeg not downloaded yet
2026-03-29 20:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_rear_passenger-1774689569207.jpg> (referer: None)
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8829%252F17858829%252F17858829-interior_dashboard-modified-1774702098070.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8829/17858829/17858829-interior_dashboard-modified-1774702098070.jpeg not downloaded yet
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6995%252F16486995%252F16486995-interior_dashboard-modified-1774702942711.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6995/16486995/16486995-interior_dashboard-modified-1774702942711.jpeg not downloaded yet
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5584%252F13365584%252Finterior_rear_seats-1774781734090.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5584/13365584/interior_rear_seats-1774781734090.jpeg not downloaded yet
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4e5c50>
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F20450018%252Fexterior_front_passenger-1774689578611.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_front_passenger-1774689578611.jpg saved to cache
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7cca350-039f-5425-b621-162e14a5dd2b
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8829%252F17858829%252Finstrument_cluster-1774716260836.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8829/17858829/instrument_cluster-1774716260836.jpg not downloaded yet
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6995%252F16486995%252Finterior_boot-1774701599275.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6995/16486995/interior_boot-1774701599275.jpeg not downloaded yet
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5584%252F13365584%252Finterior_dashboard-1774781805743.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5584/13365584/interior_dashboard-1774781805743.jpeg not downloaded yet
2026-03-29 20:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20429308.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0235/16160235/interior_boot-1774630046878.jpg> (referer: None)
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8829%252F17858829%252Finterior_boot-1774701168226.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8829/17858829/interior_boot-1774701168226.jpg not downloaded yet
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6995%252F16486995%252F16486995-docs_service_history-modified-1774702964911.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dac6d7a5f0f32ad09d3ef6ca6000c470c%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6995/16486995/16486995-docs_service_history-modified-1774702964911.jpeg?ixlib=js-3.8.0&auto=format&s=ac6d7a5f0f32ad09d3ef6ca6000c470c not downloaded yet
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5584%252F13365584%252Finterior_boot-1774781762508.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5584/13365584/interior_boot-1774781762508.jpeg not downloaded yet
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d929a90>
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F20450018%252Fexterior_rear_passenger-1774689569207.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_rear_passenger-1774689569207.jpg saved to cache
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7cca350-039f-5425-b621-162e14a5dd2b
2026-03-29 20:09:25 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (13641266) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5584/13365584/interior_front_seats-1774781966217.jpeg>.
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8829%252F17858829%252Fdocs_service_history-1774701483710.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D582cd11af8b831ff8f4e39bea3a2fc77%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8829/17858829/docs_service_history-1774701483710.jpg?ixlib=js-3.8.0&auto=format&s=582cd11af8b831ff8f4e39bea3a2fc77 not downloaded yet
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6995%252F16486995%252F16486995-docs_service_history-modified-1774702981243.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De7c1acd198c07ba556466087fd29cf86%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6995/16486995/16486995-docs_service_history-modified-1774702981243.jpeg?ixlib=js-3.8.0&auto=format&s=e7c1acd198c07ba556466087fd29cf86 not downloaded yet
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5584%252F13365584%252F13365584-docs_service_history-default-1774785930042.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df21c61a3ac58a7987831aaae723ee76f%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5584/13365584/13365584-docs_service_history-default-1774785930042.png?ixlib=js-3.8.0&auto=format&s=f21c61a3ac58a7987831aaae723ee76f not downloaded yet
2026-03-29 20:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_rear_driver-1774689556981.jpg> (referer: None)
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5584%252F13365584%252Fwheels_front_driver-1774781837965.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5584/13365584/wheels_front_driver-1774781837965.jpeg not downloaded yet
2026-03-29 20:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec963ed8-513b-594a-8c89-ed83dde16d3f with identifier: 20429308
2026-03-29 20:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec963ed8-513b-594a-8c89-ed83dde16d3f with scrape type 1
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec963ed8-513b-594a-8c89-ed83dde16d3f
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9308%252F20429308%252Fexterior_front_driver-1774699473399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9308/20429308/exterior_front_driver-1774699473399.jpg not downloaded yet
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f30db90>
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0235%252F16160235%252Finterior_boot-1774630046878.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0235/16160235/interior_boot-1774630046878.jpg saved to cache
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40b97905-f39e-59f3-978d-8420092f23a7
2026-03-29 20:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0235/16160235/interior_dashboard-1774630045587.jpg> (referer: None)
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9308%252F20429308%252Fexterior_rear_driver-1774703707907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9308/20429308/exterior_rear_driver-1774703707907.jpg not downloaded yet
2026-03-29 20:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0235/16160235/interior_rear_seats-1774630009704.jpg> (referer: None)
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9308%252F20429308%252Fexterior_front_passenger-1774703719856.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9308/20429308/exterior_front_passenger-1774703719856.jpg not downloaded yet
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d010e90>
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F20450018%252Fexterior_rear_driver-1774689556981.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_rear_driver-1774689556981.jpg saved to cache
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7cca350-039f-5425-b621-162e14a5dd2b
2026-03-29 20:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_rear_passenger-1774634239480.jpg> (referer: None)
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9308%252F20429308%252Fexterior_rear_passenger-1774699463917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9308/20429308/exterior_rear_passenger-1774699463917.jpg not downloaded yet
2026-03-29 20:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8829/17858829/17858829-exterior_rear_driver-modified-1774701989436.jpeg> (referer: None)
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9308%252F20429308%252Finterior_front_seats-1774703729413.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9308/20429308/interior_front_seats-1774703729413.jpg not downloaded yet
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9308%252F20429308%252Finterior_rear_seats-1774703735333.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9308/20429308/interior_rear_seats-1774703735333.jpg not downloaded yet
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d013490>
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0235%252F16160235%252Finterior_dashboard-1774630045587.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0235/16160235/interior_dashboard-1774630045587.jpg saved to cache
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40b97905-f39e-59f3-978d-8420092f23a7
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d59d5d0>
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0235%252F16160235%252Finterior_rear_seats-1774630009704.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0235/16160235/interior_rear_seats-1774630009704.jpg saved to cache
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40b97905-f39e-59f3-978d-8420092f23a7
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9308%252F20429308%252Finterior_dashboard-1774703749630.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9308/20429308/interior_dashboard-1774703749630.jpg not downloaded yet
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9308%252F20429308%252Finterior_boot-1774703756533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9308/20429308/interior_boot-1774703756533.jpg not downloaded yet
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddbca10>
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8217%252F20098217%252Fexterior_rear_passenger-1774634239480.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_rear_passenger-1774634239480.jpg saved to cache
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee88e099-3114-51f3-ae60-458f5650744e
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9aa2d0>
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8829%252F17858829%252F17858829-exterior_rear_driver-modified-1774701989436.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8829/17858829/17858829-exterior_rear_driver-modified-1774701989436.jpeg saved to cache
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9308%252F20429308%252Fdocs_service_history-1774702956455.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbcd4e58a7e4c044266c35659bd101384%27 HTTP/1.1" 200 None
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9308/20429308/docs_service_history-1774702956455.jpg?ixlib=js-3.8.0&auto=format&s=bcd4e58a7e4c044266c35659bd101384 not downloaded yet
2026-03-29 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_rear_driver-1774701408020.jpeg> (referer: None)
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9308%252F20429308%252Fdocs_service_history-1774702959085.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D95d1d5e725fc5645f5567cf5149cf8eb%27 HTTP/1.1" 200 None
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9308/20429308/docs_service_history-1774702959085.jpg?ixlib=js-3.8.0&auto=format&s=95d1d5e725fc5645f5567cf5149cf8eb not downloaded yet
2026-03-29 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_front_passenger-1774634253836.jpg> (referer: None)
2026-03-29 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0018/20450018/interior_rear_seats-1774690045664.jpg> (referer: None)
2026-03-29 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0018/20450018/interior_front_seats-1774690100210.jpg> (referer: None)
2026-03-29 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_front_driver-1774781574884.jpeg> (referer: None)
2026-03-29 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_rear_passenger-1774781605256.jpeg> (referer: None)
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d09cd50>
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6995%252F16486995%252Fexterior_rear_driver-1774701408020.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_rear_driver-1774701408020.jpeg saved to cache
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa663652-c303-56e8-8587-863cb5978554
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9c7b90>
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8217%252F20098217%252Fexterior_front_passenger-1774634253836.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_front_passenger-1774634253836.jpg saved to cache
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee88e099-3114-51f3-ae60-458f5650744e
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d923f50>
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F20450018%252Finterior_rear_seats-1774690045664.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/20450018/interior_rear_seats-1774690045664.jpg saved to cache
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7cca350-039f-5425-b621-162e14a5dd2b
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f506f90>
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F20450018%252Finterior_front_seats-1774690100210.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/20450018/interior_front_seats-1774690100210.jpg saved to cache
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7cca350-039f-5425-b621-162e14a5dd2b
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f629190>
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5584%252F13365584%252Fexterior_front_driver-1774781574884.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_front_driver-1774781574884.jpeg saved to cache
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 736ead27-f4f2-5741-b43a-bd2aa50120ae
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e123610>
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5584%252F13365584%252Fexterior_rear_passenger-1774781605256.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_rear_passenger-1774781605256.jpeg saved to cache
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 736ead27-f4f2-5741-b43a-bd2aa50120ae
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9308/20429308/docs_service_history-1774702956455.jpg?ixlib=js-3.8.0&auto=format&s=bcd4e58a7e4c044266c35659bd101384> (referer: None)
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9308/20429308/interior_rear_seats-1774703735333.jpg> (referer: None)
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9308/20429308/exterior_front_passenger-1774703719856.jpg> (referer: None)
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9308/20429308/exterior_front_driver-1774699473399.jpg> (referer: None)
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9308/20429308/exterior_rear_passenger-1774699463917.jpg> (referer: None)
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9308/20429308/interior_front_seats-1774703729413.jpg> (referer: None)
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9308/20429308/exterior_rear_driver-1774703707907.jpg> (referer: None)
2026-03-29 20:09:27 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5584/13365584/interior_front_seats-1774781966217.jpeg>.
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9308/20429308/interior_boot-1774703756533.jpg> (referer: None)
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5584/13365584/wheels_front_driver-1774781837965.jpeg> (referer: None)
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5584/13365584/interior_front_seats-1774781966217.jpeg> (referer: None)
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6e7b50>
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9308%252F20429308%252Fdocs_service_history-1774702956455.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbcd4e58a7e4c044266c35659bd101384') HTTP/1.1" 204 0
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9308/20429308/docs_service_history-1774702956455.jpg?ixlib=js-3.8.0&auto=format&s=bcd4e58a7e4c044266c35659bd101384 saved to cache
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec963ed8-513b-594a-8c89-ed83dde16d3f
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d494290>
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9308%252F20429308%252Finterior_rear_seats-1774703735333.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9308/20429308/interior_rear_seats-1774703735333.jpg saved to cache
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec963ed8-513b-594a-8c89-ed83dde16d3f
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6ee190>
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9308%252F20429308%252Fexterior_front_passenger-1774703719856.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9308/20429308/exterior_front_passenger-1774703719856.jpg saved to cache
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec963ed8-513b-594a-8c89-ed83dde16d3f
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2e9310>
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9308%252F20429308%252Fexterior_front_driver-1774699473399.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9308/20429308/exterior_front_driver-1774699473399.jpg saved to cache
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec963ed8-513b-594a-8c89-ed83dde16d3f
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1cc450>
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9308%252F20429308%252Fexterior_rear_passenger-1774699463917.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9308/20429308/exterior_rear_passenger-1774699463917.jpg saved to cache
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec963ed8-513b-594a-8c89-ed83dde16d3f
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35932090>
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9308%252F20429308%252Finterior_front_seats-1774703729413.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9308/20429308/interior_front_seats-1774703729413.jpg saved to cache
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec963ed8-513b-594a-8c89-ed83dde16d3f
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2ea510>
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9308%252F20429308%252Fexterior_rear_driver-1774703707907.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9308/20429308/exterior_rear_driver-1774703707907.jpg saved to cache
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec963ed8-513b-594a-8c89-ed83dde16d3f
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d3f1590>
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9308%252F20429308%252Finterior_boot-1774703756533.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9308/20429308/interior_boot-1774703756533.jpg saved to cache
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec963ed8-513b-594a-8c89-ed83dde16d3f
2026-03-29 20:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9308/20429308/docs_service_history-1774702959085.jpg?ixlib=js-3.8.0&auto=format&s=95d1d5e725fc5645f5567cf5149cf8eb> (referer: None)
2026-03-29 20:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5584/13365584/13365584-docs_service_history-default-1774785930042.png?ixlib=js-3.8.0&auto=format&s=f21c61a3ac58a7987831aaae723ee76f> (referer: None)
2026-03-29 20:09:28 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (11806505) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5584/13365584/interior_boot-1774781762508.jpeg>.
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f689e50>
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5584%252F13365584%252Fwheels_front_driver-1774781837965.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5584/13365584/wheels_front_driver-1774781837965.jpeg saved to cache
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 736ead27-f4f2-5741-b43a-bd2aa50120ae
2026-03-29 20:09:28 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:28 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:28 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xc9h`\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06\xbd\xd2\x00\xc9^\\\x00\x00\x00\x00'
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddba090>
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5584%252F13365584%252Finterior_front_seats-1774781966217.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5584/13365584/interior_front_seats-1774781966217.jpeg saved to cache
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 736ead27-f4f2-5741-b43a-bd2aa50120ae
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e10fed0>
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9308%252F20429308%252Fdocs_service_history-1774702959085.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D95d1d5e725fc5645f5567cf5149cf8eb') HTTP/1.1" 204 0
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9308/20429308/docs_service_history-1774702959085.jpg?ixlib=js-3.8.0&auto=format&s=95d1d5e725fc5645f5567cf5149cf8eb saved to cache
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec963ed8-513b-594a-8c89-ed83dde16d3f
2026-03-29 20:09:29 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:09:29 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 32768
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4bbed0>
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_8.png HTTP/1.1" 201 0
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5584%252F13365584%252F13365584-docs_service_history-default-1774785930042.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df21c61a3ac58a7987831aaae723ee76f') HTTP/1.1" 204 0
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5584/13365584/13365584-docs_service_history-default-1774785930042.png?ixlib=js-3.8.0&auto=format&s=f21c61a3ac58a7987831aaae723ee76f saved to cache
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 736ead27-f4f2-5741-b43a-bd2aa50120ae
2026-03-29 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8829/17858829/interior_boot-1774701168226.jpg> (referer: None)
2026-03-29 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8829/17858829/docs_service_history-1774701483710.jpg?ixlib=js-3.8.0&auto=format&s=582cd11af8b831ff8f4e39bea3a2fc77> (referer: None)
2026-03-29 20:09:29 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (13268344) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5584/13365584/interior_rear_seats-1774781734090.jpeg>.
2026-03-29 20:09:29 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12180067) larger than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/5584/13365584/interior_dashboard-1774781805743.jpeg>.
2026-03-29 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9308/20429308/interior_dashboard-1774703749630.jpg> (referer: None)
2026-03-29 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6995/16486995/16486995-docs_service_history-modified-1774702981243.jpeg?ixlib=js-3.8.0&auto=format&s=e7c1acd198c07ba556466087fd29cf86> (referer: None)
2026-03-29 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6995/16486995/16486995-docs_service_history-modified-1774702964911.jpeg?ixlib=js-3.8.0&auto=format&s=ac6d7a5f0f32ad09d3ef6ca6000c470c> (referer: None)
2026-03-29 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8829/17858829/interior_rear_seats-1774701120582.jpg> (referer: None)
2026-03-29 20:09:29 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5584/13365584/interior_boot-1774781762508.jpeg>.
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc11890>
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8829%252F17858829%252Finterior_boot-1774701168226.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8829/17858829/interior_boot-1774701168226.jpg saved to cache
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1
2026-03-29 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5584/13365584/interior_boot-1774781762508.jpeg> (referer: None)
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4bbbd0>
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8829%252F17858829%252Fdocs_service_history-1774701483710.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D582cd11af8b831ff8f4e39bea3a2fc77') HTTP/1.1" 204 0
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8829/17858829/docs_service_history-1774701483710.jpg?ixlib=js-3.8.0&auto=format&s=582cd11af8b831ff8f4e39bea3a2fc77 saved to cache
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1b6690>
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9308%252F20429308%252Finterior_dashboard-1774703749630.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9308/20429308/interior_dashboard-1774703749630.jpg saved to cache
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec963ed8-513b-594a-8c89-ed83dde16d3f
2026-03-29 20:09:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec963ed8-513b-594a-8c89-ed83dde16d3f, skipping ID generation
2026-03-29 20:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec963ed8-513b-594a-8c89-ed83dde16d3f with scrape type 1
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec963ed8-513b-594a-8c89-ed83dde16d3f sending to next pipeline
2026-03-29 20:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ec963ed8-513b-594a-8c89-ed83dde16d3f, identifier: 20429308
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc11cd0>
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6995%252F16486995%252F16486995-docs_service_history-modified-1774702981243.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De7c1acd198c07ba556466087fd29cf86') HTTP/1.1" 204 0
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6995/16486995/16486995-docs_service_history-modified-1774702981243.jpeg?ixlib=js-3.8.0&auto=format&s=e7c1acd198c07ba556466087fd29cf86 saved to cache
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa663652-c303-56e8-8587-863cb5978554
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9c7450>
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6995%252F16486995%252F16486995-docs_service_history-modified-1774702964911.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dac6d7a5f0f32ad09d3ef6ca6000c470c') HTTP/1.1" 204 0
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6995/16486995/16486995-docs_service_history-modified-1774702964911.jpeg?ixlib=js-3.8.0&auto=format&s=ac6d7a5f0f32ad09d3ef6ca6000c470c saved to cache
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa663652-c303-56e8-8587-863cb5978554
2026-03-29 20:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ec963ed8-513b-594a-8c89-ed83dde16d3f with identifier: 20429308
2026-03-29 20:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ec963ed8-513b-594a-8c89-ed83dde16d3f with identifier: 20429308
2026-03-29 20:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ec963ed8-513b-594a-8c89-ed83dde16d3f with identifier: 20429308 to the API
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/9308/20429308/interior_dashboard-1774703749630.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ec963ed8-513b-594a-8c89-ed83dde16d3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC06 RUU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20429308',
'listing': 'auction',
'location': 'Windsor and Maidenhead Ascot',
'make': 'MINI',
'model': 'Cooper',
'odometer': 51654,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1407550,
'Height': 2237,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9308/20429308/exterior_front_driver-1774699473399.jpg',
'Width': 2982},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1965459,
'Height': 2232,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9308/20429308/exterior_rear_driver-1774703707907.jpg',
'Width': 2977},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1212902,
'Height': 2229,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9308/20429308/exterior_front_passenger-1774703719856.jpg',
'Width': 2972},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1526323,
'Height': 2230,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9308/20429308/exterior_rear_passenger-1774699463917.jpg',
'Width': 2973},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1821850,
'Height': 2975,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9308/20429308/interior_front_seats-1774703729413.jpg',
'Width': 3967},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1128465,
'Height': 2934,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9308/20429308/interior_rear_seats-1774703735333.jpg',
'Width': 3912},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1926055,
'Height': 2979,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9308/20429308/interior_dashboard-1774703749630.jpg',
'Width': 3972},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3084205,
'Height': 3022,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9308/20429308/interior_boot-1774703756533.jpg',
'Width': 4029},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 748489,
'Height': 2268,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9308/20429308/docs_service_history-1774702956455.jpg?ixlib=js-3.8.0&auto=format&s=bcd4e58a7e4c044266c35659bd101384',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec963ed8-513b-594a-8c89-ed83dde16d3f/ec963ed8-513b-594a-8c89-ed83dde16d3f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 726163,
'Height': 2268,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9308/20429308/docs_service_history-1774702959085.jpg?ixlib=js-3.8.0&auto=format&s=95d1d5e725fc5645f5567cf5149cf8eb',
'Width': 4032}],
'price': 2868,
'price_includes_vat': False,
'registration_date': '2006-05-24',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper S Auto',
'transmission': 'automatic',
'trim': 'S Auto',
'vin': 'WMWRE32040TJ41043',
'year': 2006}
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720429308%27 HTTP/1.1" 200 None
2026-03-29 20:09:30 [motorway.uk] INFO: Saving data for 20429308: {'created_time': 1774814970.747248, 'last_price_update_time': 1774814970.747258, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20429308') HTTP/1.1" 204 0
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4d7750>
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8829%252F17858829%252Finterior_rear_seats-1774701120582.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8829/17858829/interior_rear_seats-1774701120582.jpg saved to cache
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1
2026-03-29 20:09:30 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:30 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:30 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xab\x0b\xb5\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\t\x1bt\x00\xab\x01\xb1\x00\x00\x00\x00'
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a4b50>
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5584%252F13365584%252Finterior_boot-1774781762508.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5584/13365584/interior_boot-1774781762508.jpeg saved to cache
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 736ead27-f4f2-5741-b43a-bd2aa50120ae
2026-03-29 20:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8829/17858829/interior_front_seats-1774701031985.jpg> (referer: None)
2026-03-29 20:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8829/17858829/instrument_cluster-1774716260836.jpg> (referer: None)
2026-03-29 20:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6995/16486995/16486995-interior_front_seats-modified-1774702870538.jpeg> (referer: None)
2026-03-29 20:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8829/17858829/17858829-interior_dashboard-modified-1774702098070.jpeg> (referer: None)
2026-03-29 20:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6995/16486995/16486995-interior_dashboard-modified-1774702942711.jpeg> (referer: None)
2026-03-29 20:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6995/16486995/interior_rear_seats-1774701642474.jpeg> (referer: None)
2026-03-29 20:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6995/16486995/interior_boot-1774701599275.jpeg> (referer: None)
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d17cfd0>
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8829%252F17858829%252Finterior_front_seats-1774701031985.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8829/17858829/interior_front_seats-1774701031985.jpg saved to cache
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d7560d0>
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8829%252F17858829%252Finstrument_cluster-1774716260836.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8829/17858829/instrument_cluster-1774716260836.jpg saved to cache
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb8c4d0>
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6995%252F16486995%252F16486995-interior_front_seats-modified-1774702870538.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6995/16486995/16486995-interior_front_seats-modified-1774702870538.jpeg saved to cache
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa663652-c303-56e8-8587-863cb5978554
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f32c1d0>
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8829%252F17858829%252F17858829-interior_dashboard-modified-1774702098070.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8829/17858829/17858829-interior_dashboard-modified-1774702098070.jpeg saved to cache
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f672610>
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6995%252F16486995%252F16486995-interior_dashboard-modified-1774702942711.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6995/16486995/16486995-interior_dashboard-modified-1774702942711.jpeg saved to cache
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa663652-c303-56e8-8587-863cb5978554
2026-03-29 20:09:31 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:31 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:31 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*\xc7=\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x86 \x00*\xbc\xbb\x00\x00\x00\x00'
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f32d790>
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6995%252F16486995%252Finterior_rear_seats-1774701642474.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6995/16486995/interior_rear_seats-1774701642474.jpeg saved to cache
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa663652-c303-56e8-8587-863cb5978554
2026-03-29 20:09:31 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:31 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:31 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00=\xa7\xf0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\x80\x9a\x00=\x9dn\x00\x00\x00\x00'
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb8e010>
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6995%252F16486995%252Finterior_boot-1774701599275.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6995/16486995/interior_boot-1774701599275.jpeg saved to cache
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa663652-c303-56e8-8587-863cb5978554
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20426345.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8829/17858829/exterior_front_driver-1774701267661.jpg> (referer: None)
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8829/17858829/17858829-exterior_front_passenger-modified-1774702006536.jpeg> (referer: None)
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8829/17858829/17858829-exterior_rear_passenger-modified-1774702032529.jpeg> (referer: None)
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_front_passenger-1774781604236.jpeg> (referer: None)
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_front_driver-1774701429319.jpeg> (referer: None)
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_front_passenger-1774701388791.jpeg> (referer: None)
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_rear_passenger-1774701470135.jpeg> (referer: None)
2026-03-29 20:09:32 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5584/13365584/interior_rear_seats-1774781734090.jpeg>.
2026-03-29 20:09:32 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/5584/13365584/interior_dashboard-1774781805743.jpeg>.
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5584/13365584/interior_dashboard-1774781805743.jpeg> (referer: None)
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5584/13365584/interior_rear_seats-1774781734090.jpeg> (referer: None)
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_rear_driver-1774781609933.jpeg> (referer: None)
2026-03-29 20:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26713f57-1973-5101-8db0-acebca3f2f2e with identifier: 20426345
2026-03-29 20:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26713f57-1973-5101-8db0-acebca3f2f2e with scrape type 1
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26713f57-1973-5101-8db0-acebca3f2f2e
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6345%252F20426345%252Fexterior_front_driver-1774713646086.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_front_driver-1774713646086.jpg not downloaded yet
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6345%252F20426345%252Fexterior_rear_driver-1774713673916.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_rear_driver-1774713673916.jpg not downloaded yet
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6345%252F20426345%252Fexterior_front_passenger-1774713704489.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_front_passenger-1774713704489.jpg not downloaded yet
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce31cd0>
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8829%252F17858829%252Fexterior_front_driver-1774701267661.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8829/17858829/exterior_front_driver-1774701267661.jpg saved to cache
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1107d0>
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8829%252F17858829%252F17858829-exterior_front_passenger-modified-1774702006536.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8829/17858829/17858829-exterior_front_passenger-modified-1774702006536.jpeg saved to cache
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d49c2d0>
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8829%252F17858829%252F17858829-exterior_rear_passenger-modified-1774702032529.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8829/17858829/17858829-exterior_rear_passenger-modified-1774702032529.jpeg saved to cache
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1
2026-03-29 20:09:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1, skipping ID generation
2026-03-29 20:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1 with scrape type 1
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1 sending to next pipeline
2026-03-29 20:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1, identifier: 17858829
2026-03-29 20:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1 with identifier: 17858829
2026-03-29 20:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1 with identifier: 17858829
2026-03-29 20:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1 with identifier: 17858829 to the API
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/8829/17858829/17858829-exterior_rear_passenger-modified-1774702032529.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GN21 NNT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17858829',
'listing': 'auction',
'location': 'Derbyshire Derby',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 36600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 712383,
'Height': 2140,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8829/17858829/exterior_front_driver-1774701267661.jpg',
'Width': 2853},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 828600,
'Height': 2109,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8829/17858829/17858829-exterior_rear_driver-modified-1774701989436.jpeg',
'Width': 2812},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 821729,
'Height': 2052,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8829/17858829/17858829-exterior_front_passenger-modified-1774702006536.jpeg',
'Width': 2736},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 999293,
'Height': 2139,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8829/17858829/17858829-exterior_rear_passenger-modified-1774702032529.jpeg',
'Width': 2852},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1319268,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8829/17858829/interior_front_seats-1774701031985.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 802504,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8829/17858829/interior_rear_seats-1774701120582.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1987644,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8829/17858829/17858829-interior_dashboard-modified-1774702098070.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1005464,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8829/17858829/instrument_cluster-1774716260836.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 956529,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8829/17858829/interior_boot-1774701168226.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1/f471c4f1-e8a8-5bd3-bac7-12b9db9d0be1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1359675,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8829/17858829/docs_service_history-1774701483710.jpg?ixlib=js-3.8.0&auto=format&s=582cd11af8b831ff8f4e39bea3a2fc77',
'Width': 3060}],
'price': 19820,
'price_includes_vat': False,
'registration_date': '2021-03-08',
'seats_number': None,
'seller_name': None,
'title': 'Mazda CX-5 GT Sport AWD Auto',
'transmission': 'automatic',
'trim': 'GT Sport AWD Auto',
'vin': 'JMZKFGWMA90163387',
'year': 2021}
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717858829%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [motorway.uk] INFO: Saving data for 17858829: {'created_time': 1774814973.035222, 'last_price_update_time': 1774814973.035235, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17858829') HTTP/1.1" 204 0
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6345%252F20426345%252Fexterior_rear_passenger-1774713688657.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_rear_passenger-1774713688657.jpg not downloaded yet
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ceccc10>
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5584%252F13365584%252Fexterior_front_passenger-1774781604236.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_front_passenger-1774781604236.jpeg saved to cache
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 736ead27-f4f2-5741-b43a-bd2aa50120ae
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4e12d0>
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6995%252F16486995%252Fexterior_front_driver-1774701429319.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_front_driver-1774701429319.jpeg saved to cache
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa663652-c303-56e8-8587-863cb5978554
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e07ee10>
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6995%252F16486995%252Fexterior_front_passenger-1774701388791.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_front_passenger-1774701388791.jpeg saved to cache
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa663652-c303-56e8-8587-863cb5978554
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cacbc90>
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6995%252F16486995%252Fexterior_rear_passenger-1774701470135.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_rear_passenger-1774701470135.jpeg saved to cache
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa663652-c303-56e8-8587-863cb5978554
2026-03-29 20:09:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa663652-c303-56e8-8587-863cb5978554, skipping ID generation
2026-03-29 20:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa663652-c303-56e8-8587-863cb5978554 with scrape type 1
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa663652-c303-56e8-8587-863cb5978554 sending to next pipeline
2026-03-29 20:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: aa663652-c303-56e8-8587-863cb5978554, identifier: 16486995
2026-03-29 20:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: aa663652-c303-56e8-8587-863cb5978554 with identifier: 16486995
2026-03-29 20:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: aa663652-c303-56e8-8587-863cb5978554 with identifier: 16486995
2026-03-29 20:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: aa663652-c303-56e8-8587-863cb5978554 with identifier: 16486995 to the API
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_rear_passenger-1774701470135.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'aa663652-c303-56e8-8587-863cb5978554',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GN20 MYK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16486995',
'listing': 'auction',
'location': 'Caerphilly County Borough Blackwood',
'make': 'Ford',
'model': 'Puma',
'odometer': 46500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1310259,
'Height': 2666,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_front_driver-1774701429319.jpeg',
'Width': 3555},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1515826,
'Height': 2838,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_rear_driver-1774701408020.jpeg',
'Width': 3784},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1648927,
'Height': 2882,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_front_passenger-1774701388791.jpeg',
'Width': 3843},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1834343,
'Height': 2859,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6995/16486995/exterior_rear_passenger-1774701470135.jpeg',
'Width': 3812},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1548616,
'Height': 2444,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6995/16486995/16486995-interior_front_seats-modified-1774702870538.jpeg',
'Width': 3258},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2968925,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6995/16486995/interior_rear_seats-1774701642474.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2139990,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6995/16486995/16486995-interior_dashboard-modified-1774702942711.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4270218,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6995/16486995/interior_boot-1774701599275.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2201615,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6995/16486995/16486995-docs_service_history-modified-1774702964911.jpeg?ixlib=js-3.8.0&auto=format&s=ac6d7a5f0f32ad09d3ef6ca6000c470c',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa663652-c303-56e8-8587-863cb5978554/aa663652-c303-56e8-8587-863cb5978554_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2228572,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6995/16486995/16486995-docs_service_history-modified-1774702981243.jpeg?ixlib=js-3.8.0&auto=format&s=e7c1acd198c07ba556466087fd29cf86',
'Width': 3024}],
'price': 11353,
'price_includes_vat': False,
'registration_date': '2020-03-13',
'seats_number': None,
'seller_name': None,
'title': 'Ford Puma ST-LINE X First ED + MHEV',
'transmission': 'manual',
'trim': 'ST-LINE X First ED + MHEV',
'vin': 'WF02XXERK2LB37199',
'year': 2020}
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716486995%27 HTTP/1.1" 200 None
2026-03-29 20:09:34 [motorway.uk] INFO: Saving data for 16486995: {'created_time': 1774814974.171041, 'last_price_update_time': 1774814974.171052, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16486995') HTTP/1.1" 204 0
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6345%252F20426345%252Finterior_front_seats-1774714357210.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6345/20426345/interior_front_seats-1774714357210.jpg not downloaded yet
2026-03-29 20:09:34 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:34 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:34 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xb1h\xbc\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08q\xa7\x00\xb1^\xb8\x00\x00\x00\x00'
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d536290>
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5584%252F13365584%252Finterior_dashboard-1774781805743.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5584/13365584/interior_dashboard-1774781805743.jpeg saved to cache
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 736ead27-f4f2-5741-b43a-bd2aa50120ae
2026-03-29 20:09:34 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:34 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:34 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xc5\x08\xe5\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05l\x93\x00\xc4\xfe\xe1\x00\x00\x00\x00'
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc6c750>
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5584%252F13365584%252Finterior_rear_seats-1774781734090.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5584/13365584/interior_rear_seats-1774781734090.jpeg saved to cache
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 736ead27-f4f2-5741-b43a-bd2aa50120ae
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1274d0>
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5584%252F13365584%252Fexterior_rear_driver-1774781609933.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_rear_driver-1774781609933.jpeg saved to cache
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 736ead27-f4f2-5741-b43a-bd2aa50120ae
2026-03-29 20:09:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 736ead27-f4f2-5741-b43a-bd2aa50120ae, skipping ID generation
2026-03-29 20:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 736ead27-f4f2-5741-b43a-bd2aa50120ae with scrape type 1
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 736ead27-f4f2-5741-b43a-bd2aa50120ae sending to next pipeline
2026-03-29 20:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 736ead27-f4f2-5741-b43a-bd2aa50120ae, identifier: 13365584
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6345%252F20426345%252Finterior_rear_seats-1774714329696.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6345/20426345/interior_rear_seats-1774714329696.jpg not downloaded yet
2026-03-29 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19729177.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 736ead27-f4f2-5741-b43a-bd2aa50120ae with identifier: 13365584
2026-03-29 20:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 736ead27-f4f2-5741-b43a-bd2aa50120ae with identifier: 13365584
2026-03-29 20:09:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 736ead27-f4f2-5741-b43a-bd2aa50120ae with identifier: 13365584 to the API
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_rear_driver-1774781609933.jpeg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '736ead27-f4f2-5741-b43a-bd2aa50120ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WA69 YUR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13365584',
'listing': 'auction',
'location': 'Herefordshire Ledbury',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 57780,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4880233,
'Height': 4786,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_front_driver-1774781574884.jpeg',
'Width': 6381},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7483619,
'Height': 5812,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_rear_driver-1774781609933.jpeg',
'Width': 7749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8821243,
'Height': 6026,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_front_passenger-1774781604236.jpeg',
'Width': 8034},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6351900,
'Height': 5457,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5584/13365584/exterior_rear_passenger-1774781605256.jpeg',
'Width': 7276},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 13641266,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/5584/13365584/interior_front_seats-1774781966217.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 13268344,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/5584/13365584/interior_rear_seats-1774781734090.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 12180067,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5584/13365584/interior_dashboard-1774781805743.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 11806505,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/5584/13365584/interior_boot-1774781762508.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 58288,
'Height': 321,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5584/13365584/13365584-docs_service_history-default-1774785930042.png?ixlib=js-3.8.0&auto=format&s=f21c61a3ac58a7987831aaae723ee76f',
'Width': 720},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736ead27-f4f2-5741-b43a-bd2aa50120ae/736ead27-f4f2-5741-b43a-bd2aa50120ae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6420498,
'Height': 5993,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5584/13365584/wheels_front_driver-1774781837965.jpeg',
'Width': 7991}],
'price': 18006,
'price_includes_vat': False,
'registration_date': '2019-10-16',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery Sport R-DYNAMIC SE A',
'transmission': 'automatic',
'trim': 'Sport R-DYNAMIC SE A',
'vin': 'SALCA2AX2LH843486',
'year': 2019}
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713365584%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [motorway.uk] INFO: Saving data for 13365584: {'created_time': 1774814975.518132, 'last_price_update_time': 1774814975.518142, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13365584') HTTP/1.1" 204 0
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6345%252F20426345%252Finterior_dashboard-1774714395571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6345/20426345/interior_dashboard-1774714395571.jpg not downloaded yet
2026-03-29 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8217/20098217/docs_service_history-1774777237344.jpg?ixlib=js-3.8.0&auto=format&s=93e3430ec207c7d3afa670896313c1fc> (referer: None)
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6345%252F20426345%252Finstrument_cluster-1774714379439.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6345/20426345/instrument_cluster-1774714379439.jpg not downloaded yet
2026-03-29 20:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55dcd885-3bba-5735-b46d-db3520d32e0b with identifier: 19729177
2026-03-29 20:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55dcd885-3bba-5735-b46d-db3520d32e0b with scrape type 1
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55dcd885-3bba-5735-b46d-db3520d32e0b
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9177%252F19729177%252Fexterior_front_driver-1774772720031.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_front_driver-1774772720031.jpg not downloaded yet
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6345%252F20426345%252Finterior_boot-1774714445878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6345/20426345/interior_boot-1774714445878.jpg not downloaded yet
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9177%252F19729177%252Fexterior_rear_driver-1774772742765.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_rear_driver-1774772742765.jpg not downloaded yet
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce1bc10>
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8217%252F20098217%252Fdocs_service_history-1774777237344.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D93e3430ec207c7d3afa670896313c1fc') HTTP/1.1" 204 0
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8217/20098217/docs_service_history-1774777237344.jpg?ixlib=js-3.8.0&auto=format&s=93e3430ec207c7d3afa670896313c1fc saved to cache
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee88e099-3114-51f3-ae60-458f5650744e
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6345%252F20426345%252Fdocs_service_history-1774715086487.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dea805cdeda93d4ac651d447df48ee691%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6345/20426345/docs_service_history-1774715086487.jpg?ixlib=js-3.8.0&auto=format&s=ea805cdeda93d4ac651d447df48ee691 not downloaded yet
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9177%252F19729177%252Fexterior_front_passenger-1774772819387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_front_passenger-1774772819387.jpg not downloaded yet
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9177%252F19729177%252Fexterior_rear_passenger-1774772757759.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_rear_passenger-1774772757759.jpg not downloaded yet
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9177%252F19729177%252Finterior_front_seats-1774773089733.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9177/19729177/interior_front_seats-1774773089733.jpg not downloaded yet
2026-03-29 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_rear_driver-1774634225469.jpg> (referer: None)
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9177%252F19729177%252Finterior_rear_seats-1774773104989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9177/19729177/interior_rear_seats-1774773104989.jpg not downloaded yet
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9177%252F19729177%252Finterior_dashboard-1774773158673.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9177/19729177/interior_dashboard-1774773158673.jpg not downloaded yet
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_front_driver-1774634207262.jpg> (referer: None)
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9177%252F19729177%252Finterior_boot-1774773352996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9177/19729177/interior_boot-1774773352996.jpg not downloaded yet
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9177%252F19729177%252Fdocs_service_history-1774773465397.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De92f1a84b22d64870c2d2ca33fe2bc45%27 HTTP/1.1" 200 None
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9177/19729177/docs_service_history-1774773465397.jpg?ixlib=js-3.8.0&auto=format&s=e92f1a84b22d64870c2d2ca33fe2bc45 not downloaded yet
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db5da90>
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8217%252F20098217%252Fexterior_rear_driver-1774634225469.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_rear_driver-1774634225469.jpg saved to cache
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee88e099-3114-51f3-ae60-458f5650744e
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9177%252F19729177%252Fdocs_service_history-1774773513148.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59f375d60b5c23b3f02786ad1e7f5682%27 HTTP/1.1" 200 None
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9177/19729177/docs_service_history-1774773513148.jpg?ixlib=js-3.8.0&auto=format&s=59f375d60b5c23b3f02786ad1e7f5682 not downloaded yet
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f424410>
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8217%252F20098217%252Fexterior_front_driver-1774634207262.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_front_driver-1774634207262.jpg saved to cache
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee88e099-3114-51f3-ae60-458f5650744e
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8217/20098217/interior_dashboard-1774708894328.jpg> (referer: None)
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8217/20098217/instrument_cluster-1774708885802.jpg> (referer: None)
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_rear_driver-1774713673916.jpg> (referer: None)
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8217/20098217/interior_rear_seats-1774708867451.jpg> (referer: None)
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8217/20098217/interior_front_seats-1774708807741.jpg> (referer: None)
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_rear_passenger-1774713688657.jpg> (referer: None)
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_front_driver-1774713646086.jpg> (referer: None)
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_front_passenger-1774713704489.jpg> (referer: None)
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8217/20098217/interior_boot-1774709059667.jpg> (referer: None)
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6345/20426345/interior_dashboard-1774714395571.jpg> (referer: None)
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6345/20426345/interior_front_seats-1774714357210.jpg> (referer: None)
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6345/20426345/interior_rear_seats-1774714329696.jpg> (referer: None)
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0018/20450018/interior_boot-1774690079933.jpg> (referer: None)
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0018/20450018/damage_scratches-1774689629590.jpg> (referer: None)
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d17b990>
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8217%252F20098217%252Finterior_dashboard-1774708894328.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8217/20098217/interior_dashboard-1774708894328.jpg saved to cache
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee88e099-3114-51f3-ae60-458f5650744e
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8a0790>
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8217%252F20098217%252Finstrument_cluster-1774708885802.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8217/20098217/instrument_cluster-1774708885802.jpg saved to cache
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee88e099-3114-51f3-ae60-458f5650744e
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daa22d0>
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6345%252F20426345%252Fexterior_rear_driver-1774713673916.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_rear_driver-1774713673916.jpg saved to cache
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26713f57-1973-5101-8db0-acebca3f2f2e
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d254e10>
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8217%252F20098217%252Finterior_rear_seats-1774708867451.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8217/20098217/interior_rear_seats-1774708867451.jpg saved to cache
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee88e099-3114-51f3-ae60-458f5650744e
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc290d0>
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8217%252F20098217%252Finterior_front_seats-1774708807741.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8217/20098217/interior_front_seats-1774708807741.jpg saved to cache
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee88e099-3114-51f3-ae60-458f5650744e
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0115d0>
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6345%252F20426345%252Fexterior_rear_passenger-1774713688657.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_rear_passenger-1774713688657.jpg saved to cache
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26713f57-1973-5101-8db0-acebca3f2f2e
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4aa590>
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6345%252F20426345%252Fexterior_front_driver-1774713646086.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_front_driver-1774713646086.jpg saved to cache
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26713f57-1973-5101-8db0-acebca3f2f2e
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d255c90>
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6345%252F20426345%252Fexterior_front_passenger-1774713704489.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_front_passenger-1774713704489.jpg saved to cache
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26713f57-1973-5101-8db0-acebca3f2f2e
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d59efd0>
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8217%252F20098217%252Finterior_boot-1774709059667.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8217/20098217/interior_boot-1774709059667.jpg saved to cache
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee88e099-3114-51f3-ae60-458f5650744e
2026-03-29 20:09:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee88e099-3114-51f3-ae60-458f5650744e, skipping ID generation
2026-03-29 20:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee88e099-3114-51f3-ae60-458f5650744e with scrape type 1
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee88e099-3114-51f3-ae60-458f5650744e sending to next pipeline
2026-03-29 20:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ee88e099-3114-51f3-ae60-458f5650744e, identifier: 20098217
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f3547db10>
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6345%252F20426345%252Finterior_dashboard-1774714395571.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6345/20426345/interior_dashboard-1774714395571.jpg saved to cache
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26713f57-1973-5101-8db0-acebca3f2f2e
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d010450>
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6345%252F20426345%252Finterior_front_seats-1774714357210.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6345/20426345/interior_front_seats-1774714357210.jpg saved to cache
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26713f57-1973-5101-8db0-acebca3f2f2e
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d59cc90>
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6345%252F20426345%252Finterior_rear_seats-1774714329696.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6345/20426345/interior_rear_seats-1774714329696.jpg saved to cache
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26713f57-1973-5101-8db0-acebca3f2f2e
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4a8290>
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F20450018%252Finterior_boot-1774690079933.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/20450018/interior_boot-1774690079933.jpg saved to cache
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7cca350-039f-5425-b621-162e14a5dd2b
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd16550>
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F20450018%252Fdamage_scratches-1774689629590.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/20450018/damage_scratches-1774689629590.jpg saved to cache
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7cca350-039f-5425-b621-162e14a5dd2b
2026-03-29 20:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ee88e099-3114-51f3-ae60-458f5650744e with identifier: 20098217
2026-03-29 20:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ee88e099-3114-51f3-ae60-458f5650744e with identifier: 20098217
2026-03-29 20:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ee88e099-3114-51f3-ae60-458f5650744e with identifier: 20098217 to the API
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8217/20098217/interior_boot-1774709059667.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ee88e099-3114-51f3-ae60-458f5650744e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'PY18 CPV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20098217',
'listing': 'auction',
'location': 'West Yorkshire Liversedge',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 56000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1490738,
'Height': 2483,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_front_driver-1774634207262.jpg',
'Width': 3311},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1167805,
'Height': 2273,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_rear_driver-1774634225469.jpg',
'Width': 3030},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2308537,
'Height': 2812,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_front_passenger-1774634253836.jpg',
'Width': 3749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1444373,
'Height': 2374,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8217/20098217/exterior_rear_passenger-1774634239480.jpg',
'Width': 3165},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3535325,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8217/20098217/interior_front_seats-1774708807741.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3346382,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8217/20098217/interior_rear_seats-1774708867451.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2700847,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8217/20098217/interior_dashboard-1774708894328.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2937985,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8217/20098217/instrument_cluster-1774708885802.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4209768,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8217/20098217/interior_boot-1774709059667.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee88e099-3114-51f3-ae60-458f5650744e/ee88e099-3114-51f3-ae60-458f5650744e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1414124,
'Height': 3528,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8217/20098217/docs_service_history-1774777237344.jpg?ixlib=js-3.8.0&auto=format&s=93e3430ec207c7d3afa670896313c1fc',
'Width': 2646}],
'price': 7709,
'price_includes_vat': False,
'registration_date': '2018-06-13',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo SE',
'transmission': 'manual',
'trim': 'SE',
'vin': 'WVWZZZAWZJU018624',
'year': 2018}
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720098217%27 HTTP/1.1" 200 None
2026-03-29 20:09:38 [motorway.uk] INFO: Saving data for 20098217: {'created_time': 1774814978.948061, 'last_price_update_time': 1774814978.948073, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20098217') HTTP/1.1" 204 0
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9177/19729177/docs_service_history-1774773513148.jpg?ixlib=js-3.8.0&auto=format&s=59f375d60b5c23b3f02786ad1e7f5682> (referer: None)
2026-03-29 20:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9177/19729177/interior_dashboard-1774773158673.jpg> (referer: None)
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_rear_passenger-1774772757759.jpg> (referer: None)
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1b6e10>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9177%252F19729177%252Fdocs_service_history-1774773513148.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59f375d60b5c23b3f02786ad1e7f5682') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9177/19729177/docs_service_history-1774773513148.jpg?ixlib=js-3.8.0&auto=format&s=59f375d60b5c23b3f02786ad1e7f5682 saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55dcd885-3bba-5735-b46d-db3520d32e0b
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2df26450>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9177%252F19729177%252Finterior_dashboard-1774773158673.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9177/19729177/interior_dashboard-1774773158673.jpg saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55dcd885-3bba-5735-b46d-db3520d32e0b
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1b5050>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9177%252F19729177%252Fexterior_rear_passenger-1774772757759.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_rear_passenger-1774772757759.jpg saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55dcd885-3bba-5735-b46d-db3520d32e0b
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0018/20450018/instrument_cluster-1774783372865.jpg> (referer: None)
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_front_driver-1774689546319.jpg> (referer: None)
2026-03-29 20:09:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_front_passenger-1774772819387.jpg> (referer: None)
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_rear_passenger-1774629691668.jpg> (referer: None)
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_front_driver-1774772720031.jpg> (referer: None)
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_rear_driver-1774772742765.jpg> (referer: None)
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6345/20426345/docs_service_history-1774715086487.jpg?ixlib=js-3.8.0&auto=format&s=ea805cdeda93d4ac651d447df48ee691> (referer: None)
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0018/20450018/interior_dashboard-1774783390942.jpg> (referer: None)
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6345/20426345/instrument_cluster-1774714379439.jpg> (referer: None)
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9177/19729177/interior_boot-1774773352996.jpg> (referer: None)
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0235/16160235/interior_front_seats-1774630170284.jpg> (referer: None)
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9177/19729177/interior_rear_seats-1774773104989.jpg> (referer: None)
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9177/19729177/interior_front_seats-1774773089733.jpg> (referer: None)
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4e1410>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0018%252F20450018%252Finstrument_cluster-1774783372865.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0018/20450018/instrument_cluster-1774783372865.jpg saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7cca350-039f-5425-b621-162e14a5dd2b
2026-03-29 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6345/20426345/interior_boot-1774714445878.jpg> (referer: None)
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e07cc10>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F20450018%252Fexterior_front_driver-1774689546319.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_front_driver-1774689546319.jpg saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7cca350-039f-5425-b621-162e14a5dd2b
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca4d490>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9177%252F19729177%252Fexterior_front_passenger-1774772819387.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_front_passenger-1774772819387.jpg saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55dcd885-3bba-5735-b46d-db3520d32e0b
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da02bd0>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0235%252F16160235%252Fexterior_rear_passenger-1774629691668.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_rear_passenger-1774629691668.jpg saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40b97905-f39e-59f3-978d-8420092f23a7
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc83150>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9177%252F19729177%252Fexterior_front_driver-1774772720031.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_front_driver-1774772720031.jpg saved to cache
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55dcd885-3bba-5735-b46d-db3520d32e0b
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1eae50>
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9177%252F19729177%252Fexterior_rear_driver-1774772742765.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_rear_driver-1774772742765.jpg saved to cache
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55dcd885-3bba-5735-b46d-db3520d32e0b
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da01490>
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6345%252F20426345%252Fdocs_service_history-1774715086487.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dea805cdeda93d4ac651d447df48ee691') HTTP/1.1" 204 0
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6345/20426345/docs_service_history-1774715086487.jpg?ixlib=js-3.8.0&auto=format&s=ea805cdeda93d4ac651d447df48ee691 saved to cache
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26713f57-1973-5101-8db0-acebca3f2f2e
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1eb350>
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0018%252F20450018%252Finterior_dashboard-1774783390942.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0018/20450018/interior_dashboard-1774783390942.jpg saved to cache
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7cca350-039f-5425-b621-162e14a5dd2b
2026-03-29 20:09:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7cca350-039f-5425-b621-162e14a5dd2b, skipping ID generation
2026-03-29 20:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7cca350-039f-5425-b621-162e14a5dd2b with scrape type 1
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7cca350-039f-5425-b621-162e14a5dd2b sending to next pipeline
2026-03-29 20:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a7cca350-039f-5425-b621-162e14a5dd2b, identifier: 20450018
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1b5cd0>
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6345%252F20426345%252Finstrument_cluster-1774714379439.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6345/20426345/instrument_cluster-1774714379439.jpg saved to cache
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26713f57-1973-5101-8db0-acebca3f2f2e
2026-03-29 20:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a7cca350-039f-5425-b621-162e14a5dd2b with identifier: 20450018
2026-03-29 20:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a7cca350-039f-5425-b621-162e14a5dd2b with identifier: 20450018
2026-03-29 20:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a7cca350-039f-5425-b621-162e14a5dd2b with identifier: 20450018 to the API
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0018/20450018/interior_dashboard-1774783390942.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a7cca350-039f-5425-b621-162e14a5dd2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LY16 NHE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20450018',
'listing': 'auction',
'location': 'Greater London Hornchurch',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 82547,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1440579,
'Height': 2398,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_front_driver-1774689546319.jpg',
'Width': 3197},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2092511,
'Height': 2681,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_rear_driver-1774689556981.jpg',
'Width': 3575},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1335729,
'Height': 2124,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_front_passenger-1774689578611.jpg',
'Width': 2832},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1455110,
'Height': 2554,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0018/20450018/exterior_rear_passenger-1774689569207.jpg',
'Width': 3405},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3917203,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0018/20450018/interior_front_seats-1774690100210.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4680361,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0018/20450018/interior_rear_seats-1774690045664.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2159866,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0018/20450018/interior_dashboard-1774783390942.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 695541,
'Height': 1582,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0018/20450018/instrument_cluster-1774783372865.jpg',
'Width': 2109},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4698776,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0018/20450018/interior_boot-1774690079933.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7cca350-039f-5425-b621-162e14a5dd2b/a7cca350-039f-5425-b621-162e14a5dd2b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5011870,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0018/20450018/damage_scratches-1774689629590.jpg',
'Width': 4032}],
'price': 3794,
'price_includes_vat': False,
'registration_date': '2016-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo Match',
'transmission': 'manual',
'trim': 'Match',
'vin': 'WVWZZZ6RZGY289999',
'year': 2016}
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720450018%27 HTTP/1.1" 200 None
2026-03-29 20:09:41 [motorway.uk] INFO: Saving data for 20450018: {'created_time': 1774814981.162922, 'last_price_update_time': 1774814981.162933, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20450018') HTTP/1.1" 204 0
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9e7790>
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9177%252F19729177%252Finterior_boot-1774773352996.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9177/19729177/interior_boot-1774773352996.jpg saved to cache
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55dcd885-3bba-5735-b46d-db3520d32e0b
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce1e6d0>
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0235%252F16160235%252Finterior_front_seats-1774630170284.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0235/16160235/interior_front_seats-1774630170284.jpg saved to cache
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40b97905-f39e-59f3-978d-8420092f23a7
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d10a4d0>
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9177%252F19729177%252Finterior_rear_seats-1774773104989.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9177/19729177/interior_rear_seats-1774773104989.jpg saved to cache
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55dcd885-3bba-5735-b46d-db3520d32e0b
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f607dd0>
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9177%252F19729177%252Finterior_front_seats-1774773089733.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9177/19729177/interior_front_seats-1774773089733.jpg saved to cache
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55dcd885-3bba-5735-b46d-db3520d32e0b
2026-03-29 20:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=720&page=20&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d10b490>
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6345%252F20426345%252Finterior_boot-1774714445878.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6345/20426345/interior_boot-1774714445878.jpg saved to cache
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26713f57-1973-5101-8db0-acebca3f2f2e
2026-03-29 20:09:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26713f57-1973-5101-8db0-acebca3f2f2e, skipping ID generation
2026-03-29 20:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26713f57-1973-5101-8db0-acebca3f2f2e with scrape type 1
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26713f57-1973-5101-8db0-acebca3f2f2e sending to next pipeline
2026-03-29 20:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 26713f57-1973-5101-8db0-acebca3f2f2e, identifier: 20426345
2026-03-29 20:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 26713f57-1973-5101-8db0-acebca3f2f2e with identifier: 20426345
2026-03-29 20:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 26713f57-1973-5101-8db0-acebca3f2f2e with identifier: 20426345
2026-03-29 20:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 26713f57-1973-5101-8db0-acebca3f2f2e with identifier: 20426345 to the API
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6345/20426345/interior_boot-1774714445878.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '26713f57-1973-5101-8db0-acebca3f2f2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FA18 UUL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20426345',
'listing': 'auction',
'location': 'Buckinghamshire Great Missenden',
'make': 'BMW',
'model': 'X5',
'odometer': 72434,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2313937,
'Height': 2740,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_front_driver-1774713646086.jpg',
'Width': 3653},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1738520,
'Height': 2461,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_rear_driver-1774713673916.jpg',
'Width': 3281},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2738550,
'Height': 2831,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_front_passenger-1774713704489.jpg',
'Width': 3775},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2199577,
'Height': 2839,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6345/20426345/exterior_rear_passenger-1774713688657.jpg',
'Width': 3785},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3525764,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6345/20426345/interior_front_seats-1774714357210.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3393422,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6345/20426345/interior_rear_seats-1774714329696.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3232317,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6345/20426345/interior_dashboard-1774714395571.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2916683,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6345/20426345/instrument_cluster-1774714379439.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3807141,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6345/20426345/interior_boot-1774714445878.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26713f57-1973-5101-8db0-acebca3f2f2e/26713f57-1973-5101-8db0-acebca3f2f2e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 945276,
'Height': 3207,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6345/20426345/docs_service_history-1774715086487.jpg?ixlib=js-3.8.0&auto=format&s=ea805cdeda93d4ac651d447df48ee691',
'Width': 2373}],
'price': 19672,
'price_includes_vat': False,
'registration_date': '2018-07-28',
'seats_number': None,
'seller_name': None,
'title': 'BMW X5 xDrive 30d M Sport Auto',
'transmission': 'automatic',
'trim': 'xDrive 30d M Sport Auto',
'vin': 'WBAKS420300Y80261',
'year': 2018}
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720426345%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [motorway.uk] INFO: Saving data for 20426345: {'created_time': 1774814982.300138, 'last_price_update_time': 1774814982.300149, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20426345') HTTP/1.1" 204 0
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 19584822
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 19981352
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719981352%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [motorway.uk] INFO: Scrape type for 19981352: 1
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 14405517
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20490426
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490426%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [motorway.uk] INFO: Scrape type for 20490426: 1
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20420305
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20257737
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 18590519
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 18378231
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20357052
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720357052%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [motorway.uk] INFO: Scrape type for 20357052: 1
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20469592
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 19514188
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 19747758
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 15938519
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20215486
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720215486%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [motorway.uk] INFO: Scrape type for 20215486: 1
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20230861
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 15219874
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20429518
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720429518%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [motorway.uk] INFO: Scrape type for 20429518: 1
2026-03-29 20:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_rear_driver-1774629662899.jpg> (referer: None)
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 14732982
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 7660198
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 13648117
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713648117%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [motorway.uk] INFO: Scrape type for 13648117: 1
2026-03-29 20:09:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 17991269
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20487024
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 3181281
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 18078915
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20470010
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720470010%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [motorway.uk] INFO: Scrape type for 20470010: 1
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 19430237
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20422292
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20373984
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720373984%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [motorway.uk] INFO: Scrape type for 20373984: 1
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20471256
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20283277
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20363739
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 19842807
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 3792457
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 20423510
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720423510%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [motorway.uk] INFO: Scrape type for 20423510: 1
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 19452760
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719452760%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [motorway.uk] INFO: Scrape type for 19452760: 1
2026-03-29 20:09:42 [motorway.uk] INFO: Found listing with ID: 19601308
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca23c90>
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0235%252F16160235%252Fexterior_rear_driver-1774629662899.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_rear_driver-1774629662899.jpg saved to cache
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40b97905-f39e-59f3-978d-8420092f23a7
2026-03-29 20:09:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40b97905-f39e-59f3-978d-8420092f23a7, skipping ID generation
2026-03-29 20:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40b97905-f39e-59f3-978d-8420092f23a7 with scrape type 1
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40b97905-f39e-59f3-978d-8420092f23a7 sending to next pipeline
2026-03-29 20:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 40b97905-f39e-59f3-978d-8420092f23a7, identifier: 16160235
2026-03-29 20:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 40b97905-f39e-59f3-978d-8420092f23a7 with identifier: 16160235
2026-03-29 20:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 40b97905-f39e-59f3-978d-8420092f23a7 with identifier: 16160235
2026-03-29 20:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 40b97905-f39e-59f3-978d-8420092f23a7 with identifier: 16160235 to the API
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_rear_driver-1774629662899.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '40b97905-f39e-59f3-978d-8420092f23a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DE70 CEO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16160235',
'listing': 'auction',
'location': 'Cheshire West and Chester Chester',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 61500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1484775,
'Height': 2419,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_front_driver-1774629642390.jpg',
'Width': 3225},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1085523,
'Height': 1915,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_rear_driver-1774629662899.jpg',
'Width': 2553},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1433713,
'Height': 2245,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_front_passenger-1774629708892.jpg',
'Width': 2993},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1544211,
'Height': 2266,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0235/16160235/exterior_rear_passenger-1774629691668.jpg',
'Width': 3021},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3330587,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0235/16160235/interior_front_seats-1774630170284.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3783463,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0235/16160235/interior_rear_seats-1774630009704.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3613867,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0235/16160235/interior_dashboard-1774630045587.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2332692,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0235/16160235/instrument_cluster-1774630100569.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3313360,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0235/16160235/interior_boot-1774630046878.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b97905-f39e-59f3-978d-8420092f23a7/40b97905-f39e-59f3-978d-8420092f23a7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425511,
'Height': 1945,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0235/16160235/docs_service_history-1774630318385.jpg?ixlib=js-3.8.0&auto=format&s=4b565a51a68bf454dd9a6b18c74069d6',
'Width': 2905}],
'price': 12248,
'price_includes_vat': False,
'registration_date': '2020-09-16',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Tucson N LNE 48V MHEV CRDI 2WD',
'transmission': 'manual',
'trim': 'N LNE 48V MHEV CRDI 2WD',
'vin': 'TMAJ3817LLJ099963',
'year': 2020}
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716160235%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [motorway.uk] INFO: Saving data for 16160235: {'created_time': 1774814983.256037, 'last_price_update_time': 1774814983.256048, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16160235') HTTP/1.1" 204 0
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8326/19548326/docs_service_history-1774530903536.jpg?ixlib=js-3.8.0&auto=format&s=8d44f0a3368b73123eb8460ab56917ec> (referer: None)
2026-03-29 20:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8024/20478024/interior_dashboard-1774716751881.jpg> (referer: None)
2026-03-29 20:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9177/19729177/docs_service_history-1774773465397.jpg?ixlib=js-3.8.0&auto=format&s=e92f1a84b22d64870c2d2ca33fe2bc45> (referer: None)
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8024/20478024/instrument_cluster-1774716723358.jpg> (referer: None)
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7776/18297776/interior_rear_seats-1774717886914.jpeg> (referer: None)
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6261/20176261/instrument_cluster-1774718451658.jpg> (referer: None)
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8024/20478024/interior_rear_seats-1774716647585.jpg> (referer: None)
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8326/19548326/interior_boot-1774531033885.jpg> (referer: None)
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7776/18297776/interior_dashboard-1774717906850.jpeg> (referer: None)
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6261/20176261/interior_dashboard-1774718981570.jpg> (referer: None)
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7776/18297776/interior_boot-1774717906029.jpeg> (referer: None)
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6261/20176261/interior_rear_seats-1774718442597.jpg> (referer: None)
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6261/20176261/interior_boot-1774718597168.jpg> (referer: None)
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d10a5d0>
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74e07290-1f53-5117-b94b-aa31ebceb398/74e07290-1f53-5117-b94b-aa31ebceb398_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8326%252F19548326%252Fdocs_service_history-1774530903536.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8d44f0a3368b73123eb8460ab56917ec') HTTP/1.1" 204 0
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8326/19548326/docs_service_history-1774530903536.jpg?ixlib=js-3.8.0&auto=format&s=8d44f0a3368b73123eb8460ab56917ec saved to cache
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74e07290-1f53-5117-b94b-aa31ebceb398
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daaef10>
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cf5ba3-ca90-5e9c-80ce-b14218a3a718/37cf5ba3-ca90-5e9c-80ce-b14218a3a718_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8024%252F20478024%252Finterior_dashboard-1774716751881.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8024/20478024/interior_dashboard-1774716751881.jpg saved to cache
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37cf5ba3-ca90-5e9c-80ce-b14218a3a718
2026-03-29 20:09:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:43 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd34590>
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9177%252F19729177%252Fdocs_service_history-1774773465397.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De92f1a84b22d64870c2d2ca33fe2bc45') HTTP/1.1" 204 0
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9177/19729177/docs_service_history-1774773465397.jpg?ixlib=js-3.8.0&auto=format&s=e92f1a84b22d64870c2d2ca33fe2bc45 saved to cache
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55dcd885-3bba-5735-b46d-db3520d32e0b
2026-03-29 20:09:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55dcd885-3bba-5735-b46d-db3520d32e0b, skipping ID generation
2026-03-29 20:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55dcd885-3bba-5735-b46d-db3520d32e0b with scrape type 1
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55dcd885-3bba-5735-b46d-db3520d32e0b sending to next pipeline
2026-03-29 20:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 55dcd885-3bba-5735-b46d-db3520d32e0b, identifier: 19729177
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1c74d0>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cf5ba3-ca90-5e9c-80ce-b14218a3a718/37cf5ba3-ca90-5e9c-80ce-b14218a3a718_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8024%252F20478024%252Finstrument_cluster-1774716723358.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8024/20478024/instrument_cluster-1774716723358.jpg saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37cf5ba3-ca90-5e9c-80ce-b14218a3a718
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*\xf8\xda\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xd5`\x00*\xee\xea\x00\x00\x00\x00'
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1d4bd0>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b17d1ef7-4720-5dd5-abf5-8e9b0cba0392/b17d1ef7-4720-5dd5-abf5-8e9b0cba0392_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7776%252F18297776%252Finterior_rear_seats-1774717886914.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7776/18297776/interior_rear_seats-1774717886914.jpeg saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b17d1ef7-4720-5dd5-abf5-8e9b0cba0392
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c82ee90>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fed8ef-db1c-59d9-a15e-2d05094cf7e0/e4fed8ef-db1c-59d9-a15e-2d05094cf7e0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6261%252F20176261%252Finstrument_cluster-1774718451658.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6261/20176261/instrument_cluster-1774718451658.jpg saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4fed8ef-db1c-59d9-a15e-2d05094cf7e0
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1b1010>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cf5ba3-ca90-5e9c-80ce-b14218a3a718/37cf5ba3-ca90-5e9c-80ce-b14218a3a718_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8024%252F20478024%252Finterior_rear_seats-1774716647585.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8024/20478024/interior_rear_seats-1774716647585.jpg saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37cf5ba3-ca90-5e9c-80ce-b14218a3a718
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d281a50>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74e07290-1f53-5117-b94b-aa31ebceb398/74e07290-1f53-5117-b94b-aa31ebceb398_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8326%252F19548326%252Finterior_boot-1774531033885.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8326/19548326/interior_boot-1774531033885.jpg saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74e07290-1f53-5117-b94b-aa31ebceb398
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x006\xd1\x95\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xfa\xae\x006\xc7\xa5\x00\x00\x00\x00'
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1d6110>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b17d1ef7-4720-5dd5-abf5-8e9b0cba0392/b17d1ef7-4720-5dd5-abf5-8e9b0cba0392_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7776%252F18297776%252Finterior_dashboard-1774717906850.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7776/18297776/interior_dashboard-1774717906850.jpeg saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b17d1ef7-4720-5dd5-abf5-8e9b0cba0392
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd35f90>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fed8ef-db1c-59d9-a15e-2d05094cf7e0/e4fed8ef-db1c-59d9-a15e-2d05094cf7e0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6261%252F20176261%252Finterior_dashboard-1774718981570.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6261/20176261/interior_dashboard-1774718981570.jpg saved to cache
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4fed8ef-db1c-59d9-a15e-2d05094cf7e0
2026-03-29 20:09:45 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:45 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:45 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00>\xd5\xf1\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\xf7\x0b\x00>\xcc\x01\x00\x00\x00\x00'
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2fb890>
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b17d1ef7-4720-5dd5-abf5-8e9b0cba0392/b17d1ef7-4720-5dd5-abf5-8e9b0cba0392_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7776%252F18297776%252Finterior_boot-1774717906029.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7776/18297776/interior_boot-1774717906029.jpeg saved to cache
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b17d1ef7-4720-5dd5-abf5-8e9b0cba0392
2026-03-29 20:09:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f623490>
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fed8ef-db1c-59d9-a15e-2d05094cf7e0/e4fed8ef-db1c-59d9-a15e-2d05094cf7e0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6261%252F20176261%252Finterior_rear_seats-1774718442597.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6261/20176261/interior_rear_seats-1774718442597.jpg saved to cache
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4fed8ef-db1c-59d9-a15e-2d05094cf7e0
2026-03-29 20:09:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1b2910>
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fed8ef-db1c-59d9-a15e-2d05094cf7e0/e4fed8ef-db1c-59d9-a15e-2d05094cf7e0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6261%252F20176261%252Finterior_boot-1774718597168.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6261/20176261/interior_boot-1774718597168.jpg saved to cache
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4fed8ef-db1c-59d9-a15e-2d05094cf7e0
2026-03-29 20:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 55dcd885-3bba-5735-b46d-db3520d32e0b with identifier: 19729177
2026-03-29 20:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 55dcd885-3bba-5735-b46d-db3520d32e0b with identifier: 19729177
2026-03-29 20:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 55dcd885-3bba-5735-b46d-db3520d32e0b with identifier: 19729177 to the API
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-service-history-photos.imgix.net/redacted/oriented/9177/19729177/docs_service_history-1774773465397.jpg?ixlib=js-3.8.0&auto=format&s=e92f1a84b22d64870c2d2ca33fe2bc45>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '55dcd885-3bba-5735-b46d-db3520d32e0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DC19 EKJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19729177',
'listing': 'auction',
'location': 'North Yorkshire Pickering',
'make': 'Volvo',
'model': 'XC60',
'odometer': 74028,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1762169,
'Height': 2672,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_front_driver-1774772720031.jpg',
'Width': 3562},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1863085,
'Height': 2744,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_rear_driver-1774772742765.jpg',
'Width': 3658},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1376879,
'Height': 2413,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_front_passenger-1774772819387.jpg',
'Width': 3217},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1866299,
'Height': 2605,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9177/19729177/exterior_rear_passenger-1774772757759.jpg',
'Width': 3473},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4096913,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9177/19729177/interior_front_seats-1774773089733.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3893257,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9177/19729177/interior_rear_seats-1774773104989.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1446083,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9177/19729177/interior_dashboard-1774773158673.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3376657,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9177/19729177/interior_boot-1774773352996.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6005886,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9177/19729177/docs_service_history-1774773465397.jpg?ixlib=js-3.8.0&auto=format&s=e92f1a84b22d64870c2d2ca33fe2bc45',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dcd885-3bba-5735-b46d-db3520d32e0b/55dcd885-3bba-5735-b46d-db3520d32e0b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480820,
'Height': 1563,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9177/19729177/docs_service_history-1774773513148.jpg?ixlib=js-3.8.0&auto=format&s=59f375d60b5c23b3f02786ad1e7f5682',
'Width': 4467}],
'price': 14825,
'price_includes_vat': False,
'registration_date': '2019-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC60 Momentum T5 Auto',
'transmission': 'automatic',
'trim': 'Momentum T5 Auto',
'vin': 'YV1UZ25VDL1440596',
'year': 2019}
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719729177%27 HTTP/1.1" 200 None
2026-03-29 20:09:45 [motorway.uk] INFO: Saving data for 19729177: {'created_time': 1774814985.740532, 'last_price_update_time': 1774814985.740541, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19729177') HTTP/1.1" 204 0
2026-03-29 20:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19925177.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93300940-a8a3-5e4c-b31d-ae441bf8bbda with identifier: 19925177
2026-03-29 20:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93300940-a8a3-5e4c-b31d-ae441bf8bbda with scrape type 1
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93300940-a8a3-5e4c-b31d-ae441bf8bbda
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5177%252F19925177%252Fexterior_front_driver-1774711742695.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5177/19925177/exterior_front_driver-1774711742695.jpg not downloaded yet
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5177%252F19925177%252Fexterior_rear_driver-1774711736912.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5177/19925177/exterior_rear_driver-1774711736912.jpg not downloaded yet
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5177%252F19925177%252Fexterior_front_passenger-1774711741663.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5177/19925177/exterior_front_passenger-1774711741663.jpg not downloaded yet
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5177%252F19925177%252Fexterior_rear_passenger-1774712177049.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5177/19925177/exterior_rear_passenger-1774712177049.jpg not downloaded yet
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5177%252F19925177%252Finterior_front_seats-1774712108115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5177/19925177/interior_front_seats-1774712108115.jpg not downloaded yet
2026-03-29 20:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20429518.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5177%252F19925177%252Finterior_rear_seats-1774712230542.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5177/19925177/interior_rear_seats-1774712230542.jpg not downloaded yet
2026-03-29 20:09:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5177%252F19925177%252Finterior_dashboard-1774712138797.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5177/19925177/interior_dashboard-1774712138797.jpg not downloaded yet
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5177%252F19925177%252Finstrument_cluster-1774712154651.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5177/19925177/instrument_cluster-1774712154651.jpg not downloaded yet
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5177%252F19925177%252Finterior_boot-1774712110869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5177/19925177/interior_boot-1774712110869.jpg not downloaded yet
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5177%252F19925177%252Fdocs_service_history-1774712319145.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8c629b655319eacfe6e14bf80f50be5a%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5177/19925177/docs_service_history-1774712319145.jpg?ixlib=js-3.8.0&auto=format&s=8c629b655319eacfe6e14bf80f50be5a not downloaded yet
2026-03-29 20:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08d79551-82e8-572d-aece-ccf0d6dc3489 with identifier: 20429518
2026-03-29 20:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08d79551-82e8-572d-aece-ccf0d6dc3489 with scrape type 1
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08d79551-82e8-572d-aece-ccf0d6dc3489
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9518%252F20429518%252Fexterior_front_driver-1774631501226.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_front_driver-1774631501226.jpg not downloaded yet
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9518%252F20429518%252Fexterior_rear_driver-1774631502292.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_rear_driver-1774631502292.jpg not downloaded yet
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9518%252F20429518%252Fexterior_front_passenger-1774631500525.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_front_passenger-1774631500525.jpg not downloaded yet
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9518%252F20429518%252Fexterior_rear_passenger-1774631498377.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_rear_passenger-1774631498377.jpg not downloaded yet
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9518%252F20429518%252Finterior_front_seats-1774632640042.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9518/20429518/interior_front_seats-1774632640042.jpg not downloaded yet
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9518%252F20429518%252Finterior_rear_seats-1774632638162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9518/20429518/interior_rear_seats-1774632638162.jpg not downloaded yet
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9518%252F20429518%252Finterior_dashboard-1774638851270.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9518/20429518/interior_dashboard-1774638851270.jpg not downloaded yet
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9518%252F20429518%252Finstrument_cluster-1774632618661.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9518/20429518/instrument_cluster-1774632618661.jpg not downloaded yet
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9518%252F20429518%252Finterior_boot-1774632640850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9518/20429518/interior_boot-1774632640850.jpg not downloaded yet
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9518%252F20429518%252Fdocs_service_history-1774634462684.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0424c506d4bb287fa9dd1723461e143b%27 HTTP/1.1" 200 None
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9518/20429518/docs_service_history-1774634462684.jpg?ixlib=js-3.8.0&auto=format&s=0424c506d4bb287fa9dd1723461e143b not downloaded yet
2026-03-29 20:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8326/19548326/instrument_cluster-1774530622124.jpg> (referer: None)
2026-03-29 20:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8024/20478024/interior_front_seats-1774716631350.jpg> (referer: None)
2026-03-29 20:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7776/18297776/interior_front_seats-1774717865951.jpeg> (referer: None)
2026-03-29 20:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6261/20176261/interior_front_seats-1774718384522.jpg> (referer: None)
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9268d0>
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74e07290-1f53-5117-b94b-aa31ebceb398/74e07290-1f53-5117-b94b-aa31ebceb398_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8326%252F19548326%252Finstrument_cluster-1774530622124.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8326/19548326/instrument_cluster-1774530622124.jpg saved to cache
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74e07290-1f53-5117-b94b-aa31ebceb398
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2f4390>
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cf5ba3-ca90-5e9c-80ce-b14218a3a718/37cf5ba3-ca90-5e9c-80ce-b14218a3a718_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8024%252F20478024%252Finterior_front_seats-1774716631350.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8024/20478024/interior_front_seats-1774716631350.jpg saved to cache
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37cf5ba3-ca90-5e9c-80ce-b14218a3a718
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x005 \xc0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x1d\x8f\x005\x16\xd0\x00\x00\x00\x00'
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6524d0>
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b17d1ef7-4720-5dd5-abf5-8e9b0cba0392/b17d1ef7-4720-5dd5-abf5-8e9b0cba0392_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7776%252F18297776%252Finterior_front_seats-1774717865951.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7776/18297776/interior_front_seats-1774717865951.jpeg saved to cache
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b17d1ef7-4720-5dd5-abf5-8e9b0cba0392
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d924b50>
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fed8ef-db1c-59d9-a15e-2d05094cf7e0/e4fed8ef-db1c-59d9-a15e-2d05094cf7e0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6261%252F20176261%252Finterior_front_seats-1774718384522.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6261/20176261/interior_front_seats-1774718384522.jpg saved to cache
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4fed8ef-db1c-59d9-a15e-2d05094cf7e0
2026-03-29 20:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5177/19925177/interior_front_seats-1774712108115.jpg> (referer: None)
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daf1f90>
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93300940-a8a3-5e4c-b31d-ae441bf8bbda/93300940-a8a3-5e4c-b31d-ae441bf8bbda_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5177%252F19925177%252Finterior_front_seats-1774712108115.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5177/19925177/interior_front_seats-1774712108115.jpg saved to cache
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93300940-a8a3-5e4c-b31d-ae441bf8bbda
2026-03-29 20:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9518/20429518/instrument_cluster-1774632618661.jpg> (referer: None)
2026-03-29 20:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9518/20429518/interior_boot-1774632640850.jpg> (referer: None)
2026-03-29 20:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9518/20429518/interior_rear_seats-1774632638162.jpg> (referer: None)
2026-03-29 20:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9518/20429518/docs_service_history-1774634462684.jpg?ixlib=js-3.8.0&auto=format&s=0424c506d4bb287fa9dd1723461e143b> (referer: None)
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d650910>
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9518%252F20429518%252Finstrument_cluster-1774632618661.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9518/20429518/instrument_cluster-1774632618661.jpg saved to cache
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08d79551-82e8-572d-aece-ccf0d6dc3489
2026-03-29 20:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=756&page=21&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c735a90>
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9518%252F20429518%252Finterior_boot-1774632640850.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9518/20429518/interior_boot-1774632640850.jpg saved to cache
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08d79551-82e8-572d-aece-ccf0d6dc3489
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daf3e90>
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9518%252F20429518%252Finterior_rear_seats-1774632638162.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9518/20429518/interior_rear_seats-1774632638162.jpg saved to cache
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08d79551-82e8-572d-aece-ccf0d6dc3489
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8e4190>
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9518%252F20429518%252Fdocs_service_history-1774634462684.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0424c506d4bb287fa9dd1723461e143b') HTTP/1.1" 204 0
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9518/20429518/docs_service_history-1774634462684.jpg?ixlib=js-3.8.0&auto=format&s=0424c506d4bb287fa9dd1723461e143b saved to cache
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08d79551-82e8-572d-aece-ccf0d6dc3489
2026-03-29 20:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:47 [motorway.uk] INFO: Found listing with ID: 19444118
2026-03-29 20:09:47 [motorway.uk] INFO: Found listing with ID: 20486974
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486974%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [motorway.uk] INFO: Scrape type for 20486974: 1
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20486509
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 14040355
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 17809843
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20270906
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 9667311
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 19797838
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20486919
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20406062
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 18135215
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718135215%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [motorway.uk] INFO: Scrape type for 18135215: 2
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9518/20429518/interior_dashboard-1774638851270.jpg> (referer: None)
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20348082
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720348082%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [motorway.uk] INFO: Scrape type for 20348082: 1
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 19815321
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 18899297
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20382953
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 15048808
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20376604
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 19669683
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719669683%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [motorway.uk] INFO: Scrape type for 19669683: 0
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 16614089
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20281844
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20472398
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720472398%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [motorway.uk] INFO: Scrape type for 20472398: 1
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20463285
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720463285%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [motorway.uk] INFO: Scrape type for 20463285: 1
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 10521418
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20325744
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 7322331
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 6590662
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 12561164
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20346563
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 18746892
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 18935928
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718935928%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [motorway.uk] INFO: Scrape type for 18935928: 1
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e113010>
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9518%252F20429518%252Finterior_dashboard-1774638851270.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9518/20429518/interior_dashboard-1774638851270.jpg saved to cache
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08d79551-82e8-572d-aece-ccf0d6dc3489
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 11445648
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711445648%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [motorway.uk] INFO: Scrape type for 11445648: 1
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20471200
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20259315
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 18569454
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 19681726
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719681726%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [motorway.uk] INFO: Scrape type for 19681726: 1
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_rear_passenger-1774631498377.jpg> (referer: None)
2026-03-29 20:09:48 [motorway.uk] INFO: Found listing with ID: 20483853
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_front_driver-1774631501226.jpg> (referer: None)
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9518/20429518/interior_front_seats-1774632640042.jpg> (referer: None)
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_rear_driver-1774631502292.jpg> (referer: None)
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d58c990>
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9518%252F20429518%252Fexterior_rear_passenger-1774631498377.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_rear_passenger-1774631498377.jpg saved to cache
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08d79551-82e8-572d-aece-ccf0d6dc3489
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20215486.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d650410>
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9518%252F20429518%252Fexterior_front_driver-1774631501226.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_front_driver-1774631501226.jpg saved to cache
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08d79551-82e8-572d-aece-ccf0d6dc3489
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd50d90>
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9518%252F20429518%252Finterior_front_seats-1774632640042.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9518/20429518/interior_front_seats-1774632640042.jpg saved to cache
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08d79551-82e8-572d-aece-ccf0d6dc3489
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd51e90>
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9518%252F20429518%252Fexterior_rear_driver-1774631502292.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_rear_driver-1774631502292.jpg saved to cache
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08d79551-82e8-572d-aece-ccf0d6dc3489
2026-03-29 20:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6340f643-74f9-50c8-87fa-aa4c9342102b with identifier: 20215486
2026-03-29 20:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6340f643-74f9-50c8-87fa-aa4c9342102b with scrape type 1
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6340f643-74f9-50c8-87fa-aa4c9342102b
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5486%252F20215486%252Fexterior_front_driver-1774706396152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5486/20215486/exterior_front_driver-1774706396152.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5486%252F20215486%252Fexterior_rear_driver-1774706360769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5486/20215486/exterior_rear_driver-1774706360769.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5486%252F20215486%252Fexterior_front_passenger-1774706316499.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5486/20215486/exterior_front_passenger-1774706316499.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5486%252F20215486%252Fexterior_rear_passenger-1774706347188.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5486/20215486/exterior_rear_passenger-1774706347188.jpg not downloaded yet
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_front_passenger-1774631500525.jpg> (referer: None)
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5486%252F20215486%252Finterior_front_seats-1774706690045.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5486/20215486/interior_front_seats-1774706690045.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5486%252F20215486%252Finterior_rear_seats-1774706653988.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5486/20215486/interior_rear_seats-1774706653988.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5486%252F20215486%252Finterior_dashboard-1774706653742.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5486/20215486/interior_dashboard-1774706653742.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5486%252F20215486%252F20215486-instrument_cluster-modified-1774779414371.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5486/20215486/20215486-instrument_cluster-modified-1774779414371.jpeg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5486%252F20215486%252Finterior_boot-1774706616507.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5486/20215486/interior_boot-1774706616507.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5486%252F20215486%252Fwheels_front_driver-1774706447751.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5486/20215486/wheels_front_driver-1774706447751.jpg not downloaded yet
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20423510.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d945cd0>
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9518%252F20429518%252Fexterior_front_passenger-1774631500525.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_front_passenger-1774631500525.jpg saved to cache
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08d79551-82e8-572d-aece-ccf0d6dc3489
2026-03-29 20:09:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08d79551-82e8-572d-aece-ccf0d6dc3489, skipping ID generation
2026-03-29 20:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08d79551-82e8-572d-aece-ccf0d6dc3489 with scrape type 1
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08d79551-82e8-572d-aece-ccf0d6dc3489 sending to next pipeline
2026-03-29 20:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 08d79551-82e8-572d-aece-ccf0d6dc3489, identifier: 20429518
2026-03-29 20:09:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 08d79551-82e8-572d-aece-ccf0d6dc3489 with identifier: 20429518
2026-03-29 20:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 08d79551-82e8-572d-aece-ccf0d6dc3489 with identifier: 20429518
2026-03-29 20:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 08d79551-82e8-572d-aece-ccf0d6dc3489 with identifier: 20429518 to the API
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_front_passenger-1774631500525.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '08d79551-82e8-572d-aece-ccf0d6dc3489',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HJ17 EVW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20429518',
'listing': 'auction',
'location': 'Dorset Poole',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 14823,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1194276,
'Height': 2145,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_front_driver-1774631501226.jpg',
'Width': 2860},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1070115,
'Height': 2141,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_rear_driver-1774631502292.jpg',
'Width': 2854},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1447401,
'Height': 2348,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_front_passenger-1774631500525.jpg',
'Width': 3131},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1293158,
'Height': 2266,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9518/20429518/exterior_rear_passenger-1774631498377.jpg',
'Width': 3021},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2457283,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9518/20429518/interior_front_seats-1774632640042.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2266797,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9518/20429518/interior_rear_seats-1774632638162.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1812559,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9518/20429518/interior_dashboard-1774638851270.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1478584,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9518/20429518/instrument_cluster-1774632618661.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2024460,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9518/20429518/interior_boot-1774632640850.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d79551-82e8-572d-aece-ccf0d6dc3489/08d79551-82e8-572d-aece-ccf0d6dc3489_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1065049,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9518/20429518/docs_service_history-1774634462684.jpg?ixlib=js-3.8.0&auto=format&s=0424c506d4bb287fa9dd1723461e143b',
'Width': 3840}],
'price': 8276,
'price_includes_vat': False,
'registration_date': '2017-03-28',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Yaris Icon VVT-i',
'transmission': 'manual',
'trim': 'Icon VVT-i',
'vin': 'VNKKJ3D370A424112',
'year': 2017}
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720429518%27 HTTP/1.1" 200 None
2026-03-29 20:09:49 [motorway.uk] INFO: Saving data for 20429518: {'created_time': 1774814989.683665, 'last_price_update_time': 1774814989.683676, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20429518') HTTP/1.1" 204 0
2026-03-29 20:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20470010.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f52d6585-3816-50c5-b5ff-56e8cad48218 with identifier: 20423510
2026-03-29 20:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f52d6585-3816-50c5-b5ff-56e8cad48218 with scrape type 1
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f52d6585-3816-50c5-b5ff-56e8cad48218
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3510%252F20423510%252Fexterior_front_driver-1774699206471.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3510/20423510/exterior_front_driver-1774699206471.jpg not downloaded yet
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3510%252F20423510%252Fexterior_rear_driver-1774699351790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3510/20423510/exterior_rear_driver-1774699351790.jpg not downloaded yet
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3510%252F20423510%252Fexterior_front_passenger-1774699261046.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3510/20423510/exterior_front_passenger-1774699261046.jpg not downloaded yet
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3510%252F20423510%252Fexterior_rear_passenger-1774699313391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3510/20423510/exterior_rear_passenger-1774699313391.jpg not downloaded yet
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3510%252F20423510%252Finterior_front_seats-1774700179213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3510/20423510/interior_front_seats-1774700179213.jpg not downloaded yet
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3510%252F20423510%252Finterior_rear_seats-1774700190513.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3510/20423510/interior_rear_seats-1774700190513.jpg not downloaded yet
2026-03-29 20:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15e87498-62ad-5ac3-8d20-22c5781c71ff with identifier: 20470010
2026-03-29 20:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15e87498-62ad-5ac3-8d20-22c5781c71ff with scrape type 1
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15e87498-62ad-5ac3-8d20-22c5781c71ff
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0010%252F20470010%252Fexterior_front_driver-1774703527915.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0010/20470010/exterior_front_driver-1774703527915.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3510%252F20423510%252Finterior_dashboard-1774700606186.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3510/20423510/interior_dashboard-1774700606186.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0010%252F20470010%252Fexterior_rear_driver-1774703541775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0010/20470010/exterior_rear_driver-1774703541775.jpg not downloaded yet
2026-03-29 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17809359.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3510%252F20423510%252Finterior_boot-1774700563072.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3510/20423510/interior_boot-1774700563072.jpg not downloaded yet
2026-03-29 20:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19452760.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5486/20215486/exterior_front_passenger-1774706316499.jpg> (referer: None)
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0010%252F20470010%252Fexterior_front_passenger-1774705146216.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0010/20470010/exterior_front_passenger-1774705146216.jpg not downloaded yet
2026-03-29 20:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3510%252F20423510%252Fdocs_service_history-1774700862307.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D25d80a7cb4a6e9518e1ef805f3088c5b%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3510/20423510/docs_service_history-1774700862307.jpg?ixlib=js-3.8.0&auto=format&s=25d80a7cb4a6e9518e1ef805f3088c5b not downloaded yet
2026-03-29 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20373984.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0010%252F20470010%252Fexterior_rear_passenger-1774705104834.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0010/20470010/exterior_rear_passenger-1774705104834.jpg not downloaded yet
2026-03-29 20:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3510%252F20423510%252Fdocs_service_history-1774700900075.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc1d43eec231bea130485c6d58f4149be%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3510/20423510/docs_service_history-1774700900075.jpg?ixlib=js-3.8.0&auto=format&s=c1d43eec231bea130485c6d58f4149be not downloaded yet
2026-03-29 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13648117.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0010%252F20470010%252Finterior_front_seats-1774705579741.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0010/20470010/interior_front_seats-1774705579741.jpg not downloaded yet
2026-03-29 20:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19aebffe-f908-5142-a575-bf77ded191a2 with identifier: 17809359
2026-03-29 20:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19aebffe-f908-5142-a575-bf77ded191a2 with scrape type 1
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19aebffe-f908-5142-a575-bf77ded191a2
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9359%252F17809359%252Fexterior_front_driver-1774443135397.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9359/17809359/exterior_front_driver-1774443135397.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0010%252F20470010%252Finterior_rear_seats-1774705591995.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0010/20470010/interior_rear_seats-1774705591995.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9359%252F17809359%252Fexterior_rear_driver-1774443149505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9359/17809359/exterior_rear_driver-1774443149505.jpg not downloaded yet
2026-03-29 20:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cb91678-c081-5024-b5af-9115479498ca with identifier: 19452760
2026-03-29 20:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cb91678-c081-5024-b5af-9115479498ca with scrape type 1
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5cb91678-c081-5024-b5af-9115479498ca
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2760%252F19452760%252Fexterior_front_driver-1774703780891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2760/19452760/exterior_front_driver-1774703780891.jpg not downloaded yet
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd51610>
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6340f643-74f9-50c8-87fa-aa4c9342102b/6340f643-74f9-50c8-87fa-aa4c9342102b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5486%252F20215486%252Fexterior_front_passenger-1774706316499.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5486/20215486/exterior_front_passenger-1774706316499.jpg saved to cache
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6340f643-74f9-50c8-87fa-aa4c9342102b
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0010%252F20470010%252Finterior_dashboard-1774705638115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0010/20470010/interior_dashboard-1774705638115.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9359%252F17809359%252Fexterior_front_passenger-1774443188675.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9359/17809359/exterior_front_passenger-1774443188675.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2760%252F19452760%252Fexterior_rear_driver-1774703801899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2760/19452760/exterior_rear_driver-1774703801899.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0010%252F20470010%252Finstrument_cluster-1774705839872.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0010/20470010/instrument_cluster-1774705839872.jpg not downloaded yet
2026-03-29 20:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ced4691-8f6d-5ea4-b801-d906708ec437 with identifier: 20373984
2026-03-29 20:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ced4691-8f6d-5ea4-b801-d906708ec437 with scrape type 1
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ced4691-8f6d-5ea4-b801-d906708ec437
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3984%252F20373984%252Fexterior_front_driver-1774633316553.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3984/20373984/exterior_front_driver-1774633316553.jpg not downloaded yet
2026-03-29 20:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff19882-7ddc-50fe-9399-10a6068f174d with identifier: 13648117
2026-03-29 20:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ff19882-7ddc-50fe-9399-10a6068f174d with scrape type 1
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ff19882-7ddc-50fe-9399-10a6068f174d
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8117%252F13648117%252Fexterior_front_driver-1774700304765.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8117/13648117/exterior_front_driver-1774700304765.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9359%252F17809359%252Fexterior_rear_passenger-1774443168441.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9359/17809359/exterior_rear_passenger-1774443168441.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2760%252F19452760%252Fexterior_front_passenger-1774703847313.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2760/19452760/exterior_front_passenger-1774703847313.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0010%252F20470010%252Finterior_boot-1774705660127.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0010/20470010/interior_boot-1774705660127.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3984%252F20373984%252Fexterior_rear_driver-1774702884198.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3984/20373984/exterior_rear_driver-1774702884198.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8117%252F13648117%252Fexterior_rear_driver-1774700328020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8117/13648117/exterior_rear_driver-1774700328020.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9359%252F17809359%252Finterior_front_seats-1774453463952.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9359/17809359/interior_front_seats-1774453463952.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2760%252F19452760%252Fexterior_rear_passenger-1774703825174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2760/19452760/exterior_rear_passenger-1774703825174.jpg not downloaded yet
2026-03-29 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5486/20215486/wheels_front_driver-1774706447751.jpg> (referer: None)
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0010%252F20470010%252Fdocs_service_history-1774723458820.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D69ee283f11843fb50cf3b02925282ace%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0010/20470010/docs_service_history-1774723458820.jpg?ixlib=js-3.8.0&auto=format&s=69ee283f11843fb50cf3b02925282ace not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3984%252F20373984%252Fexterior_front_passenger-1774700433238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3984/20373984/exterior_front_passenger-1774700433238.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8117%252F13648117%252Fexterior_front_passenger-1774700362378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8117/13648117/exterior_front_passenger-1774700362378.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9359%252F17809359%252Finterior_dashboard-1774443563622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9359/17809359/interior_dashboard-1774443563622.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2760%252F19452760%252Finterior_front_seats-1774712046932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2760/19452760/interior_front_seats-1774712046932.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3984%252F20373984%252Fexterior_rear_passenger-1774633350525.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3984/20373984/exterior_rear_passenger-1774633350525.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8117%252F13648117%252Fexterior_rear_passenger-1774700338688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8117/13648117/exterior_rear_passenger-1774700338688.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9359%252F17809359%252Finterior_boot-1774443522133.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9359/17809359/interior_boot-1774443522133.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2760%252F19452760%252Finterior_rear_seats-1774712096256.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2760/19452760/interior_rear_seats-1774712096256.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3984%252F20373984%252Finterior_front_seats-1774633945917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3984/20373984/interior_front_seats-1774633945917.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8117%252F13648117%252Finterior_front_seats-1774709518083.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8117/13648117/interior_front_seats-1774709518083.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9359%252F17809359%252Fdamage_scratches-1774443237257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9359/17809359/damage_scratches-1774443237257.jpg not downloaded yet
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2760%252F19452760%252Finterior_dashboard-1774717425474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2760/19452760/interior_dashboard-1774717425474.jpg not downloaded yet
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a3650>
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6340f643-74f9-50c8-87fa-aa4c9342102b/6340f643-74f9-50c8-87fa-aa4c9342102b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5486%252F20215486%252Fwheels_front_driver-1774706447751.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5486/20215486/wheels_front_driver-1774706447751.jpg saved to cache
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6340f643-74f9-50c8-87fa-aa4c9342102b
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3984%252F20373984%252Finterior_dashboard-1774700457990.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3984/20373984/interior_dashboard-1774700457990.jpg not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8117%252F13648117%252Finterior_rear_seats-1774709530961.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8117/13648117/interior_rear_seats-1774709530961.jpg not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9359%252F17809359%252Fdamage_scratches-1774443277407.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9359/17809359/damage_scratches-1774443277407.jpg not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2760%252F19452760%252Finstrument_cluster-1774717432241.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2760/19452760/instrument_cluster-1774717432241.jpg not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3984%252F20373984%252Finstrument_cluster-1774634033624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3984/20373984/instrument_cluster-1774634033624.jpg not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8117%252F13648117%252Finterior_dashboard-1774709553991.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8117/13648117/interior_dashboard-1774709553991.jpg not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9359%252F17809359%252Fdamage_scratches-1774443299537.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9359/17809359/damage_scratches-1774443299537.jpg not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2760%252F19452760%252Finterior_boot-1774712213213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2760/19452760/interior_boot-1774712213213.jpg not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3984%252F20373984%252Finterior_boot-1774633993529.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3984/20373984/interior_boot-1774633993529.jpg not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8117%252F13648117%252Finstrument_cluster-1774701087029.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8117/13648117/instrument_cluster-1774701087029.jpg not downloaded yet
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0010/20470010/exterior_front_driver-1774703527915.jpg> (referer: None)
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3510/20423510/docs_service_history-1774700862307.jpg?ixlib=js-3.8.0&auto=format&s=25d80a7cb4a6e9518e1ef805f3088c5b> (referer: None)
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2760%252F19452760%252Fdocs_service_history-1774715849414.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5a89d89d06c183a22f48bc29b6fec92d%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2760/19452760/docs_service_history-1774715849414.png?ixlib=js-3.8.0&auto=format&s=5a89d89d06c183a22f48bc29b6fec92d not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3984%252F20373984%252Fdocs_service_history-1774634350907.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8fcfe5d7ec02613425c9d98d1f0e8a97%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3984/20373984/docs_service_history-1774634350907.jpg?ixlib=js-3.8.0&auto=format&s=8fcfe5d7ec02613425c9d98d1f0e8a97 not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8117%252F13648117%252Finterior_boot-1774701036370.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8117/13648117/interior_boot-1774701036370.jpg not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3984%252F20373984%252Fdocs_service_history-1774702903569.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9786fe2af51f568041b374d4a6739e7e%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3984/20373984/docs_service_history-1774702903569.jpg?ixlib=js-3.8.0&auto=format&s=9786fe2af51f568041b374d4a6739e7e not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8117%252F13648117%252Fdocs_service_history-1774701669182.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da4c3f075cb9565bc9a54f218245a1181%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8117/13648117/docs_service_history-1774701669182.jpg?ixlib=js-3.8.0&auto=format&s=a4c3f075cb9565bc9a54f218245a1181 not downloaded yet
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0010/20470010/exterior_rear_passenger-1774705104834.jpg> (referer: None)
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f48b8d0>
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15e87498-62ad-5ac3-8d20-22c5781c71ff/15e87498-62ad-5ac3-8d20-22c5781c71ff_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0010%252F20470010%252Fexterior_front_driver-1774703527915.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0010/20470010/exterior_front_driver-1774703527915.jpg saved to cache
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15e87498-62ad-5ac3-8d20-22c5781c71ff
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e103690>
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f52d6585-3816-50c5-b5ff-56e8cad48218/f52d6585-3816-50c5-b5ff-56e8cad48218_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3510%252F20423510%252Fdocs_service_history-1774700862307.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D25d80a7cb4a6e9518e1ef805f3088c5b') HTTP/1.1" 204 0
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3510/20423510/docs_service_history-1774700862307.jpg?ixlib=js-3.8.0&auto=format&s=25d80a7cb4a6e9518e1ef805f3088c5b saved to cache
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f52d6585-3816-50c5-b5ff-56e8cad48218
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cacd590>
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15e87498-62ad-5ac3-8d20-22c5781c71ff/15e87498-62ad-5ac3-8d20-22c5781c71ff_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0010%252F20470010%252Fexterior_rear_passenger-1774705104834.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0010/20470010/exterior_rear_passenger-1774705104834.jpg saved to cache
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15e87498-62ad-5ac3-8d20-22c5781c71ff
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3510/20423510/interior_dashboard-1774700606186.jpg> (referer: None)
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20357052.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0010/20470010/exterior_rear_driver-1774703541775.jpg> (referer: None)
2026-03-29 20:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8117/13648117/exterior_rear_driver-1774700328020.jpg> (referer: None)
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5486/20215486/interior_boot-1774706616507.jpg> (referer: None)
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8117/13648117/instrument_cluster-1774701087029.jpg> (referer: None)
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490426.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6aed50>
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f52d6585-3816-50c5-b5ff-56e8cad48218/f52d6585-3816-50c5-b5ff-56e8cad48218_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3510%252F20423510%252Finterior_dashboard-1774700606186.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3510/20423510/interior_dashboard-1774700606186.jpg saved to cache
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f52d6585-3816-50c5-b5ff-56e8cad48218
2026-03-29 20:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a44d30-bdcb-5e22-a706-e615b984bf7b with identifier: 20357052
2026-03-29 20:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a44d30-bdcb-5e22-a706-e615b984bf7b with scrape type 1
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76a44d30-bdcb-5e22-a706-e615b984bf7b
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7052%252F20357052%252Fexterior_front_driver-1773994590704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7052/20357052/exterior_front_driver-1773994590704.jpg not downloaded yet
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c7350>
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15e87498-62ad-5ac3-8d20-22c5781c71ff/15e87498-62ad-5ac3-8d20-22c5781c71ff_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0010%252F20470010%252Fexterior_rear_driver-1774703541775.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0010/20470010/exterior_rear_driver-1774703541775.jpg saved to cache
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15e87498-62ad-5ac3-8d20-22c5781c71ff
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7aaa50>
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ff19882-7ddc-50fe-9399-10a6068f174d/1ff19882-7ddc-50fe-9399-10a6068f174d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8117%252F13648117%252Fexterior_rear_driver-1774700328020.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8117/13648117/exterior_rear_driver-1774700328020.jpg saved to cache
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ff19882-7ddc-50fe-9399-10a6068f174d
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d217f50>
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6340f643-74f9-50c8-87fa-aa4c9342102b/6340f643-74f9-50c8-87fa-aa4c9342102b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5486%252F20215486%252Finterior_boot-1774706616507.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5486/20215486/interior_boot-1774706616507.jpg saved to cache
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6340f643-74f9-50c8-87fa-aa4c9342102b
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7a8d10>
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ff19882-7ddc-50fe-9399-10a6068f174d/1ff19882-7ddc-50fe-9399-10a6068f174d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8117%252F13648117%252Finstrument_cluster-1774701087029.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8117/13648117/instrument_cluster-1774701087029.jpg saved to cache
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ff19882-7ddc-50fe-9399-10a6068f174d
2026-03-29 20:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f with identifier: 20490426
2026-03-29 20:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f with scrape type 1
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0426%252F20490426%252Fexterior_front_driver-1774710014869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0426/20490426/exterior_front_driver-1774710014869.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7052%252F20357052%252Fexterior_rear_driver-1773994563398.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7052/20357052/exterior_rear_driver-1773994563398.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0426%252F20490426%252Fexterior_rear_driver-1774710031660.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0426/20490426/exterior_rear_driver-1774710031660.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7052%252F20357052%252Fexterior_front_passenger-1773994526125.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7052/20357052/exterior_front_passenger-1773994526125.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0426%252F20490426%252Fexterior_front_passenger-1774710160552.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0426/20490426/exterior_front_passenger-1774710160552.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7052%252F20357052%252Fexterior_rear_passenger-1773994547598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7052/20357052/exterior_rear_passenger-1773994547598.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0426%252F20490426%252Fexterior_rear_passenger-1774710026700.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0426/20490426/exterior_rear_passenger-1774710026700.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7052%252F20357052%252Finterior_front_seats-1774783323535.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7052/20357052/interior_front_seats-1774783323535.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0426%252F20490426%252Finterior_front_seats-1774710592091.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0426/20490426/interior_front_seats-1774710592091.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7052%252F20357052%252Finterior_rear_seats-1773996091493.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7052/20357052/interior_rear_seats-1773996091493.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0426%252F20490426%252Finterior_rear_seats-1774710613612.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0426/20490426/interior_rear_seats-1774710613612.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7052%252F20357052%252Finterior_dashboard-1774782830085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7052/20357052/interior_dashboard-1774782830085.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0426%252F20490426%252Finterior_dashboard-1774710648154.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0426/20490426/interior_dashboard-1774710648154.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7052%252F20357052%252Finstrument_cluster-1773996125893.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7052/20357052/instrument_cluster-1773996125893.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0426%252F20490426%252Finstrument_cluster-1774710689404.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0426/20490426/instrument_cluster-1774710689404.jpg not downloaded yet
2026-03-29 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19981352.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3984/20373984/docs_service_history-1774702903569.jpg?ixlib=js-3.8.0&auto=format&s=9786fe2af51f568041b374d4a6739e7e> (referer: None)
2026-03-29 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19681726.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3984/20373984/interior_boot-1774633993529.jpg> (referer: None)
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7052%252F20357052%252Finterior_boot-1774785342948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7052/20357052/interior_boot-1774785342948.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0426%252F20490426%252Finterior_boot-1774710653575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0426/20490426/interior_boot-1774710653575.jpg not downloaded yet
2026-03-29 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3984/20373984/docs_service_history-1774634350907.jpg?ixlib=js-3.8.0&auto=format&s=8fcfe5d7ec02613425c9d98d1f0e8a97> (referer: None)
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7052%252F20357052%252Fdocs_service_history-1773996624255.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd12338781d4dd36be2e28ff2fa34108e%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7052/20357052/docs_service_history-1773996624255.jpg?ixlib=js-3.8.0&auto=format&s=d12338781d4dd36be2e28ff2fa34108e not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0426%252F20490426%252Fdocs_service_history-1774710885667.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df3e70e53ea26dc7c6d304939b179e7d0%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0426/20490426/docs_service_history-1774710885667.jpg?ixlib=js-3.8.0&auto=format&s=f3e70e53ea26dc7c6d304939b179e7d0 not downloaded yet
2026-03-29 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18935928.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c2b2444-6761-5352-882e-257e9a3fe5b7 with identifier: 19981352
2026-03-29 20:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c2b2444-6761-5352-882e-257e9a3fe5b7 with scrape type 1
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c2b2444-6761-5352-882e-257e9a3fe5b7
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1352%252F19981352%252Fexterior_front_driver-1774633114891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1352/19981352/exterior_front_driver-1774633114891.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1352%252F19981352%252Fexterior_rear_driver-1774698027686.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1352/19981352/exterior_rear_driver-1774698027686.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1352%252F19981352%252Fexterior_front_passenger-1774633164392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1352/19981352/exterior_front_passenger-1774633164392.jpg not downloaded yet
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2030d0>
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ced4691-8f6d-5ea4-b801-d906708ec437/5ced4691-8f6d-5ea4-b801-d906708ec437_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3984%252F20373984%252Fdocs_service_history-1774702903569.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9786fe2af51f568041b374d4a6739e7e') HTTP/1.1" 204 0
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3984/20373984/docs_service_history-1774702903569.jpg?ixlib=js-3.8.0&auto=format&s=9786fe2af51f568041b374d4a6739e7e saved to cache
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ced4691-8f6d-5ea4-b801-d906708ec437
2026-03-29 20:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f2ed91d-167b-5e5c-bee3-afd83955c13d with identifier: 19681726
2026-03-29 20:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f2ed91d-167b-5e5c-bee3-afd83955c13d with scrape type 1
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f2ed91d-167b-5e5c-bee3-afd83955c13d
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1726%252F19681726%252Fexterior_front_driver-1774706421999.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1726/19681726/exterior_front_driver-1774706421999.jpg not downloaded yet
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dec5890>
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ced4691-8f6d-5ea4-b801-d906708ec437/5ced4691-8f6d-5ea4-b801-d906708ec437_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3984%252F20373984%252Finterior_boot-1774633993529.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3984/20373984/interior_boot-1774633993529.jpg saved to cache
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ced4691-8f6d-5ea4-b801-d906708ec437
2026-03-29 20:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0426/20490426/exterior_front_driver-1774710014869.jpg> (referer: None)
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1352%252F19981352%252Fexterior_rear_passenger-1774698039643.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1352/19981352/exterior_rear_passenger-1774698039643.jpg not downloaded yet
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1726%252F19681726%252Fexterior_rear_driver-1774706435764.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1726/19681726/exterior_rear_driver-1774706435764.jpg not downloaded yet
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d536950>
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ced4691-8f6d-5ea4-b801-d906708ec437/5ced4691-8f6d-5ea4-b801-d906708ec437_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3984%252F20373984%252Fdocs_service_history-1774634350907.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8fcfe5d7ec02613425c9d98d1f0e8a97') HTTP/1.1" 204 0
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3984/20373984/docs_service_history-1774634350907.jpg?ixlib=js-3.8.0&auto=format&s=8fcfe5d7ec02613425c9d98d1f0e8a97 saved to cache
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ced4691-8f6d-5ea4-b801-d906708ec437
2026-03-29 20:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7052/20357052/exterior_rear_driver-1773994563398.jpg> (referer: None)
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1352%252F19981352%252Finterior_front_seats-1774633686400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1352/19981352/interior_front_seats-1774633686400.jpg not downloaded yet
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1726%252F19681726%252Fexterior_front_passenger-1774706473002.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1726/19681726/exterior_front_passenger-1774706473002.jpg not downloaded yet
2026-03-29 20:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9617c337-eba5-5b10-a251-e094ac4033e1 with identifier: 18935928
2026-03-29 20:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9617c337-eba5-5b10-a251-e094ac4033e1 with scrape type 1
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9617c337-eba5-5b10-a251-e094ac4033e1
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F18935928%252Fexterior_front_driver-1774376731876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/18935928/exterior_front_driver-1774376731876.jpg not downloaded yet
2026-03-29 20:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8117/13648117/docs_service_history-1774701669182.jpg?ixlib=js-3.8.0&auto=format&s=a4c3f075cb9565bc9a54f218245a1181> (referer: None)
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1352%252F19981352%252Finterior_rear_seats-1774633880191.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1352/19981352/interior_rear_seats-1774633880191.jpg not downloaded yet
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1726%252F19681726%252Fexterior_rear_passenger-1774708482307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1726/19681726/exterior_rear_passenger-1774708482307.jpg not downloaded yet
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F18935928%252Fexterior_rear_driver-1774376754537.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/18935928/exterior_rear_driver-1774376754537.jpg not downloaded yet
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f65c8d0>
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f/f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0426%252F20490426%252Fexterior_front_driver-1774710014869.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0426/20490426/exterior_front_driver-1774710014869.jpg saved to cache
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1352%252F19981352%252Finterior_dashboard-1774633909325.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1352/19981352/interior_dashboard-1774633909325.jpg not downloaded yet
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1726%252F19681726%252Finterior_front_seats-1774707012751.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1726/19681726/interior_front_seats-1774707012751.jpg not downloaded yet
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F18935928%252Fexterior_front_passenger-1774376782783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/18935928/exterior_front_passenger-1774376782783.jpg not downloaded yet
2026-03-29 20:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0426/20490426/exterior_rear_driver-1774710031660.jpg> (referer: None)
2026-03-29 20:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=792&page=22&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7052/20357052/exterior_front_driver-1773994590704.jpg> (referer: None)
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1352%252F19981352%252Finstrument_cluster-1774697584118.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1352/19981352/instrument_cluster-1774697584118.jpg not downloaded yet
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1726%252F19681726%252Finterior_rear_seats-1774707057094.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1726/19681726/interior_rear_seats-1774707057094.jpg not downloaded yet
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F18935928%252Fexterior_rear_passenger-1774376764087.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/18935928/exterior_rear_passenger-1774376764087.jpg not downloaded yet
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d255790>
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a44d30-bdcb-5e22-a706-e615b984bf7b/76a44d30-bdcb-5e22-a706-e615b984bf7b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7052%252F20357052%252Fexterior_rear_driver-1773994563398.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7052/20357052/exterior_rear_driver-1773994563398.jpg saved to cache
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76a44d30-bdcb-5e22-a706-e615b984bf7b
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d918250>
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ff19882-7ddc-50fe-9399-10a6068f174d/1ff19882-7ddc-50fe-9399-10a6068f174d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8117%252F13648117%252Fdocs_service_history-1774701669182.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da4c3f075cb9565bc9a54f218245a1181') HTTP/1.1" 204 0
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8117/13648117/docs_service_history-1774701669182.jpg?ixlib=js-3.8.0&auto=format&s=a4c3f075cb9565bc9a54f218245a1181 saved to cache
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ff19882-7ddc-50fe-9399-10a6068f174d
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0426/20490426/docs_service_history-1774710885667.jpg?ixlib=js-3.8.0&auto=format&s=f3e70e53ea26dc7c6d304939b179e7d0> (referer: None)
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1352%252F19981352%252Finterior_boot-1774633992900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1352/19981352/interior_boot-1774633992900.jpg not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1726%252F19681726%252Finterior_dashboard-1774707089037.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1726/19681726/interior_dashboard-1774707089037.jpg not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F18935928%252Finterior_front_seats-1774377360119.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/18935928/interior_front_seats-1774377360119.jpg not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1352%252F19981352%252Fdocs_service_history-1774636075735.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D220b7dd7405ec0454052dd51f0d0f267%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1352/19981352/docs_service_history-1774636075735.jpg?ixlib=js-3.8.0&auto=format&s=220b7dd7405ec0454052dd51f0d0f267 not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1726%252F19681726%252Finterior_boot-1774707096396.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1726/19681726/interior_boot-1774707096396.jpg not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F18935928%252Finterior_rear_seats-1774377371207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/18935928/interior_rear_seats-1774377371207.jpg not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1726%252F19681726%252Fdocs_service_history-1774707476167.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D28b25b866d6f96f49b2d8559fc966d24%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1726/19681726/docs_service_history-1774707476167.jpg?ixlib=js-3.8.0&auto=format&s=28b25b866d6f96f49b2d8559fc966d24 not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F18935928%252Finterior_dashboard-1774377394391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/18935928/interior_dashboard-1774377394391.jpg not downloaded yet
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db0d910>
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f/f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0426%252F20490426%252Fexterior_rear_driver-1774710031660.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0426/20490426/exterior_rear_driver-1774710031660.jpg saved to cache
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20385482
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 14497960
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20393358
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720393358%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [motorway.uk] INFO: Scrape type for 20393358: 1
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d616490>
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a44d30-bdcb-5e22-a706-e615b984bf7b/76a44d30-bdcb-5e22-a706-e615b984bf7b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7052%252F20357052%252Fexterior_front_driver-1773994590704.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7052/20357052/exterior_front_driver-1773994590704.jpg saved to cache
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76a44d30-bdcb-5e22-a706-e615b984bf7b
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c738910>
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f/f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0426%252F20490426%252Fdocs_service_history-1774710885667.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df3e70e53ea26dc7c6d304939b179e7d0') HTTP/1.1" 204 0
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0426/20490426/docs_service_history-1774710885667.jpg?ixlib=js-3.8.0&auto=format&s=f3e70e53ea26dc7c6d304939b179e7d0 saved to cache
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1726%252F19681726%252Fdocs_service_history-1774707482917.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1cd50316b651d78e01f163bf39d627c6%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1726/19681726/docs_service_history-1774707482917.jpg?ixlib=js-3.8.0&auto=format&s=1cd50316b651d78e01f163bf39d627c6 not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F18935928%252Finstrument_cluster-1774377438665.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/18935928/instrument_cluster-1774377438665.jpg not downloaded yet
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20217991
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20383556
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20485756
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 19413267
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 19288331
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20462610
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20490179
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20486724
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20489344
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20348979
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 14956280
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714956280%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [motorway.uk] INFO: Scrape type for 14956280: 1
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11445648.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F18935928%252Finterior_boot-1774377512949.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/18935928/interior_boot-1774377512949.jpg not downloaded yet
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 18941047
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718941047%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [motorway.uk] INFO: Scrape type for 18941047: 1
2026-03-29 20:09:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5928%252F18935928%252Fdocs_service_history-1774379150564.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1135160585b01f850d079475fceda086%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5928/18935928/docs_service_history-1774379150564.jpg?ixlib=js-3.8.0&auto=format&s=1135160585b01f850d079475fceda086 not downloaded yet
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 13723227
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20423398
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20464480
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20471522
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 8915220
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20476962
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 17749520
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717749520%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [motorway.uk] INFO: Scrape type for 17749520: 1
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7052/20357052/interior_dashboard-1774782830085.jpg> (referer: None)
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 15294916
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20018421
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720018421%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [motorway.uk] INFO: Scrape type for 20018421: 1
2026-03-29 20:09:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20405344
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20465616
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 12468788
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712468788%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [motorway.uk] INFO: Scrape type for 12468788: 1
2026-03-29 20:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16777483-44df-59ed-b1e2-03271f9671b7 with identifier: 11445648
2026-03-29 20:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16777483-44df-59ed-b1e2-03271f9671b7 with scrape type 1
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16777483-44df-59ed-b1e2-03271f9671b7
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5648%252F11445648%252Fexterior_front_driver-1774787148414.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5648/11445648/exterior_front_driver-1774787148414.jpeg not downloaded yet
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1352/19981352/exterior_front_driver-1774633114891.jpg> (referer: None)
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20416075
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20337017
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 5750587
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275750587%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [motorway.uk] INFO: Scrape type for 5750587: 1
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5648%252F11445648%252Fexterior_rear_driver-1774787170199.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5648/11445648/exterior_rear_driver-1774787170199.jpeg not downloaded yet
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1352/19981352/exterior_front_passenger-1774633164392.jpg> (referer: None)
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20426574
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720426574%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [motorway.uk] INFO: Scrape type for 20426574: 1
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5648%252F11445648%252Fexterior_front_passenger-1774787156710.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5648/11445648/exterior_front_passenger-1774787156710.jpeg not downloaded yet
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20428130
2026-03-29 20:09:54 [motorway.uk] INFO: Found listing with ID: 20480796
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720480796%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [motorway.uk] INFO: Scrape type for 20480796: 1
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2bc3d0>
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a44d30-bdcb-5e22-a706-e615b984bf7b/76a44d30-bdcb-5e22-a706-e615b984bf7b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7052%252F20357052%252Finterior_dashboard-1774782830085.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7052/20357052/interior_dashboard-1774782830085.jpg saved to cache
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76a44d30-bdcb-5e22-a706-e615b984bf7b
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5648%252F11445648%252Fexterior_rear_passenger-1774787183927.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5648/11445648/exterior_rear_passenger-1774787183927.jpeg not downloaded yet
2026-03-29 20:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1726/19681726/exterior_front_driver-1774706421999.jpg> (referer: None)
2026-03-29 20:09:55 [motorway.uk] INFO: Found listing with ID: 20477490
2026-03-29 20:09:55 [motorway.uk] INFO: Found listing with ID: 20165932
2026-03-29 20:09:55 [motorway.uk] INFO: Found listing with ID: 19570678
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719570678%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [motorway.uk] INFO: Scrape type for 19570678: 1
2026-03-29 20:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20463285.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5648%252F11445648%252Finterior_front_seats-1774790141151.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5648/11445648/interior_front_seats-1774790141151.jpeg not downloaded yet
2026-03-29 20:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8117/13648117/interior_boot-1774701036370.jpg> (referer: None)
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5648%252F11445648%252Finterior_rear_seats-1774790102042.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5648/11445648/interior_rear_seats-1774790102042.jpeg not downloaded yet
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2bced0>
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c2b2444-6761-5352-882e-257e9a3fe5b7/3c2b2444-6761-5352-882e-257e9a3fe5b7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1352%252F19981352%252Fexterior_front_driver-1774633114891.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1352/19981352/exterior_front_driver-1774633114891.jpg saved to cache
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c2b2444-6761-5352-882e-257e9a3fe5b7
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd282d0>
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c2b2444-6761-5352-882e-257e9a3fe5b7/3c2b2444-6761-5352-882e-257e9a3fe5b7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1352%252F19981352%252Fexterior_front_passenger-1774633164392.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1352/19981352/exterior_front_passenger-1774633164392.jpg saved to cache
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c2b2444-6761-5352-882e-257e9a3fe5b7
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5648%252F11445648%252Finterior_dashboard-1774788685714.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5648/11445648/interior_dashboard-1774788685714.jpeg not downloaded yet
2026-03-29 20:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1352/19981352/exterior_rear_driver-1774698027686.jpg> (referer: None)
2026-03-29 20:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1726/19681726/exterior_rear_driver-1774706435764.jpg> (referer: None)
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5648%252F11445648%252Finstrument_cluster-1774787828068.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5648/11445648/instrument_cluster-1774787828068.jpeg not downloaded yet
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4a0450>
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2ed91d-167b-5e5c-bee3-afd83955c13d/5f2ed91d-167b-5e5c-bee3-afd83955c13d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1726%252F19681726%252Fexterior_front_driver-1774706421999.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1726/19681726/exterior_front_driver-1774706421999.jpg saved to cache
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f2ed91d-167b-5e5c-bee3-afd83955c13d
2026-03-29 20:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a45be190-b549-5073-bfc0-7d75f7db0dbe with identifier: 20463285
2026-03-29 20:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a45be190-b549-5073-bfc0-7d75f7db0dbe with scrape type 1
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a45be190-b549-5073-bfc0-7d75f7db0dbe
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3285%252F20463285%252Fexterior_front_driver-1774693819884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_front_driver-1774693819884.jpg not downloaded yet
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c769610>
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ff19882-7ddc-50fe-9399-10a6068f174d/1ff19882-7ddc-50fe-9399-10a6068f174d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8117%252F13648117%252Finterior_boot-1774701036370.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8117/13648117/interior_boot-1774701036370.jpg saved to cache
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ff19882-7ddc-50fe-9399-10a6068f174d
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5648%252F11445648%252Finterior_boot-1774788667741.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5648/11445648/interior_boot-1774788667741.jpeg not downloaded yet
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3285%252F20463285%252Fexterior_rear_driver-1774693793504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_rear_driver-1774693793504.jpg not downloaded yet
2026-03-29 20:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5648%252F11445648%252Fdocs_service_history-1774790518407.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D28dd7adbca53ea233d5060fc308a8e19%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5648/11445648/docs_service_history-1774790518407.jpeg?ixlib=js-3.8.0&auto=format&s=28dd7adbca53ea233d5060fc308a8e19 not downloaded yet
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3285%252F20463285%252Fexterior_front_passenger-1774693815886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_front_passenger-1774693815886.jpg not downloaded yet
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d690290>
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c2b2444-6761-5352-882e-257e9a3fe5b7/3c2b2444-6761-5352-882e-257e9a3fe5b7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1352%252F19981352%252Fexterior_rear_driver-1774698027686.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1352/19981352/exterior_rear_driver-1774698027686.jpg saved to cache
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c2b2444-6761-5352-882e-257e9a3fe5b7
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d13f990>
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2ed91d-167b-5e5c-bee3-afd83955c13d/5f2ed91d-167b-5e5c-bee3-afd83955c13d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1726%252F19681726%252Fexterior_rear_driver-1774706435764.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1726/19681726/exterior_rear_driver-1774706435764.jpg saved to cache
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f2ed91d-167b-5e5c-bee3-afd83955c13d
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3285%252F20463285%252Fexterior_rear_passenger-1774693804214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_rear_passenger-1774693804214.jpg not downloaded yet
2026-03-29 20:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18135215.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3285%252F20463285%252Finterior_front_seats-1774781452031.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3285/20463285/interior_front_seats-1774781452031.jpg not downloaded yet
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3285%252F20463285%252Finterior_rear_seats-1774781226658.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3285/20463285/interior_rear_seats-1774781226658.jpg not downloaded yet
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3285%252F20463285%252Finterior_dashboard-1774781336832.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3285/20463285/interior_dashboard-1774781336832.jpg not downloaded yet
2026-03-29 20:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2857debc-154c-5696-aa66-374be0574758 with identifier: 18135215
2026-03-29 20:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2857debc-154c-5696-aa66-374be0574758 with scrape type 2
2026-03-29 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2857debc-154c-5696-aa66-374be0574758 with scrape type 2
2026-03-29 20:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2857debc-154c-5696-aa66-374be0574758, identifier: 18135215
2026-03-29 20:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0426/20490426/interior_dashboard-1774710648154.jpg> (referer: None)
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3285%252F20463285%252Finstrument_cluster-1774782435177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3285/20463285/instrument_cluster-1774782435177.jpg not downloaded yet
2026-03-29 20:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2857debc-154c-5696-aa66-374be0574758 with identifier: 18135215
2026-03-29 20:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2857debc-154c-5696-aa66-374be0574758 with identifier: 18135215
2026-03-29 20:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2857debc-154c-5696-aa66-374be0574758 with identifier: 18135215 to the API
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18135215.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '2857debc-154c-5696-aa66-374be0574758',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'E15 JMF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18135215',
'listing': 'auction',
'location': 'Lincolnshire Spalding',
'make': 'Ford',
'model': 'Focus',
'odometer': 57840,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 9500,
'price_includes_vat': False,
'registration_date': '2016-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus ST-3 TDCI',
'transmission': 'manual',
'trim': 'ST-3 TDCI',
'vin': 'WF05XXGCC5GA78986',
'year': 2016}
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718135215%27 HTTP/1.1" 200 None
2026-03-29 20:09:56 [motorway.uk] INFO: Saving data for 18135215: {'auction_closing_time': 1774884600.0, 'created_time': 1774469315.828814, 'last_price_update_time': 1774814996.899073}
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18135215') HTTP/1.1" 204 0
2026-03-29 20:09:57 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (10732158) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5648/11445648/interior_front_seats-1774790141151.jpeg>.
2026-03-29 20:09:57 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12729954) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5648/11445648/interior_rear_seats-1774790102042.jpeg>.
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3285%252F20463285%252Finterior_boot-1774699067338.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3285/20463285/interior_boot-1774699067338.jpg not downloaded yet
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5928/18935928/interior_dashboard-1774377394391.jpg> (referer: None)
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3285%252F20463285%252Fwheels_front_driver-1774693841977.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3285/20463285/wheels_front_driver-1774693841977.jpg not downloaded yet
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f682c90>
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f/f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0426%252F20490426%252Finterior_dashboard-1774710648154.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0426/20490426/interior_dashboard-1774710648154.jpg saved to cache
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9c5f65b-672c-52bc-9a07-1c7efdc5bf2f
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce9e910>
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9617c337-eba5-5b10-a251-e094ac4033e1/9617c337-eba5-5b10-a251-e094ac4033e1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F18935928%252Finterior_dashboard-1774377394391.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/18935928/interior_dashboard-1774377394391.jpg saved to cache
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9617c337-eba5-5b10-a251-e094ac4033e1
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5928/18935928/interior_rear_seats-1774377371207.jpg> (referer: None)
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20393358.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1726/19681726/docs_service_history-1774707476167.jpg?ixlib=js-3.8.0&auto=format&s=28b25b866d6f96f49b2d8559fc966d24> (referer: None)
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_front_driver-1774693819884.jpg> (referer: None)
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_rear_passenger-1774693804214.jpg> (referer: None)
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3285/20463285/interior_dashboard-1774781336832.jpg> (referer: None)
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1726/19681726/interior_boot-1774707096396.jpg> (referer: None)
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5648/11445648/exterior_front_driver-1774787148414.jpeg> (referer: None)
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce9fc10>
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9617c337-eba5-5b10-a251-e094ac4033e1/9617c337-eba5-5b10-a251-e094ac4033e1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F18935928%252Finterior_rear_seats-1774377371207.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/18935928/interior_rear_seats-1774377371207.jpg saved to cache
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9617c337-eba5-5b10-a251-e094ac4033e1
2026-03-29 20:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09c27abd-3f65-5c3d-8a44-96204b861885 with identifier: 20393358
2026-03-29 20:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09c27abd-3f65-5c3d-8a44-96204b861885 with scrape type 1
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09c27abd-3f65-5c3d-8a44-96204b861885
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20393358%252Fexterior_front_driver-1774699736401.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_front_driver-1774699736401.jpg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20393358%252Fexterior_rear_driver-1774699780319.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_rear_driver-1774699780319.jpg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20393358%252Fexterior_front_passenger-1774699752007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_front_passenger-1774699752007.jpg not downloaded yet
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc6b050>
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2ed91d-167b-5e5c-bee3-afd83955c13d/5f2ed91d-167b-5e5c-bee3-afd83955c13d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1726%252F19681726%252Fdocs_service_history-1774707476167.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D28b25b866d6f96f49b2d8559fc966d24') HTTP/1.1" 204 0
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1726/19681726/docs_service_history-1774707476167.jpg?ixlib=js-3.8.0&auto=format&s=28b25b866d6f96f49b2d8559fc966d24 saved to cache
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f2ed91d-167b-5e5c-bee3-afd83955c13d
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce213d0>
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3285%252F20463285%252Fexterior_front_driver-1774693819884.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_front_driver-1774693819884.jpg saved to cache
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a45be190-b549-5073-bfc0-7d75f7db0dbe
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1ce450>
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3285%252F20463285%252Fexterior_rear_passenger-1774693804214.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_rear_passenger-1774693804214.jpg saved to cache
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a45be190-b549-5073-bfc0-7d75f7db0dbe
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f38f1d0>
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3285%252F20463285%252Finterior_dashboard-1774781336832.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3285/20463285/interior_dashboard-1774781336832.jpg saved to cache
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a45be190-b549-5073-bfc0-7d75f7db0dbe
2026-03-29 20:09:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8ff250>
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2ed91d-167b-5e5c-bee3-afd83955c13d/5f2ed91d-167b-5e5c-bee3-afd83955c13d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1726%252F19681726%252Finterior_boot-1774707096396.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1726/19681726/interior_boot-1774707096396.jpg saved to cache
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f2ed91d-167b-5e5c-bee3-afd83955c13d
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca39410>
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16777483-44df-59ed-b1e2-03271f9671b7/16777483-44df-59ed-b1e2-03271f9671b7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5648%252F11445648%252Fexterior_front_driver-1774787148414.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5648/11445648/exterior_front_driver-1774787148414.jpeg saved to cache
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16777483-44df-59ed-b1e2-03271f9671b7
2026-03-29 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5648/11445648/interior_dashboard-1774788685714.jpeg> (referer: None)
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20393358%252Fexterior_rear_passenger-1774699764411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_rear_passenger-1774699764411.jpg not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3358%252F20393358%252Finterior_front_seats-1774700430002.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3358/20393358/interior_front_seats-1774700430002.jpg not downloaded yet
2026-03-29 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17749520.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=828&page=23&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3358%252F20393358%252Finterior_rear_seats-1774700426585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3358/20393358/interior_rear_seats-1774700426585.jpg not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20393358%252Finterior_dashboard-1774700447448.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20393358/interior_dashboard-1774700447448.jpg not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3358%252F20393358%252Finterior_boot-1774700435405.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3358/20393358/interior_boot-1774700435405.jpg not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3358%252F20393358%252Fdocs_service_history-1774700599948.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De7ed8f0f1a780dea9d6a87ba86722a72%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3358/20393358/docs_service_history-1774700599948.jpg?ixlib=js-3.8.0&auto=format&s=e7ed8f0f1a780dea9d6a87ba86722a72 not downloaded yet
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d973c90>
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16777483-44df-59ed-b1e2-03271f9671b7/16777483-44df-59ed-b1e2-03271f9671b7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5648%252F11445648%252Finterior_dashboard-1774788685714.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5648/11445648/interior_dashboard-1774788685714.jpeg saved to cache
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16777483-44df-59ed-b1e2-03271f9671b7
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3358%252F20393358%252Fdocs_service_history-1774700621124.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D75da20f05230d423d14f10ae778efb5f%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3358/20393358/docs_service_history-1774700621124.jpg?ixlib=js-3.8.0&auto=format&s=75da20f05230d423d14f10ae778efb5f not downloaded yet
2026-03-29 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14956280.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4a5c213-3796-5e0c-aec5-f14a83ccc118 with identifier: 17749520
2026-03-29 20:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4a5c213-3796-5e0c-aec5-f14a83ccc118 with scrape type 1
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4a5c213-3796-5e0c-aec5-f14a83ccc118
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9520%252F17749520%252Fexterior_front_driver-1774719502127.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_front_driver-1774719502127.jpg not downloaded yet
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 20345939
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 12444904
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 20479213
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720479213%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [motorway.uk] INFO: Scrape type for 20479213: 1
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9520%252F17749520%252Fexterior_rear_driver-1774719515071.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_rear_driver-1774719515071.jpg not downloaded yet
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 5678750
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 1379253
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 20147268
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 20465867
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720465867%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [motorway.uk] INFO: Scrape type for 20465867: 1
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9520%252F17749520%252Fexterior_front_passenger-1774719593761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_front_passenger-1774719593761.jpg not downloaded yet
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 18276171
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 20490982
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 20494330
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 20486417
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 19705843
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 6409208
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276409208%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [motorway.uk] INFO: Scrape type for 6409208: 1
2026-03-29 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3285/20463285/wheels_front_driver-1774693841977.jpg> (referer: None)
2026-03-29 20:09:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3285/20463285/instrument_cluster-1774782435177.jpg> (referer: None)
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9520%252F17749520%252Fexterior_rear_passenger-1774719547424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_rear_passenger-1774719547424.jpg not downloaded yet
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20049212
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 12893788
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20129049
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 19812836
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 7025214
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20458640
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 12548446
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20453033
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20028099
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20414917
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 18114859
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20498769
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720498769%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [motorway.uk] INFO: Scrape type for 20498769: 1
2026-03-29 20:09:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adcd354e-592f-5f58-bb87-708c2eb561f8 with identifier: 14956280
2026-03-29 20:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adcd354e-592f-5f58-bb87-708c2eb561f8 with scrape type 1
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item adcd354e-592f-5f58-bb87-708c2eb561f8
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6280%252F14956280%252Fexterior_front_driver-1774709080529.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_front_driver-1774709080529.jpeg not downloaded yet
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9520%252F17749520%252Finterior_front_seats-1774719907453.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9520/17749520/interior_front_seats-1774719907453.jpg not downloaded yet
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20401260
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20421513
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720421513%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [motorway.uk] INFO: Scrape type for 20421513: 1
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6280%252F14956280%252Fexterior_rear_driver-1774709165177.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_rear_driver-1774709165177.jpeg not downloaded yet
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9520%252F17749520%252Finterior_rear_seats-1774719822730.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9520/17749520/interior_rear_seats-1774719822730.jpg not downloaded yet
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 19128404
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20306533
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20304701
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720304701%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [motorway.uk] INFO: Scrape type for 20304701: 1
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6280%252F14956280%252Fexterior_front_passenger-1774709113184.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_front_passenger-1774709113184.jpeg not downloaded yet
2026-03-29 20:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da85c50>
2026-03-29 20:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3285%252F20463285%252Fwheels_front_driver-1774693841977.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3285/20463285/wheels_front_driver-1774693841977.jpg saved to cache
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a45be190-b549-5073-bfc0-7d75f7db0dbe
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9520%252F17749520%252Finterior_dashboard-1774772724100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9520/17749520/interior_dashboard-1774772724100.jpg not downloaded yet
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20378364
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 18272017
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718272017%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [motorway.uk] INFO: Scrape type for 18272017: 1
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6280%252F14956280%252Fexterior_rear_passenger-1774709132176.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_rear_passenger-1774709132176.jpeg not downloaded yet
2026-03-29 20:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35736690>
2026-03-29 20:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3285%252F20463285%252Finstrument_cluster-1774782435177.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3285/20463285/instrument_cluster-1774782435177.jpg saved to cache
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a45be190-b549-5073-bfc0-7d75f7db0dbe
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9520%252F17749520%252Finstrument_cluster-1774720251890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9520/17749520/instrument_cluster-1774720251890.jpg not downloaded yet
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20445540
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 20500409
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720500409%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [motorway.uk] INFO: Scrape type for 20500409: 1
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6280%252F14956280%252Finterior_front_seats-1774709214710.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6280/14956280/interior_front_seats-1774709214710.jpeg not downloaded yet
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9520%252F17749520%252Finterior_boot-1774720122753.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9520/17749520/interior_boot-1774720122753.jpg not downloaded yet
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 18253303
2026-03-29 20:09:59 [motorway.uk] INFO: Found listing with ID: 18656000
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6280%252F14956280%252Finterior_rear_seats-1774710573408.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6280/14956280/interior_rear_seats-1774710573408.jpeg not downloaded yet
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9520%252F17749520%252Fdocs_service_history-1774719972971.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df963e4a5eb6af31226c172382ac88a14%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9520/17749520/docs_service_history-1774719972971.jpg?ixlib=js-3.8.0&auto=format&s=f963e4a5eb6af31226c172382ac88a14 not downloaded yet
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6280%252F14956280%252F14956280-interior_dashboard-modified-1774711781117.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6280/14956280/14956280-interior_dashboard-modified-1774711781117.jpeg not downloaded yet
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6280%252F14956280%252Finstrument_cluster-1774709379827.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6280/14956280/instrument_cluster-1774709379827.jpeg not downloaded yet
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6280%252F14956280%252Finterior_boot-1774710311823.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6280/14956280/interior_boot-1774710311823.jpeg not downloaded yet
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6280%252F14956280%252Fdocs_service_history-1774711237762.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3073e6b54fdcd3001f7904d1174b4d4b%27 HTTP/1.1" 200 None
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6280/14956280/docs_service_history-1774711237762.jpeg?ixlib=js-3.8.0&auto=format&s=3073e6b54fdcd3001f7904d1174b4d4b not downloaded yet
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_front_driver-1774699736401.jpg> (referer: None)
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_front_passenger-1774699752007.jpg> (referer: None)
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_rear_passenger-1774699764411.jpg> (referer: None)
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5648/11445648/instrument_cluster-1774787828068.jpeg> (referer: None)
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_rear_driver-1774699780319.jpg> (referer: None)
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3358/20393358/interior_rear_seats-1774700426585.jpg> (referer: None)
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3358/20393358/interior_dashboard-1774700447448.jpg> (referer: None)
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3358/20393358/interior_front_seats-1774700430002.jpg> (referer: None)
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3285/20463285/interior_boot-1774699067338.jpg> (referer: None)
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3358/20393358/docs_service_history-1774700621124.jpg?ixlib=js-3.8.0&auto=format&s=75da20f05230d423d14f10ae778efb5f> (referer: None)
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3358/20393358/interior_boot-1774700435405.jpg> (referer: None)
2026-03-29 20:09:59 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5648/11445648/interior_front_seats-1774790141151.jpeg>.
2026-03-29 20:09:59 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5648/11445648/interior_rear_seats-1774790102042.jpeg>.
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5648/11445648/interior_front_seats-1774790141151.jpeg> (referer: None)
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5648/11445648/interior_rear_seats-1774790102042.jpeg> (referer: None)
2026-03-29 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3358/20393358/docs_service_history-1774700599948.jpg?ixlib=js-3.8.0&auto=format&s=e7ed8f0f1a780dea9d6a87ba86722a72> (referer: None)
2026-03-29 20:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5f5c10>
2026-03-29 20:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20393358%252Fexterior_front_driver-1774699736401.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_front_driver-1774699736401.jpg saved to cache
2026-03-29 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09c27abd-3f65-5c3d-8a44-96204b861885
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5f6cd0>
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20393358%252Fexterior_front_passenger-1774699752007.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_front_passenger-1774699752007.jpg saved to cache
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09c27abd-3f65-5c3d-8a44-96204b861885
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d215990>
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20393358%252Fexterior_rear_passenger-1774699764411.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_rear_passenger-1774699764411.jpg saved to cache
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09c27abd-3f65-5c3d-8a44-96204b861885
2026-03-29 20:10:00 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:00 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:00 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00x\xd3\xaf\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06\x05\x90\x00x\xc9\xa3\x00\x00\x00\x00'
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7fe3d0>
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16777483-44df-59ed-b1e2-03271f9671b7/16777483-44df-59ed-b1e2-03271f9671b7_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5648%252F11445648%252Finstrument_cluster-1774787828068.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5648/11445648/instrument_cluster-1774787828068.jpeg saved to cache
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16777483-44df-59ed-b1e2-03271f9671b7
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d472490>
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20393358%252Fexterior_rear_driver-1774699780319.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_rear_driver-1774699780319.jpg saved to cache
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09c27abd-3f65-5c3d-8a44-96204b861885
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a3110>
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3358%252F20393358%252Finterior_rear_seats-1774700426585.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3358/20393358/interior_rear_seats-1774700426585.jpg saved to cache
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09c27abd-3f65-5c3d-8a44-96204b861885
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d216950>
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20393358%252Finterior_dashboard-1774700447448.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20393358/interior_dashboard-1774700447448.jpg saved to cache
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09c27abd-3f65-5c3d-8a44-96204b861885
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a34d0>
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3358%252F20393358%252Finterior_front_seats-1774700430002.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3358/20393358/interior_front_seats-1774700430002.jpg saved to cache
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09c27abd-3f65-5c3d-8a44-96204b861885
2026-03-29 20:10:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a0690>
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3285%252F20463285%252Finterior_boot-1774699067338.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3285/20463285/interior_boot-1774699067338.jpg saved to cache
2026-03-29 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a45be190-b549-5073-bfc0-7d75f7db0dbe
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7fcbd0>
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3358%252F20393358%252Fdocs_service_history-1774700621124.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D75da20f05230d423d14f10ae778efb5f') HTTP/1.1" 204 0
2026-03-29 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3358/20393358/docs_service_history-1774700621124.jpg?ixlib=js-3.8.0&auto=format&s=75da20f05230d423d14f10ae778efb5f saved to cache
2026-03-29 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09c27abd-3f65-5c3d-8a44-96204b861885
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d214ad0>
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3358%252F20393358%252Finterior_boot-1774700435405.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3358/20393358/interior_boot-1774700435405.jpg saved to cache
2026-03-29 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09c27abd-3f65-5c3d-8a44-96204b861885
2026-03-29 20:10:01 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:01 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:01 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x9b\xefR\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07\xd3,\x00\x9b\xe5F\x00\x00\x00\x00'
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d918510>
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16777483-44df-59ed-b1e2-03271f9671b7/16777483-44df-59ed-b1e2-03271f9671b7_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5648%252F11445648%252Finterior_front_seats-1774790141151.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5648/11445648/interior_front_seats-1774790141151.jpeg saved to cache
2026-03-29 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16777483-44df-59ed-b1e2-03271f9671b7
2026-03-29 20:10:01 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:01 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:01 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xbdr\xf0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xcbr\x00\xbdh\xe4\x00\x00\x00\x00'
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce7d110>
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16777483-44df-59ed-b1e2-03271f9671b7/16777483-44df-59ed-b1e2-03271f9671b7_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5648%252F11445648%252Finterior_rear_seats-1774790102042.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5648/11445648/interior_rear_seats-1774790102042.jpeg saved to cache
2026-03-29 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16777483-44df-59ed-b1e2-03271f9671b7
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d472a50>
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3358%252F20393358%252Fdocs_service_history-1774700599948.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De7ed8f0f1a780dea9d6a87ba86722a72') HTTP/1.1" 204 0
2026-03-29 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3358/20393358/docs_service_history-1774700599948.jpg?ixlib=js-3.8.0&auto=format&s=e7ed8f0f1a780dea9d6a87ba86722a72 saved to cache
2026-03-29 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09c27abd-3f65-5c3d-8a44-96204b861885
2026-03-29 20:10:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09c27abd-3f65-5c3d-8a44-96204b861885, skipping ID generation
2026-03-29 20:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09c27abd-3f65-5c3d-8a44-96204b861885 with scrape type 1
2026-03-29 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09c27abd-3f65-5c3d-8a44-96204b861885 sending to next pipeline
2026-03-29 20:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 09c27abd-3f65-5c3d-8a44-96204b861885, identifier: 20393358
2026-03-29 20:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 09c27abd-3f65-5c3d-8a44-96204b861885 with identifier: 20393358
2026-03-29 20:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 09c27abd-3f65-5c3d-8a44-96204b861885 with identifier: 20393358
2026-03-29 20:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 09c27abd-3f65-5c3d-8a44-96204b861885 with identifier: 20393358 to the API
2026-03-29 20:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-service-history-photos.imgix.net/redacted/oriented/3358/20393358/docs_service_history-1774700599948.jpg?ixlib=js-3.8.0&auto=format&s=e7ed8f0f1a780dea9d6a87ba86722a72>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '09c27abd-3f65-5c3d-8a44-96204b861885',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YD19 NRT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20393358',
'listing': 'auction',
'location': 'South Lanarkshire Glasgow',
'make': 'BMW',
'model': 'X3',
'odometer': 49800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1364471,
'Height': 2332,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_front_driver-1774699736401.jpg',
'Width': 3109},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1367345,
'Height': 2145,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_rear_driver-1774699780319.jpg',
'Width': 2860},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 875297,
'Height': 1881,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_front_passenger-1774699752007.jpg',
'Width': 2508},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1158624,
'Height': 2039,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3358/20393358/exterior_rear_passenger-1774699764411.jpg',
'Width': 2719},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2011979,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3358/20393358/interior_front_seats-1774700430002.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1842163,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3358/20393358/interior_rear_seats-1774700426585.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2020810,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3358/20393358/interior_dashboard-1774700447448.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3247437,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3358/20393358/interior_boot-1774700435405.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2189472,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3358/20393358/docs_service_history-1774700599948.jpg?ixlib=js-3.8.0&auto=format&s=e7ed8f0f1a780dea9d6a87ba86722a72',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09c27abd-3f65-5c3d-8a44-96204b861885/09c27abd-3f65-5c3d-8a44-96204b861885_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2356440,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3358/20393358/docs_service_history-1774700621124.jpg?ixlib=js-3.8.0&auto=format&s=75da20f05230d423d14f10ae778efb5f',
'Width': 3840}],
'price': 21950,
'price_includes_vat': False,
'registration_date': '2019-06-21',
'seats_number': None,
'seller_name': None,
'title': 'BMW X3 xDrive 20d M Sport Auto',
'transmission': 'automatic',
'trim': 'xDrive 20d M Sport Auto',
'vin': 'WBATX36070ND75324',
'year': 2019}
2026-03-29 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720393358%27 HTTP/1.1" 200 None
2026-03-29 20:10:02 [motorway.uk] INFO: Saving data for 20393358: {'created_time': 1774815002.746121, 'last_price_update_time': 1774815002.746133, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20393358') HTTP/1.1" 204 0
2026-03-29 20:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6280/14956280/instrument_cluster-1774709379827.jpeg> (referer: None)
2026-03-29 20:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6280/14956280/interior_boot-1774710311823.jpeg> (referer: None)
2026-03-29 20:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1c\x1d\x1f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xe1\xa2\x00\x1c\x12\x9d\x00\x00\x00\x00'
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2728d0>
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6280%252F14956280%252Finstrument_cluster-1774709379827.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6280/14956280/instrument_cluster-1774709379827.jpeg saved to cache
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item adcd354e-592f-5f58-bb87-708c2eb561f8
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00+d\x9d\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02$\xf4\x00+Z\x1b\x00\x00\x00\x00'
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f38a610>
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6280%252F14956280%252Finterior_boot-1774710311823.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6280/14956280/interior_boot-1774710311823.jpeg saved to cache
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item adcd354e-592f-5f58-bb87-708c2eb561f8
2026-03-29 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20465867.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9520/17749520/instrument_cluster-1774720251890.jpg> (referer: None)
2026-03-29 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_rear_passenger-1774709132176.jpeg> (referer: None)
2026-03-29 20:10:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_front_passenger-1774709113184.jpeg> (referer: None)
2026-03-29 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9520/17749520/docs_service_history-1774719972971.jpg?ixlib=js-3.8.0&auto=format&s=f963e4a5eb6af31226c172382ac88a14> (referer: None)
2026-03-29 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6280/14956280/14956280-interior_dashboard-modified-1774711781117.jpeg> (referer: None)
2026-03-29 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9520/17749520/interior_dashboard-1774772724100.jpg> (referer: None)
2026-03-29 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6280/14956280/docs_service_history-1774711237762.jpeg?ixlib=js-3.8.0&auto=format&s=3073e6b54fdcd3001f7904d1174b4d4b> (referer: None)
2026-03-29 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9520/17749520/interior_boot-1774720122753.jpg> (referer: None)
2026-03-29 20:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1bdcc08-aa81-5463-9d87-ca9f76950a61 with identifier: 20465867
2026-03-29 20:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1bdcc08-aa81-5463-9d87-ca9f76950a61 with scrape type 1
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1bdcc08-aa81-5463-9d87-ca9f76950a61
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5867%252F20465867%252Fexterior_front_driver-1774712240414.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_front_driver-1774712240414.jpg not downloaded yet
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5867%252F20465867%252Fexterior_rear_driver-1774710530515.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_rear_driver-1774710530515.jpg not downloaded yet
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5867%252F20465867%252Fexterior_front_passenger-1774710514386.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_front_passenger-1774710514386.jpg not downloaded yet
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e039010>
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9520%252F17749520%252Finstrument_cluster-1774720251890.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9520/17749520/instrument_cluster-1774720251890.jpg saved to cache
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4a5c213-3796-5e0c-aec5-f14a83ccc118
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f218bd0>
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6280%252F14956280%252Fexterior_rear_passenger-1774709132176.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_rear_passenger-1774709132176.jpeg saved to cache
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item adcd354e-592f-5f58-bb87-708c2eb561f8
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5867%252F20465867%252Fexterior_rear_passenger-1774710488704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_rear_passenger-1774710488704.jpg not downloaded yet
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4a6790>
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6280%252F14956280%252Fexterior_front_passenger-1774709113184.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_front_passenger-1774709113184.jpeg saved to cache
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item adcd354e-592f-5f58-bb87-708c2eb561f8
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c919690>
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9520%252F17749520%252Fdocs_service_history-1774719972971.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df963e4a5eb6af31226c172382ac88a14') HTTP/1.1" 204 0
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9520/17749520/docs_service_history-1774719972971.jpg?ixlib=js-3.8.0&auto=format&s=f963e4a5eb6af31226c172382ac88a14 saved to cache
2026-03-29 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f4a5c213-3796-5e0c-aec5-f14a83ccc118
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de0fc10>
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6280%252F14956280%252F14956280-interior_dashboard-modified-1774711781117.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6280/14956280/14956280-interior_dashboard-modified-1774711781117.jpeg saved to cache
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item adcd354e-592f-5f58-bb87-708c2eb561f8
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5867%252F20465867%252Finterior_front_seats-1774711188647.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5867/20465867/interior_front_seats-1774711188647.jpg not downloaded yet
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d189f50>
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9520%252F17749520%252Finterior_dashboard-1774772724100.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9520/17749520/interior_dashboard-1774772724100.jpg saved to cache
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4a5c213-3796-5e0c-aec5-f14a83ccc118
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cabc350>
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6280%252F14956280%252Fdocs_service_history-1774711237762.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3073e6b54fdcd3001f7904d1174b4d4b') HTTP/1.1" 204 0
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6280/14956280/docs_service_history-1774711237762.jpeg?ixlib=js-3.8.0&auto=format&s=3073e6b54fdcd3001f7904d1174b4d4b saved to cache
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item adcd354e-592f-5f58-bb87-708c2eb561f8
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f27e9d0>
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9520%252F17749520%252Finterior_boot-1774720122753.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9520/17749520/interior_boot-1774720122753.jpg saved to cache
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4a5c213-3796-5e0c-aec5-f14a83ccc118
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5867%252F20465867%252Finterior_rear_seats-1774711272362.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5867/20465867/interior_rear_seats-1774711272362.jpg not downloaded yet
2026-03-29 20:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6280/14956280/interior_front_seats-1774709214710.jpeg> (referer: None)
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5867%252F20465867%252Finterior_dashboard-1774711254614.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5867/20465867/interior_dashboard-1774711254614.jpg not downloaded yet
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5867%252F20465867%252Finstrument_cluster-1774712771547.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5867/20465867/instrument_cluster-1774712771547.jpg not downloaded yet
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5867%252F20465867%252Finterior_boot-1774711199087.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5867/20465867/interior_boot-1774711199087.jpg not downloaded yet
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5867%252F20465867%252Fdocs_service_history-1774711959812.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D497f1221e3824a336564532326ede3b9%27 HTTP/1.1" 200 None
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5867/20465867/docs_service_history-1774711959812.jpg?ixlib=js-3.8.0&auto=format&s=497f1221e3824a336564532326ede3b9 not downloaded yet
2026-03-29 20:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6280/14956280/interior_rear_seats-1774710573408.jpeg> (referer: None)
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x008u"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\xb0c\x008j\xa0\x00\x00\x00\x00'
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6ac310>
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6280%252F14956280%252Finterior_front_seats-1774709214710.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6280/14956280/interior_front_seats-1774709214710.jpeg saved to cache
2026-03-29 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item adcd354e-592f-5f58-bb87-708c2eb561f8
2026-03-29 20:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_rear_driver-1774709165177.jpeg> (referer: None)
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:04 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00O\xafC\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xe0.\x00O\xa4\xc1\x00\x00\x00\x00'
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6ad290>
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6280%252F14956280%252Finterior_rear_seats-1774710573408.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6280/14956280/interior_rear_seats-1774710573408.jpeg saved to cache
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item adcd354e-592f-5f58-bb87-708c2eb561f8
2026-03-29 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/6409208.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e118810>
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6280%252F14956280%252Fexterior_rear_driver-1774709165177.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_rear_driver-1774709165177.jpeg saved to cache
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item adcd354e-592f-5f58-bb87-708c2eb561f8
2026-03-29 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9520/17749520/interior_rear_seats-1774719822730.jpg> (referer: None)
2026-03-29 20:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8712e47-b601-53f6-93c0-61afaa3dc9b6 with identifier: 6409208
2026-03-29 20:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8712e47-b601-53f6-93c0-61afaa3dc9b6 with scrape type 1
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8712e47-b601-53f6-93c0-61afaa3dc9b6
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9208%252F6409208%252Fexterior_front_driver-1774712019214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_front_driver-1774712019214.jpg not downloaded yet
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9208%252F6409208%252Fexterior_rear_driver-1774712036527.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_rear_driver-1774712036527.jpg not downloaded yet
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9208%252F6409208%252Fexterior_front_passenger-1774712069093.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_front_passenger-1774712069093.jpg not downloaded yet
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9208%252F6409208%252Fexterior_rear_passenger-1774712051420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_rear_passenger-1774712051420.jpg not downloaded yet
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9208%252F6409208%252Finterior_front_seats-1774712601622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9208/6409208/interior_front_seats-1774712601622.jpg not downloaded yet
2026-03-29 20:10:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7aaed0>
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9520%252F17749520%252Finterior_rear_seats-1774719822730.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9520/17749520/interior_rear_seats-1774719822730.jpg saved to cache
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4a5c213-3796-5e0c-aec5-f14a83ccc118
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9208%252F6409208%252Finterior_rear_seats-1774712614392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9208/6409208/interior_rear_seats-1774712614392.jpg not downloaded yet
2026-03-29 20:10:05 [scrapy.extensions.logstats] INFO: Crawled 190 pages (at 50 pages/min), scraped 110 items (at 18 items/min)
2026-03-29 20:10:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 302MiB
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9208%252F6409208%252Finterior_dashboard-1774712653736.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9208/6409208/interior_dashboard-1774712653736.jpg not downloaded yet
2026-03-29 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_front_passenger-1774710514386.jpg> (referer: None)
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9208%252F6409208%252Finstrument_cluster-1774712698311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9208/6409208/instrument_cluster-1774712698311.jpg not downloaded yet
2026-03-29 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9520/17749520/interior_front_seats-1774719907453.jpg> (referer: None)
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9208%252F6409208%252Finterior_boot-1774712672420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9208/6409208/interior_boot-1774712672420.jpg not downloaded yet
2026-03-29 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_rear_passenger-1774710488704.jpg> (referer: None)
2026-03-29 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_rear_driver-1774710530515.jpg> (referer: None)
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9208%252F6409208%252Fdocs_service_history-1774712863109.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3abb1c7827b3f53c1633b8dce42b13c2%27 HTTP/1.1" 200 None
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9208/6409208/docs_service_history-1774712863109.jpg?ixlib=js-3.8.0&auto=format&s=3abb1c7827b3f53c1633b8dce42b13c2 not downloaded yet
2026-03-29 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5867/20465867/interior_rear_seats-1774711272362.jpg> (referer: None)
2026-03-29 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_front_driver-1774712240414.jpg> (referer: None)
2026-03-29 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5867/20465867/interior_front_seats-1774711188647.jpg> (referer: None)
2026-03-29 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5867/20465867/docs_service_history-1774711959812.jpg?ixlib=js-3.8.0&auto=format&s=497f1221e3824a336564532326ede3b9> (referer: None)
2026-03-29 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5867/20465867/instrument_cluster-1774712771547.jpg> (referer: None)
2026-03-29 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5867/20465867/interior_boot-1774711199087.jpg> (referer: None)
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db79d10>
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5867%252F20465867%252Fexterior_front_passenger-1774710514386.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_front_passenger-1774710514386.jpg saved to cache
2026-03-29 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f1bdcc08-aa81-5463-9d87-ca9f76950a61
2026-03-29 20:10:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1a1250>
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9520%252F17749520%252Finterior_front_seats-1774719907453.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9520/17749520/interior_front_seats-1774719907453.jpg saved to cache
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4a5c213-3796-5e0c-aec5-f14a83ccc118
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0b3310>
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5867%252F20465867%252Fexterior_rear_passenger-1774710488704.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_rear_passenger-1774710488704.jpg saved to cache
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1bdcc08-aa81-5463-9d87-ca9f76950a61
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5d3dd0>
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5867%252F20465867%252Fexterior_rear_driver-1774710530515.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_rear_driver-1774710530515.jpg saved to cache
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1bdcc08-aa81-5463-9d87-ca9f76950a61
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0b0650>
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5867%252F20465867%252Finterior_rear_seats-1774711272362.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5867/20465867/interior_rear_seats-1774711272362.jpg saved to cache
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f1bdcc08-aa81-5463-9d87-ca9f76950a61
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cabeb90>
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5867%252F20465867%252Fexterior_front_driver-1774712240414.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_front_driver-1774712240414.jpg saved to cache
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1bdcc08-aa81-5463-9d87-ca9f76950a61
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5d0bd0>
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5867%252F20465867%252Finterior_front_seats-1774711188647.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5867/20465867/interior_front_seats-1774711188647.jpg saved to cache
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1bdcc08-aa81-5463-9d87-ca9f76950a61
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d24d5d0>
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5867%252F20465867%252Fdocs_service_history-1774711959812.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D497f1221e3824a336564532326ede3b9') HTTP/1.1" 204 0
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5867/20465867/docs_service_history-1774711959812.jpg?ixlib=js-3.8.0&auto=format&s=497f1221e3824a336564532326ede3b9 saved to cache
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1bdcc08-aa81-5463-9d87-ca9f76950a61
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d999150>
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5867%252F20465867%252Finstrument_cluster-1774712771547.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5867/20465867/instrument_cluster-1774712771547.jpg saved to cache
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f1bdcc08-aa81-5463-9d87-ca9f76950a61
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f427550>
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5867%252F20465867%252Finterior_boot-1774711199087.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5867/20465867/interior_boot-1774711199087.jpg saved to cache
2026-03-29 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f1bdcc08-aa81-5463-9d87-ca9f76950a61
2026-03-29 20:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5867/20465867/interior_dashboard-1774711254614.jpg> (referer: None)
2026-03-29 20:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9208/6409208/interior_dashboard-1774712653736.jpg> (referer: None)
2026-03-29 20:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d529cd0>
2026-03-29 20:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5867%252F20465867%252Finterior_dashboard-1774711254614.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5867/20465867/interior_dashboard-1774711254614.jpg saved to cache
2026-03-29 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f1bdcc08-aa81-5463-9d87-ca9f76950a61
2026-03-29 20:10:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1bdcc08-aa81-5463-9d87-ca9f76950a61, skipping ID generation
2026-03-29 20:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1bdcc08-aa81-5463-9d87-ca9f76950a61 with scrape type 1
2026-03-29 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1bdcc08-aa81-5463-9d87-ca9f76950a61 sending to next pipeline
2026-03-29 20:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f1bdcc08-aa81-5463-9d87-ca9f76950a61, identifier: 20465867
2026-03-29 20:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f1bdcc08-aa81-5463-9d87-ca9f76950a61 with identifier: 20465867
2026-03-29 20:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f1bdcc08-aa81-5463-9d87-ca9f76950a61 with identifier: 20465867
2026-03-29 20:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f1bdcc08-aa81-5463-9d87-ca9f76950a61 with identifier: 20465867 to the API
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5867/20465867/interior_dashboard-1774711254614.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'f1bdcc08-aa81-5463-9d87-ca9f76950a61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO23 LVC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20465867',
'listing': 'auction',
'location': 'West Berkshire Reading',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 37099,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2204951,
'Height': 2877,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_front_driver-1774712240414.jpg',
'Width': 3836},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1562984,
'Height': 2589,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_rear_driver-1774710530515.jpg',
'Width': 3452},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1393283,
'Height': 2430,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_front_passenger-1774710514386.jpg',
'Width': 3240},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1635878,
'Height': 2611,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5867/20465867/exterior_rear_passenger-1774710488704.jpg',
'Width': 3481},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2018389,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5867/20465867/interior_front_seats-1774711188647.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1586630,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5867/20465867/interior_rear_seats-1774711272362.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2595082,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5867/20465867/interior_dashboard-1774711254614.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1350487,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5867/20465867/instrument_cluster-1774712771547.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2621968,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5867/20465867/interior_boot-1774711199087.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bdcc08-aa81-5463-9d87-ca9f76950a61/f1bdcc08-aa81-5463-9d87-ca9f76950a61_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1122714,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5867/20465867/docs_service_history-1774711959812.jpg?ixlib=js-3.8.0&auto=format&s=497f1221e3824a336564532326ede3b9',
'Width': 2880}],
'price': 14678,
'price_includes_vat': False,
'registration_date': '2023-03-16',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Yaris Excel HEV CVT',
'transmission': 'automatic',
'trim': 'Excel HEV CVT',
'vin': 'VNKKBAC330A273532',
'year': 2023}
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720465867%27 HTTP/1.1" 200 None
2026-03-29 20:10:07 [motorway.uk] INFO: Saving data for 20465867: {'created_time': 1774815007.830647, 'last_price_update_time': 1774815007.830658, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20465867') HTTP/1.1" 204 0
2026-03-29 20:10:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cabab50>
2026-03-29 20:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9208%252F6409208%252Finterior_dashboard-1774712653736.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9208/6409208/interior_dashboard-1774712653736.jpg saved to cache
2026-03-29 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8712e47-b601-53f6-93c0-61afaa3dc9b6
2026-03-29 20:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9208/6409208/docs_service_history-1774712863109.jpg?ixlib=js-3.8.0&auto=format&s=3abb1c7827b3f53c1633b8dce42b13c2> (referer: None)
2026-03-29 20:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_front_driver-1774712019214.jpg> (referer: None)
2026-03-29 20:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_front_driver-1774709080529.jpeg> (referer: None)
2026-03-29 20:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_rear_passenger-1774712051420.jpg> (referer: None)
2026-03-29 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_front_passenger-1774712069093.jpg> (referer: None)
2026-03-29 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_rear_driver-1774712036527.jpg> (referer: None)
2026-03-29 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9208/6409208/instrument_cluster-1774712698311.jpg> (referer: None)
2026-03-29 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9208/6409208/interior_front_seats-1774712601622.jpg> (referer: None)
2026-03-29 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9208/6409208/interior_rear_seats-1774712614392.jpg> (referer: None)
2026-03-29 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9208/6409208/interior_boot-1774712672420.jpg> (referer: None)
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc88990>
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9208%252F6409208%252Fdocs_service_history-1774712863109.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3abb1c7827b3f53c1633b8dce42b13c2') HTTP/1.1" 204 0
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9208/6409208/docs_service_history-1774712863109.jpg?ixlib=js-3.8.0&auto=format&s=3abb1c7827b3f53c1633b8dce42b13c2 saved to cache
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8712e47-b601-53f6-93c0-61afaa3dc9b6
2026-03-29 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20304701.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c703110>
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9208%252F6409208%252Fexterior_front_driver-1774712019214.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_front_driver-1774712019214.jpg saved to cache
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8712e47-b601-53f6-93c0-61afaa3dc9b6
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e192c90>
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6280%252F14956280%252Fexterior_front_driver-1774709080529.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_front_driver-1774709080529.jpeg saved to cache
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item adcd354e-592f-5f58-bb87-708c2eb561f8
2026-03-29 20:10:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: adcd354e-592f-5f58-bb87-708c2eb561f8, skipping ID generation
2026-03-29 20:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adcd354e-592f-5f58-bb87-708c2eb561f8 with scrape type 1
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item adcd354e-592f-5f58-bb87-708c2eb561f8 sending to next pipeline
2026-03-29 20:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: adcd354e-592f-5f58-bb87-708c2eb561f8, identifier: 14956280
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0dd790>
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9208%252F6409208%252Fexterior_rear_passenger-1774712051420.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_rear_passenger-1774712051420.jpg saved to cache
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8712e47-b601-53f6-93c0-61afaa3dc9b6
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c789210>
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9208%252F6409208%252Fexterior_front_passenger-1774712069093.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_front_passenger-1774712069093.jpg saved to cache
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8712e47-b601-53f6-93c0-61afaa3dc9b6
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d06b250>
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9208%252F6409208%252Fexterior_rear_driver-1774712036527.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_rear_driver-1774712036527.jpg saved to cache
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8712e47-b601-53f6-93c0-61afaa3dc9b6
2026-03-29 20:10:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f645f90>
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9208%252F6409208%252Finstrument_cluster-1774712698311.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9208/6409208/instrument_cluster-1774712698311.jpg saved to cache
2026-03-29 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8712e47-b601-53f6-93c0-61afaa3dc9b6
2026-03-29 20:10:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d06a290>
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9208%252F6409208%252Finterior_front_seats-1774712601622.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9208/6409208/interior_front_seats-1774712601622.jpg saved to cache
2026-03-29 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8712e47-b601-53f6-93c0-61afaa3dc9b6
2026-03-29 20:10:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e074c10>
2026-03-29 20:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9208%252F6409208%252Finterior_rear_seats-1774712614392.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9208/6409208/interior_rear_seats-1774712614392.jpg saved to cache
2026-03-29 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8712e47-b601-53f6-93c0-61afaa3dc9b6
2026-03-29 20:10:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c76dd90>
2026-03-29 20:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9208%252F6409208%252Finterior_boot-1774712672420.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9208/6409208/interior_boot-1774712672420.jpg saved to cache
2026-03-29 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8712e47-b601-53f6-93c0-61afaa3dc9b6
2026-03-29 20:10:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8712e47-b601-53f6-93c0-61afaa3dc9b6, skipping ID generation
2026-03-29 20:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8712e47-b601-53f6-93c0-61afaa3dc9b6 with scrape type 1
2026-03-29 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8712e47-b601-53f6-93c0-61afaa3dc9b6 sending to next pipeline
2026-03-29 20:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a8712e47-b601-53f6-93c0-61afaa3dc9b6, identifier: 6409208
2026-03-29 20:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: adcd354e-592f-5f58-bb87-708c2eb561f8 with identifier: 14956280
2026-03-29 20:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: adcd354e-592f-5f58-bb87-708c2eb561f8 with identifier: 14956280
2026-03-29 20:10:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: adcd354e-592f-5f58-bb87-708c2eb561f8 with identifier: 14956280 to the API
2026-03-29 20:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_front_driver-1774709080529.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'adcd354e-592f-5f58-bb87-708c2eb561f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP72 XTJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14956280',
'listing': 'auction',
'location': 'Greater London London',
'make': 'MINI',
'model': 'Cooper',
'odometer': 32793,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1241051,
'Height': 2167,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_front_driver-1774709080529.jpeg',
'Width': 2889},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1303857,
'Height': 2435,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_rear_driver-1774709165177.jpeg',
'Width': 3247},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1146263,
'Height': 2153,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_front_passenger-1774709113184.jpeg',
'Width': 2871},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1061901,
'Height': 2237,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6280/14956280/exterior_rear_passenger-1774709132176.jpeg',
'Width': 2982},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3941765,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6280/14956280/interior_front_seats-1774709214710.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 5541745,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6280/14956280/interior_rear_seats-1774710573408.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1947185,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6280/14956280/14956280-interior_dashboard-modified-1774711781117.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1965761,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6280/14956280/instrument_cluster-1774709379827.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2984337,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6280/14956280/interior_boot-1774710311823.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adcd354e-592f-5f58-bb87-708c2eb561f8/adcd354e-592f-5f58-bb87-708c2eb561f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3528214,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6280/14956280/docs_service_history-1774711237762.jpeg?ixlib=js-3.8.0&auto=format&s=3073e6b54fdcd3001f7904d1174b4d4b',
'Width': 4032}],
'price': 14643,
'price_includes_vat': False,
'registration_date': '2022-12-17',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper Classic Auto',
'transmission': 'automatic',
'trim': 'Classic Auto',
'vin': 'WMW32DK0602T93919',
'year': 2022}
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714956280%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [motorway.uk] INFO: Saving data for 14956280: {'created_time': 1774815010.037925, 'last_price_update_time': 1774815010.037938, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14956280') HTTP/1.1" 204 0
2026-03-29 20:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a8712e47-b601-53f6-93c0-61afaa3dc9b6 with identifier: 6409208
2026-03-29 20:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a8712e47-b601-53f6-93c0-61afaa3dc9b6 with identifier: 6409208
2026-03-29 20:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a8712e47-b601-53f6-93c0-61afaa3dc9b6 with identifier: 6409208 to the API
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9208/6409208/interior_boot-1774712672420.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'a8712e47-b601-53f6-93c0-61afaa3dc9b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'NV21 KVB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/6409208',
'listing': 'auction',
'location': 'Stockton-on-Tees Stockton-on-Tees',
'make': 'Honda',
'model': 'CR-V',
'odometer': 59800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2075839,
'Height': 2638,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_front_driver-1774712019214.jpg',
'Width': 3517},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2147361,
'Height': 2663,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_rear_driver-1774712036527.jpg',
'Width': 3550},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2007382,
'Height': 2639,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_front_passenger-1774712069093.jpg',
'Width': 3518},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1348484,
'Height': 2351,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9208/6409208/exterior_rear_passenger-1774712051420.jpg',
'Width': 3135},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3324706,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9208/6409208/interior_front_seats-1774712601622.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3473336,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9208/6409208/interior_rear_seats-1774712614392.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2922753,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9208/6409208/interior_dashboard-1774712653736.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2596122,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9208/6409208/instrument_cluster-1774712698311.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3806284,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9208/6409208/interior_boot-1774712672420.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8712e47-b601-53f6-93c0-61afaa3dc9b6/a8712e47-b601-53f6-93c0-61afaa3dc9b6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641801,
'Height': 1911,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9208/6409208/docs_service_history-1774712863109.jpg?ixlib=js-3.8.0&auto=format&s=3abb1c7827b3f53c1633b8dce42b13c2',
'Width': 2690}],
'price': 17940,
'price_includes_vat': False,
'registration_date': '2021-07-26',
'seats_number': None,
'seller_name': None,
'title': 'Honda CR-V EX I-MMD CVT',
'transmission': 'automatic',
'trim': 'EX I-MMD CVT',
'vin': 'JHMRT6880MX206215',
'year': 2021}
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276409208%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [motorway.uk] INFO: Saving data for 6409208: {'created_time': 1774815010.464895, 'last_price_update_time': 1774815010.464906, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='6409208') HTTP/1.1" 204 0
2026-03-29 20:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20500409.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=864&page=24&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a505728c-0e68-5d43-a634-6c70d3b26c44 with identifier: 20304701
2026-03-29 20:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a505728c-0e68-5d43-a634-6c70d3b26c44 with scrape type 1
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a505728c-0e68-5d43-a634-6c70d3b26c44
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4701%252F20304701%252Fexterior_front_driver-1774339194494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_front_driver-1774339194494.jpg not downloaded yet
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4701%252F20304701%252Fexterior_rear_driver-1774339212467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_rear_driver-1774339212467.jpg not downloaded yet
2026-03-29 20:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_rear_passenger-1774719547424.jpg> (referer: None)
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4701%252F20304701%252Fexterior_front_passenger-1774339243874.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_front_passenger-1774339243874.jpg not downloaded yet
2026-03-29 20:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_rear_driver-1774719515071.jpg> (referer: None)
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4701%252F20304701%252Fexterior_rear_passenger-1774339225270.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_rear_passenger-1774339225270.jpg not downloaded yet
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4701%252F20304701%252Finterior_front_seats-1774339614248.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4701/20304701/interior_front_seats-1774339614248.jpg not downloaded yet
2026-03-29 20:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_front_passenger-1774719593761.jpg> (referer: None)
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4701%252F20304701%252Finterior_rear_seats-1774696269575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4701/20304701/interior_rear_seats-1774696269575.jpg not downloaded yet
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4701%252F20304701%252Finterior_dashboard-1774339648513.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4701/20304701/interior_dashboard-1774339648513.jpg not downloaded yet
2026-03-29 20:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95e934b1-801f-5013-bc1d-82bb393ad01a with identifier: 20500409
2026-03-29 20:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95e934b1-801f-5013-bc1d-82bb393ad01a with scrape type 1
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95e934b1-801f-5013-bc1d-82bb393ad01a
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F20500409%252Fexterior_front_driver-1774777310798.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_front_driver-1774777310798.jpg not downloaded yet
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 1329664
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%271329664%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [motorway.uk] INFO: Scrape type for 1329664: 1
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4701%252F20304701%252Finterior_boot-1774339660025.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4701/20304701/interior_boot-1774339660025.jpg not downloaded yet
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F20500409%252Fexterior_rear_driver-1774777321612.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_rear_driver-1774777321612.jpg not downloaded yet
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 20409002
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 18827226
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 20436077
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 16052794
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 20401398
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 20375710
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 17939747
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717939747%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [motorway.uk] INFO: Scrape type for 17939747: 1
2026-03-29 20:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20421513.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4701%252F20304701%252Fdocs_service_history-1774339799868.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9d0071091587da48b66df33be3029b13%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4701/20304701/docs_service_history-1774339799868.jpg?ixlib=js-3.8.0&auto=format&s=9d0071091587da48b66df33be3029b13 not downloaded yet
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F20500409%252Fexterior_front_passenger-1774777353692.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_front_passenger-1774777353692.jpg not downloaded yet
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 20202196
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 18800703
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 12120509
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 14548428
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 20386514
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 17979492
2026-03-29 20:10:10 [motorway.uk] INFO: Found listing with ID: 20435734
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720435734%27 HTTP/1.1" 200 None
2026-03-29 20:10:10 [motorway.uk] INFO: Scrape type for 20435734: 1
2026-03-29 20:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e039e90>
2026-03-29 20:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9520%252F17749520%252Fexterior_rear_passenger-1774719547424.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_rear_passenger-1774719547424.jpg saved to cache
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4a5c213-3796-5e0c-aec5-f14a83ccc118
2026-03-29 20:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc63550>
2026-03-29 20:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9520%252F17749520%252Fexterior_rear_driver-1774719515071.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_rear_driver-1774719515071.jpg saved to cache
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4a5c213-3796-5e0c-aec5-f14a83ccc118
2026-03-29 20:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7613d0>
2026-03-29 20:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9520%252F17749520%252Fexterior_front_passenger-1774719593761.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_front_passenger-1774719593761.jpg saved to cache
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4a5c213-3796-5e0c-aec5-f14a83ccc118
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4701%252F20304701%252Fdocs_service_history-1774339800756.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D262d6b9e3d42de3b279214af150dd647%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4701/20304701/docs_service_history-1774339800756.jpg?ixlib=js-3.8.0&auto=format&s=262d6b9e3d42de3b279214af150dd647 not downloaded yet
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F20500409%252Fexterior_rear_passenger-1774777341214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_rear_passenger-1774777341214.jpg not downloaded yet
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 19226483
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 20265624
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720265624%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [motorway.uk] INFO: Scrape type for 20265624: 2
2026-03-29 20:10:11 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12871557) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5648/11445648/interior_boot-1774788667741.jpeg>.
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0409%252F20500409%252Finterior_front_seats-1774780217725.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0409/20500409/interior_front_seats-1774780217725.jpg not downloaded yet
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 7585646
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 19995676
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 16512497
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 20498788
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 6438177
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 20309766
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 20454787
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 20456993
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 20486739
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 20130808
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 20423862
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 20283454
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 10973365
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 20392215
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 20496032
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 19667593
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719667593%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [motorway.uk] INFO: Scrape type for 19667593: 1
2026-03-29 20:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0409%252F20500409%252Finterior_rear_seats-1774777754259.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0409/20500409/interior_rear_seats-1774777754259.jpg not downloaded yet
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 13151440
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 19970268
2026-03-29 20:10:11 [motorway.uk] INFO: Found listing with ID: 20240702
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720240702%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [motorway.uk] INFO: Scrape type for 20240702: 1
2026-03-29 20:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05cb53a8-4f85-5142-8548-a8943301ebe7 with identifier: 20421513
2026-03-29 20:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05cb53a8-4f85-5142-8548-a8943301ebe7 with scrape type 1
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05cb53a8-4f85-5142-8548-a8943301ebe7
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1513%252F20421513%252Fexterior_front_driver-1774361318349.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_front_driver-1774361318349.jpg not downloaded yet
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F20500409%252Finterior_dashboard-1774777779316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/20500409/interior_dashboard-1774777779316.jpg not downloaded yet
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1513%252F20421513%252Fexterior_rear_driver-1774361350433.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_rear_driver-1774361350433.jpg not downloaded yet
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F20500409%252Finstrument_cluster-1774777821199.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/20500409/instrument_cluster-1774777821199.jpg not downloaded yet
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1513%252F20421513%252Fexterior_front_passenger-1774361637182.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_front_passenger-1774361637182.jpg not downloaded yet
2026-03-29 20:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_front_driver-1774719502127.jpg> (referer: None)
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0409%252F20500409%252Finterior_boot-1774777790118.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0409/20500409/interior_boot-1774777790118.jpg not downloaded yet
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1513%252F20421513%252Fexterior_rear_passenger-1774361771447.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_rear_passenger-1774361771447.jpg not downloaded yet
2026-03-29 20:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_front_passenger-1774693815886.jpg> (referer: None)
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0409%252F20500409%252Fdocs_service_history-1774778067599.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6e0334a50d02108825835b9bb50b5cf5%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0409/20500409/docs_service_history-1774778067599.jpg?ixlib=js-3.8.0&auto=format&s=6e0334a50d02108825835b9bb50b5cf5 not downloaded yet
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1513%252F20421513%252Finterior_front_seats-1774363016317.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1513/20421513/interior_front_seats-1774363016317.jpg not downloaded yet
2026-03-29 20:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_rear_passenger-1774339225270.jpg> (referer: None)
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1513%252F20421513%252Finterior_rear_seats-1774363311572.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1513/20421513/interior_rear_seats-1774363311572.jpg not downloaded yet
2026-03-29 20:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_front_passenger-1774339243874.jpg> (referer: None)
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1513%252F20421513%252Finterior_dashboard-1774522409419.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1513/20421513/interior_dashboard-1774522409419.jpg not downloaded yet
2026-03-29 20:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d748750>
2026-03-29 20:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9520%252F17749520%252Fexterior_front_driver-1774719502127.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_front_driver-1774719502127.jpg saved to cache
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4a5c213-3796-5e0c-aec5-f14a83ccc118
2026-03-29 20:10:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4a5c213-3796-5e0c-aec5-f14a83ccc118, skipping ID generation
2026-03-29 20:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4a5c213-3796-5e0c-aec5-f14a83ccc118 with scrape type 1
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4a5c213-3796-5e0c-aec5-f14a83ccc118 sending to next pipeline
2026-03-29 20:10:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f4a5c213-3796-5e0c-aec5-f14a83ccc118, identifier: 17749520
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1513%252F20421513%252Finstrument_cluster-1774363092187.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1513/20421513/instrument_cluster-1774363092187.jpg not downloaded yet
2026-03-29 20:10:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f4a5c213-3796-5e0c-aec5-f14a83ccc118 with identifier: 17749520
2026-03-29 20:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f4a5c213-3796-5e0c-aec5-f14a83ccc118 with identifier: 17749520
2026-03-29 20:10:12 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f4a5c213-3796-5e0c-aec5-f14a83ccc118 with identifier: 17749520 to the API
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_front_driver-1774719502127.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f4a5c213-3796-5e0c-aec5-f14a83ccc118',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EL15 EBG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17749520',
'listing': 'auction',
'location': 'Medway Gillingham',
'make': 'MINI',
'model': 'Cooper',
'odometer': 22500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1179229,
'Height': 2387,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_front_driver-1774719502127.jpg',
'Width': 3182},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1092242,
'Height': 2366,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_rear_driver-1774719515071.jpg',
'Width': 3154},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1224857,
'Height': 2324,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_front_passenger-1774719593761.jpg',
'Width': 3099},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1284944,
'Height': 2490,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9520/17749520/exterior_rear_passenger-1774719547424.jpg',
'Width': 3320},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3156831,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9520/17749520/interior_front_seats-1774719907453.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2495022,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9520/17749520/interior_rear_seats-1774719822730.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2276270,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9520/17749520/interior_dashboard-1774772724100.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2194104,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9520/17749520/instrument_cluster-1774720251890.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3078504,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9520/17749520/interior_boot-1774720122753.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a5c213-3796-5e0c-aec5-f14a83ccc118/f4a5c213-3796-5e0c-aec5-f14a83ccc118_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1300342,
'Height': 764,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9520/17749520/docs_service_history-1774719972971.jpg?ixlib=js-3.8.0&auto=format&s=f963e4a5eb6af31226c172382ac88a14',
'Width': 2142}],
'price': 17650,
'price_includes_vat': False,
'registration_date': '2021-07-30',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper S Sport Auto',
'transmission': 'automatic',
'trim': 'S Sport Auto',
'vin': 'WMW52DH0702R07891',
'year': 2021}
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717749520%27 HTTP/1.1" 200 None
2026-03-29 20:10:12 [motorway.uk] INFO: Saving data for 17749520: {'created_time': 1774815012.324985, 'last_price_update_time': 1774815012.324996, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17749520') HTTP/1.1" 204 0
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1513%252F20421513%252Finterior_boot-1774363186898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1513/20421513/interior_boot-1774363186898.jpg not downloaded yet
2026-03-29 20:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_rear_driver-1774693793504.jpg> (referer: None)
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8ef650>
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3285%252F20463285%252Fexterior_front_passenger-1774693815886.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_front_passenger-1774693815886.jpg saved to cache
2026-03-29 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a45be190-b549-5073-bfc0-7d75f7db0dbe
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd42090>
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4701%252F20304701%252Fexterior_rear_passenger-1774339225270.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_rear_passenger-1774339225270.jpg saved to cache
2026-03-29 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a505728c-0e68-5d43-a634-6c70d3b26c44
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddab750>
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4701%252F20304701%252Fexterior_front_passenger-1774339243874.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_front_passenger-1774339243874.jpg saved to cache
2026-03-29 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a505728c-0e68-5d43-a634-6c70d3b26c44
2026-03-29 20:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_front_driver-1774339194494.jpg> (referer: None)
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1513%252F20421513%252Fdocs_service_history-1774520670422.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8597cb81d9a0b60347c986abf273c013%27 HTTP/1.1" 200 None
2026-03-29 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1513/20421513/docs_service_history-1774520670422.jpg?ixlib=js-3.8.0&auto=format&s=8597cb81d9a0b60347c986abf273c013 not downloaded yet
2026-03-29 20:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20498769.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d67c890>
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3285%252F20463285%252Fexterior_rear_driver-1774693793504.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_rear_driver-1774693793504.jpg saved to cache
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a45be190-b549-5073-bfc0-7d75f7db0dbe
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4b0950>
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4701%252F20304701%252Fexterior_front_driver-1774339194494.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_front_driver-1774339194494.jpg saved to cache
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a505728c-0e68-5d43-a634-6c70d3b26c44
2026-03-29 20:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4532b99-c348-5c81-9aa2-d934294ccea4 with identifier: 20498769
2026-03-29 20:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4532b99-c348-5c81-9aa2-d934294ccea4 with scrape type 1
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4532b99-c348-5c81-9aa2-d934294ccea4
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Fexterior_front_driver-1774774513675.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_front_driver-1774774513675.jpg not downloaded yet
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Fexterior_rear_driver-1774774523017.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_rear_driver-1774774523017.jpg not downloaded yet
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Fexterior_front_passenger-1774774602584.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_front_passenger-1774774602584.jpg not downloaded yet
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Fexterior_rear_passenger-1774774542365.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_rear_passenger-1774774542365.jpg not downloaded yet
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8769%252F20498769%252Finterior_front_seats-1774774774147.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8769/20498769/interior_front_seats-1774774774147.jpg not downloaded yet
2026-03-29 20:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1513/20421513/docs_service_history-1774520670422.jpg?ixlib=js-3.8.0&auto=format&s=8597cb81d9a0b60347c986abf273c013> (referer: None)
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8769%252F20498769%252Finterior_rear_seats-1774774879128.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8769/20498769/interior_rear_seats-1774774879128.jpg not downloaded yet
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Finterior_dashboard-1774774828795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/interior_dashboard-1774774828795.jpg not downloaded yet
2026-03-29 20:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_rear_passenger-1774361771447.jpg> (referer: None)
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Finstrument_cluster-1774774904207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/instrument_cluster-1774774904207.jpg not downloaded yet
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8769%252F20498769%252Finterior_boot-1774774841591.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8769/20498769/interior_boot-1774774841591.jpg not downloaded yet
2026-03-29 20:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19570678.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Fwheels_front_driver-1774774756409.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/wheels_front_driver-1774774756409.jpg not downloaded yet
2026-03-29 20:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5648/11445648/docs_service_history-1774790518407.jpeg?ixlib=js-3.8.0&auto=format&s=28dd7adbca53ea233d5060fc308a8e19> (referer: None)
2026-03-29 20:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_rear_driver-1774361350433.jpg> (referer: None)
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2bea50>
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1513%252F20421513%252Fdocs_service_history-1774520670422.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8597cb81d9a0b60347c986abf273c013') HTTP/1.1" 204 0
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1513/20421513/docs_service_history-1774520670422.jpg?ixlib=js-3.8.0&auto=format&s=8597cb81d9a0b60347c986abf273c013 saved to cache
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05cb53a8-4f85-5142-8548-a8943301ebe7
2026-03-29 20:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3285/20463285/interior_front_seats-1774781452031.jpg> (referer: None)
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca4c450>
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1513%252F20421513%252Fexterior_rear_passenger-1774361771447.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_rear_passenger-1774361771447.jpg saved to cache
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05cb53a8-4f85-5142-8548-a8943301ebe7
2026-03-29 20:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3285/20463285/interior_rear_seats-1774781226658.jpg> (referer: None)
2026-03-29 20:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b986a516-e46a-5fd4-9581-ebca3b603e96 with identifier: 19570678
2026-03-29 20:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b986a516-e46a-5fd4-9581-ebca3b603e96 with scrape type 1
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b986a516-e46a-5fd4-9581-ebca3b603e96
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F19570678%252Fexterior_front_driver-1774708820545.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_front_driver-1774708820545.jpg not downloaded yet
2026-03-29 20:10:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:10:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5e4350>
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16777483-44df-59ed-b1e2-03271f9671b7/16777483-44df-59ed-b1e2-03271f9671b7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5648%252F11445648%252Fdocs_service_history-1774790518407.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D28dd7adbca53ea233d5060fc308a8e19') HTTP/1.1" 204 0
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5648/11445648/docs_service_history-1774790518407.jpeg?ixlib=js-3.8.0&auto=format&s=28dd7adbca53ea233d5060fc308a8e19 saved to cache
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 16777483-44df-59ed-b1e2-03271f9671b7
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c715290>
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1513%252F20421513%252Fexterior_rear_driver-1774361350433.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_rear_driver-1774361350433.jpg saved to cache
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05cb53a8-4f85-5142-8548-a8943301ebe7
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F19570678%252Fexterior_rear_driver-1774708834809.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_rear_driver-1774708834809.jpg not downloaded yet
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F19570678%252Fexterior_front_passenger-1774708822317.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_front_passenger-1774708822317.jpg not downloaded yet
2026-03-29 20:10:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc7c350>
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3285%252F20463285%252Finterior_front_seats-1774781452031.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3285/20463285/interior_front_seats-1774781452031.jpg saved to cache
2026-03-29 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a45be190-b549-5073-bfc0-7d75f7db0dbe
2026-03-29 20:10:14 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:14 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:14 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x004\xd7\x8e\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\xd8(\x004\xa9\xcd\x00\x00\x00\x00'
2026-03-29 20:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6e7450>
2026-03-29 20:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3285%252F20463285%252Finterior_rear_seats-1774781226658.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3285/20463285/interior_rear_seats-1774781226658.jpg saved to cache
2026-03-29 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a45be190-b549-5073-bfc0-7d75f7db0dbe
2026-03-29 20:10:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a45be190-b549-5073-bfc0-7d75f7db0dbe, skipping ID generation
2026-03-29 20:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a45be190-b549-5073-bfc0-7d75f7db0dbe with scrape type 1
2026-03-29 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a45be190-b549-5073-bfc0-7d75f7db0dbe sending to next pipeline
2026-03-29 20:10:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a45be190-b549-5073-bfc0-7d75f7db0dbe, identifier: 20463285
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F19570678%252Fexterior_rear_passenger-1774708833684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_rear_passenger-1774708833684.jpg not downloaded yet
2026-03-29 20:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a45be190-b549-5073-bfc0-7d75f7db0dbe with identifier: 20463285
2026-03-29 20:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a45be190-b549-5073-bfc0-7d75f7db0dbe with identifier: 20463285
2026-03-29 20:10:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a45be190-b549-5073-bfc0-7d75f7db0dbe with identifier: 20463285 to the API
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3285/20463285/interior_rear_seats-1774781226658.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'a45be190-b549-5073-bfc0-7d75f7db0dbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CJ21 UXN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20463285',
'listing': 'auction',
'location': 'Nottinghamshire Nottingham',
'make': 'BMW',
'model': '5 Series',
'odometer': 44166,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1601886,
'Height': 2403,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_front_driver-1774693819884.jpg',
'Width': 3204},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1524534,
'Height': 2297,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_rear_driver-1774693793504.jpg',
'Width': 3062},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1331814,
'Height': 2257,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_front_passenger-1774693815886.jpg',
'Width': 3009},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1620392,
'Height': 2357,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3285/20463285/exterior_rear_passenger-1774693804214.jpg',
'Width': 3142},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3291540,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3285/20463285/interior_front_seats-1774781452031.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3846070,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3285/20463285/interior_rear_seats-1774781226658.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2186734,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3285/20463285/interior_dashboard-1774781336832.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1679003,
'Height': 2934,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3285/20463285/instrument_cluster-1774782435177.jpg',
'Width': 3912},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3802961,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3285/20463285/interior_boot-1774699067338.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45be190-b549-5073-bfc0-7d75f7db0dbe/a45be190-b549-5073-bfc0-7d75f7db0dbe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1468120,
'Height': 2503,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3285/20463285/wheels_front_driver-1774693841977.jpg',
'Width': 3337}],
'price': 22980,
'price_includes_vat': False,
'registration_date': '2021-07-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW 520I M Sport MHEV Auto',
'transmission': 'automatic',
'trim': '520I M Sport MHEV Auto',
'vin': 'WBA12BM080CH65332',
'year': 2021}
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720463285%27 HTTP/1.1" 200 None
2026-03-29 20:10:14 [motorway.uk] INFO: Saving data for 20463285: {'created_time': 1774815014.733422, 'last_price_update_time': 1774815014.733436, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20463285') HTTP/1.1" 204 0
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0678%252F19570678%252F19570678-interior_front_seats-modified-1774716150495.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0678/19570678/19570678-interior_front_seats-modified-1774716150495.jpeg not downloaded yet
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0678%252F19570678%252Finterior_rear_seats-1774710214658.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0678/19570678/interior_rear_seats-1774710214658.jpg not downloaded yet
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0678%252F19570678%252F19570678-interior_dashboard-modified-1774714957727.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0678/19570678/19570678-interior_dashboard-modified-1774714957727.jpeg not downloaded yet
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0678%252F19570678%252Finterior_boot-1774709172438.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0678/19570678/interior_boot-1774709172438.jpg not downloaded yet
2026-03-29 20:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1513/20421513/interior_front_seats-1774363016317.jpg> (referer: None)
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0678%252F19570678%252Fdocs_service_history-1774712275192.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc90f57d8d0df6265940d9725ba01ab41%27 HTTP/1.1" 200 None
2026-03-29 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0678/19570678/docs_service_history-1774712275192.jpg?ixlib=js-3.8.0&auto=format&s=c90f57d8d0df6265940d9725ba01ab41 not downloaded yet
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0678%252F19570678%252Fdocs_service_history-1774712289128.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D63b25184f2df78f96ac489d3be48826d%27 HTTP/1.1" 200 None
2026-03-29 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0678/19570678/docs_service_history-1774712289128.jpg?ixlib=js-3.8.0&auto=format&s=63b25184f2df78f96ac489d3be48826d not downloaded yet
2026-03-29 20:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1513/20421513/instrument_cluster-1774363092187.jpg> (referer: None)
2026-03-29 20:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1513/20421513/interior_dashboard-1774522409419.jpg> (referer: None)
2026-03-29 20:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8769/20498769/interior_dashboard-1774774828795.jpg> (referer: None)
2026-03-29 20:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1513/20421513/interior_boot-1774363186898.jpg> (referer: None)
2026-03-29 20:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5648/11445648/exterior_rear_passenger-1774787183927.jpeg> (referer: None)
2026-03-29 20:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_front_driver-1774708820545.jpg> (referer: None)
2026-03-29 20:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8769/20498769/interior_boot-1774774841591.jpg> (referer: None)
2026-03-29 20:10:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e122e90>
2026-03-29 20:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1513%252F20421513%252Finterior_front_seats-1774363016317.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1513/20421513/interior_front_seats-1774363016317.jpg saved to cache
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05cb53a8-4f85-5142-8548-a8943301ebe7
2026-03-29 20:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8769/20498769/interior_front_seats-1774774774147.jpg> (referer: None)
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2df24f50>
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1513%252F20421513%252Finstrument_cluster-1774363092187.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1513/20421513/instrument_cluster-1774363092187.jpg saved to cache
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05cb53a8-4f85-5142-8548-a8943301ebe7
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de1afd0>
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1513%252F20421513%252Finterior_dashboard-1774522409419.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1513/20421513/interior_dashboard-1774522409419.jpg saved to cache
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05cb53a8-4f85-5142-8548-a8943301ebe7
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2b5b50>
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Finterior_dashboard-1774774828795.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/interior_dashboard-1774774828795.jpg saved to cache
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4532b99-c348-5c81-9aa2-d934294ccea4
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f439a50>
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1513%252F20421513%252Finterior_boot-1774363186898.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1513/20421513/interior_boot-1774363186898.jpg saved to cache
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05cb53a8-4f85-5142-8548-a8943301ebe7
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de1a250>
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16777483-44df-59ed-b1e2-03271f9671b7/16777483-44df-59ed-b1e2-03271f9671b7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5648%252F11445648%252Fexterior_rear_passenger-1774787183927.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5648/11445648/exterior_rear_passenger-1774787183927.jpeg saved to cache
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16777483-44df-59ed-b1e2-03271f9671b7
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f43a910>
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F19570678%252Fexterior_front_driver-1774708820545.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_front_driver-1774708820545.jpg saved to cache
2026-03-29 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b986a516-e46a-5fd4-9581-ebca3b603e96
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c692a90>
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8769%252F20498769%252Finterior_boot-1774774841591.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8769/20498769/interior_boot-1774774841591.jpg saved to cache
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a4532b99-c348-5c81-9aa2-d934294ccea4
2026-03-29 20:10:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4dce90>
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8769%252F20498769%252Finterior_front_seats-1774774774147.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8769/20498769/interior_front_seats-1774774774147.jpg saved to cache
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4532b99-c348-5c81-9aa2-d934294ccea4
2026-03-29 20:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_front_passenger-1774708822317.jpg> (referer: None)
2026-03-29 20:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_rear_passenger-1774708833684.jpg> (referer: None)
2026-03-29 20:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_rear_driver-1774708834809.jpg> (referer: None)
2026-03-29 20:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20479213.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:16 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5648/11445648/interior_boot-1774788667741.jpeg>.
2026-03-29 20:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0678/19570678/interior_boot-1774709172438.jpg> (referer: None)
2026-03-29 20:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5648/11445648/interior_boot-1774788667741.jpeg> (referer: None)
2026-03-29 20:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18272017.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d590c90>
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F19570678%252Fexterior_front_passenger-1774708822317.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_front_passenger-1774708822317.jpg saved to cache
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b986a516-e46a-5fd4-9581-ebca3b603e96
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7abf90>
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F19570678%252Fexterior_rear_passenger-1774708833684.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_rear_passenger-1774708833684.jpg saved to cache
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b986a516-e46a-5fd4-9581-ebca3b603e96
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f68d410>
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F19570678%252Fexterior_rear_driver-1774708834809.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_rear_driver-1774708834809.jpg saved to cache
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b986a516-e46a-5fd4-9581-ebca3b603e96
2026-03-29 20:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c with identifier: 20479213
2026-03-29 20:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c with scrape type 1
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9213%252F20479213%252Fexterior_front_driver-1774686251910.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_front_driver-1774686251910.jpg not downloaded yet
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d56ee10>
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0678%252F19570678%252Finterior_boot-1774709172438.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0678/19570678/interior_boot-1774709172438.jpg saved to cache
2026-03-29 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b986a516-e46a-5fd4-9581-ebca3b603e96
2026-03-29 20:10:16 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:16 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:16 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xb8\xdc\xca\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x0b\x8a\xbb\x00\xb8\xd2\xbe\x00\x00\x00\x00'
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d253190>
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16777483-44df-59ed-b1e2-03271f9671b7/16777483-44df-59ed-b1e2-03271f9671b7_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5648%252F11445648%252Finterior_boot-1774788667741.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5648/11445648/interior_boot-1774788667741.jpeg saved to cache
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 16777483-44df-59ed-b1e2-03271f9671b7
2026-03-29 20:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbc13e4e-30a7-5555-be71-5525f9b0d6e0 with identifier: 18272017
2026-03-29 20:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0 with scrape type 1
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2017%252F18272017%252Fexterior_front_driver-1774695140071.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_front_driver-1774695140071.jpg not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9213%252F20479213%252Fexterior_rear_driver-1774686288067.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_rear_driver-1774686288067.jpg not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2017%252F18272017%252Fexterior_rear_driver-1774695156813.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_rear_driver-1774695156813.jpg not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9213%252F20479213%252Fexterior_front_passenger-1774686297640.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_front_passenger-1774686297640.jpg not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2017%252F18272017%252Fexterior_front_passenger-1774695199729.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_front_passenger-1774695199729.jpg not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9213%252F20479213%252Fexterior_rear_passenger-1774686306614.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_rear_passenger-1774686306614.jpg not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2017%252F18272017%252Fexterior_rear_passenger-1774695181814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_rear_passenger-1774695181814.jpg not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9213%252F20479213%252Finterior_front_seats-1774686646834.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9213/20479213/interior_front_seats-1774686646834.jpg not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2017%252F18272017%252Finterior_front_seats-1774695870297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2017/18272017/interior_front_seats-1774695870297.jpg not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9213%252F20479213%252Finterior_rear_seats-1774690942582.png%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9213/20479213/interior_rear_seats-1774690942582.png not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2017%252F18272017%252Finterior_rear_seats-1774695892532.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2017/18272017/interior_rear_seats-1774695892532.jpg not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9213%252F20479213%252Finterior_dashboard-1774686568491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9213/20479213/interior_dashboard-1774686568491.jpg not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2017%252F18272017%252Finterior_dashboard-1774695930400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2017/18272017/interior_dashboard-1774695930400.jpg not downloaded yet
2026-03-29 20:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20265624.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9213%252F20479213%252Finstrument_cluster-1774691114621.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9213/20479213/instrument_cluster-1774691114621.jpg not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2017%252F18272017%252Finstrument_cluster-1774695937168.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2017/18272017/instrument_cluster-1774695937168.jpg not downloaded yet
2026-03-29 20:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0678/19570678/docs_service_history-1774712289128.jpg?ixlib=js-3.8.0&auto=format&s=63b25184f2df78f96ac489d3be48826d> (referer: None)
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9213%252F20479213%252Finterior_boot-1774686618268.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9213/20479213/interior_boot-1774686618268.jpg not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2017%252F18272017%252Finterior_boot-1774695948015.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2017/18272017/interior_boot-1774695948015.jpg not downloaded yet
2026-03-29 20:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0678/19570678/interior_rear_seats-1774710214658.jpg> (referer: None)
2026-03-29 20:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_front_driver-1774774513675.jpg> (referer: None)
2026-03-29 20:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0678/19570678/docs_service_history-1774712275192.jpg?ixlib=js-3.8.0&auto=format&s=c90f57d8d0df6265940d9725ba01ab41> (referer: None)
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9213%252F20479213%252Fdocs_service_history-1774690025211.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D245e745dd50747ed5dd9b567bda3d288%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9213/20479213/docs_service_history-1774690025211.jpg?ixlib=js-3.8.0&auto=format&s=245e745dd50747ed5dd9b567bda3d288 not downloaded yet
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2017%252F18272017%252Fdocs_service_history-1774696273099.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcebbce1b5e98e07c1c446a868a7fe202%27 HTTP/1.1" 200 None
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2017/18272017/docs_service_history-1774696273099.jpg?ixlib=js-3.8.0&auto=format&s=cebbce1b5e98e07c1c446a868a7fe202 not downloaded yet
2026-03-29 20:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dcc6757-323b-57ba-a968-d891ce888674 with identifier: 20265624
2026-03-29 20:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dcc6757-323b-57ba-a968-d891ce888674 with scrape type 2
2026-03-29 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dcc6757-323b-57ba-a968-d891ce888674 with scrape type 2
2026-03-29 20:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7dcc6757-323b-57ba-a968-d891ce888674, identifier: 20265624
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5b6290>
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0678%252F19570678%252Fdocs_service_history-1774712289128.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D63b25184f2df78f96ac489d3be48826d') HTTP/1.1" 204 0
2026-03-29 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0678/19570678/docs_service_history-1774712289128.jpg?ixlib=js-3.8.0&auto=format&s=63b25184f2df78f96ac489d3be48826d saved to cache
2026-03-29 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b986a516-e46a-5fd4-9581-ebca3b603e96
2026-03-29 20:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7dcc6757-323b-57ba-a968-d891ce888674 with identifier: 20265624
2026-03-29 20:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7dcc6757-323b-57ba-a968-d891ce888674 with identifier: 20265624
2026-03-29 20:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7dcc6757-323b-57ba-a968-d891ce888674 with identifier: 20265624 to the API
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20265624.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7dcc6757-323b-57ba-a968-d891ce888674',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MJ68 BTO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20265624',
'listing': 'auction',
'location': 'None None',
'make': 'DS',
'model': 'DS3',
'odometer': 20890,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 5200,
'price_includes_vat': False,
'registration_date': '2018-09-28',
'seats_number': None,
'seller_name': None,
'title': 'DS DS3 Cafe Racer PureTech S/S',
'transmission': 'manual',
'trim': 'Cafe Racer PureTech S/S',
'vin': 'VF7SAHNZ6JW508810',
'year': 2018}
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720265624%27 HTTP/1.1" 200 None
2026-03-29 20:10:18 [motorway.uk] INFO: Saving data for 20265624: {'auction_closing_time': 1774884600.0, 'created_time': 1774469597.859977, 'last_price_update_time': 1774815018.491643}
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20265624') HTTP/1.1" 204 0
2026-03-29 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0678/19570678/19570678-interior_front_seats-modified-1774716150495.jpeg> (referer: None)
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca56fd0>
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0678%252F19570678%252Finterior_rear_seats-1774710214658.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0678/19570678/interior_rear_seats-1774710214658.jpg saved to cache
2026-03-29 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b986a516-e46a-5fd4-9581-ebca3b603e96
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddb1010>
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Fexterior_front_driver-1774774513675.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_front_driver-1774774513675.jpg saved to cache
2026-03-29 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4532b99-c348-5c81-9aa2-d934294ccea4
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2d44d0>
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0678%252F19570678%252Fdocs_service_history-1774712275192.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc90f57d8d0df6265940d9725ba01ab41') HTTP/1.1" 204 0
2026-03-29 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0678/19570678/docs_service_history-1774712275192.jpg?ixlib=js-3.8.0&auto=format&s=c90f57d8d0df6265940d9725ba01ab41 saved to cache
2026-03-29 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b986a516-e46a-5fd4-9581-ebca3b603e96
2026-03-29 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8769/20498769/wheels_front_driver-1774774756409.jpg> (referer: None)
2026-03-29 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_rear_passenger-1774774542365.jpg> (referer: None)
2026-03-29 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_rear_driver-1774774523017.jpg> (referer: None)
2026-03-29 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_front_passenger-1774774602584.jpg> (referer: None)
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddb3190>
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0678%252F19570678%252F19570678-interior_front_seats-modified-1774716150495.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0678/19570678/19570678-interior_front_seats-modified-1774716150495.jpeg saved to cache
2026-03-29 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b986a516-e46a-5fd4-9581-ebca3b603e96
2026-03-29 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8769/20498769/instrument_cluster-1774774904207.jpg> (referer: None)
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d94b090>
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Fwheels_front_driver-1774774756409.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/wheels_front_driver-1774774756409.jpg saved to cache
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a4532b99-c348-5c81-9aa2-d934294ccea4
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d949fd0>
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Fexterior_rear_passenger-1774774542365.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_rear_passenger-1774774542365.jpg saved to cache
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4532b99-c348-5c81-9aa2-d934294ccea4
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d59ecd0>
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Fexterior_rear_driver-1774774523017.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_rear_driver-1774774523017.jpg saved to cache
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4532b99-c348-5c81-9aa2-d934294ccea4
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d524110>
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Fexterior_front_passenger-1774774602584.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_front_passenger-1774774602584.jpg saved to cache
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4532b99-c348-5c81-9aa2-d934294ccea4
2026-03-29 20:10:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d59d150>
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8769%252F20498769%252Finstrument_cluster-1774774904207.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8769/20498769/instrument_cluster-1774774904207.jpg saved to cache
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4532b99-c348-5c81-9aa2-d934294ccea4
2026-03-29 20:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_rear_driver-1774686288067.jpg> (referer: None)
2026-03-29 20:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_rear_driver-1774695156813.jpg> (referer: None)
2026-03-29 20:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0678/19570678/19570678-interior_dashboard-modified-1774714957727.jpeg> (referer: None)
2026-03-29 20:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1513/20421513/interior_rear_seats-1774363311572.jpg> (referer: None)
2026-03-29 20:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2017/18272017/interior_dashboard-1774695930400.jpg> (referer: None)
2026-03-29 20:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8769/20498769/interior_rear_seats-1774774879128.jpg> (referer: None)
2026-03-29 20:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2017/18272017/instrument_cluster-1774695937168.jpg> (referer: None)
2026-03-29 20:10:19 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (23222123) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9213/20479213/interior_rear_seats-1774690942582.png>.
2026-03-29 20:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2017/18272017/docs_service_history-1774696273099.jpg?ixlib=js-3.8.0&auto=format&s=cebbce1b5e98e07c1c446a868a7fe202> (referer: None)
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1aded0>
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9213%252F20479213%252Fexterior_rear_driver-1774686288067.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_rear_driver-1774686288067.jpg saved to cache
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c
2026-03-29 20:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9213/20479213/instrument_cluster-1774691114621.jpg> (referer: None)
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d56bb10>
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2017%252F18272017%252Fexterior_rear_driver-1774695156813.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_rear_driver-1774695156813.jpg saved to cache
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f332a50>
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0678%252F19570678%252F19570678-interior_dashboard-modified-1774714957727.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0678/19570678/19570678-interior_dashboard-modified-1774714957727.jpeg saved to cache
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b986a516-e46a-5fd4-9581-ebca3b603e96
2026-03-29 20:10:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b986a516-e46a-5fd4-9581-ebca3b603e96, skipping ID generation
2026-03-29 20:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b986a516-e46a-5fd4-9581-ebca3b603e96 with scrape type 1
2026-03-29 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b986a516-e46a-5fd4-9581-ebca3b603e96 sending to next pipeline
2026-03-29 20:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b986a516-e46a-5fd4-9581-ebca3b603e96, identifier: 19570678
2026-03-29 20:10:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4a6910>
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1513%252F20421513%252Finterior_rear_seats-1774363311572.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1513/20421513/interior_rear_seats-1774363311572.jpg saved to cache
2026-03-29 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05cb53a8-4f85-5142-8548-a8943301ebe7
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2d4790>
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2017%252F18272017%252Finterior_dashboard-1774695930400.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2017/18272017/interior_dashboard-1774695930400.jpg saved to cache
2026-03-29 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0
2026-03-29 20:10:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a9990>
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8769%252F20498769%252Finterior_rear_seats-1774774879128.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8769/20498769/interior_rear_seats-1774774879128.jpg saved to cache
2026-03-29 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4532b99-c348-5c81-9aa2-d934294ccea4
2026-03-29 20:10:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4532b99-c348-5c81-9aa2-d934294ccea4, skipping ID generation
2026-03-29 20:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4532b99-c348-5c81-9aa2-d934294ccea4 with scrape type 1
2026-03-29 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4532b99-c348-5c81-9aa2-d934294ccea4 sending to next pipeline
2026-03-29 20:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a4532b99-c348-5c81-9aa2-d934294ccea4, identifier: 20498769
2026-03-29 20:10:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4a4d10>
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2017%252F18272017%252Finstrument_cluster-1774695937168.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2017/18272017/instrument_cluster-1774695937168.jpg saved to cache
2026-03-29 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2bc8d0>
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2017%252F18272017%252Fdocs_service_history-1774696273099.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcebbce1b5e98e07c1c446a868a7fe202') HTTP/1.1" 204 0
2026-03-29 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2017/18272017/docs_service_history-1774696273099.jpg?ixlib=js-3.8.0&auto=format&s=cebbce1b5e98e07c1c446a868a7fe202 saved to cache
2026-03-29 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0
2026-03-29 20:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b986a516-e46a-5fd4-9581-ebca3b603e96 with identifier: 19570678
2026-03-29 20:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b986a516-e46a-5fd4-9581-ebca3b603e96 with identifier: 19570678
2026-03-29 20:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b986a516-e46a-5fd4-9581-ebca3b603e96 with identifier: 19570678 to the API
2026-03-29 20:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0678/19570678/19570678-interior_dashboard-modified-1774714957727.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'b986a516-e46a-5fd4-9581-ebca3b603e96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'Y6 MWW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19570678',
'listing': 'auction',
'location': 'Cheshire West and Chester Northwich',
'make': 'BMW',
'model': '5 Series',
'odometer': 59557,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632462,
'Height': 1640,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_front_driver-1774708820545.jpg',
'Width': 2186},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604430,
'Height': 1579,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_rear_driver-1774708834809.jpg',
'Width': 2105},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562518,
'Height': 1571,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_front_passenger-1774708822317.jpg',
'Width': 2094},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 675225,
'Height': 1658,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0678/19570678/exterior_rear_passenger-1774708833684.jpg',
'Width': 2210},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1519507,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0678/19570678/19570678-interior_front_seats-modified-1774716150495.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1882440,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/0678/19570678/interior_rear_seats-1774710214658.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2800611,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0678/19570678/19570678-interior_dashboard-modified-1774714957727.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2331793,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/0678/19570678/interior_boot-1774709172438.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1101811,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0678/19570678/docs_service_history-1774712275192.jpg?ixlib=js-3.8.0&auto=format&s=c90f57d8d0df6265940d9725ba01ab41',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b986a516-e46a-5fd4-9581-ebca3b603e96/b986a516-e46a-5fd4-9581-ebca3b603e96_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 940510,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0678/19570678/docs_service_history-1774712289128.jpg?ixlib=js-3.8.0&auto=format&s=63b25184f2df78f96ac489d3be48826d',
'Width': 3060}],
'price': 21990,
'price_includes_vat': False,
'registration_date': '2020-11-24',
'seats_number': None,
'seller_name': None,
'title': 'BMW 530D xDrive M Sport MHEV Auto',
'transmission': 'automatic',
'trim': '530D xDrive M Sport MHEV Auto',
'vin': 'WBA32AH020CF99628',
'year': 2020}
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719570678%27 HTTP/1.1" 200 None
2026-03-29 20:10:21 [motorway.uk] INFO: Saving data for 19570678: {'created_time': 1774815021.213659, 'last_price_update_time': 1774815021.213668, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19570678') HTTP/1.1" 204 0
2026-03-29 20:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a4532b99-c348-5c81-9aa2-d934294ccea4 with identifier: 20498769
2026-03-29 20:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a4532b99-c348-5c81-9aa2-d934294ccea4 with identifier: 20498769
2026-03-29 20:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a4532b99-c348-5c81-9aa2-d934294ccea4 with identifier: 20498769 to the API
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8769/20498769/interior_rear_seats-1774774879128.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a4532b99-c348-5c81-9aa2-d934294ccea4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WF23 JCY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20498769',
'listing': 'auction',
'location': 'Somerset Taunton',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 5000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1840182,
'Height': 2658,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_front_driver-1774774513675.jpg',
'Width': 3544},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1778314,
'Height': 2777,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_rear_driver-1774774523017.jpg',
'Width': 3702},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1908964,
'Height': 2828,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_front_passenger-1774774602584.jpg',
'Width': 3771},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1792541,
'Height': 2606,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8769/20498769/exterior_rear_passenger-1774774542365.jpg',
'Width': 3474},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5083201,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8769/20498769/interior_front_seats-1774774774147.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3884975,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8769/20498769/interior_rear_seats-1774774879128.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1803229,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8769/20498769/interior_dashboard-1774774828795.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2261764,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8769/20498769/instrument_cluster-1774774904207.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3862628,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8769/20498769/interior_boot-1774774841591.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4532b99-c348-5c81-9aa2-d934294ccea4/a4532b99-c348-5c81-9aa2-d934294ccea4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1698307,
'Height': 2895,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8769/20498769/wheels_front_driver-1774774756409.jpg',
'Width': 3860}],
'price': 21158,
'price_includes_vat': False,
'registration_date': '2023-04-05',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo GTI TSI S-A',
'transmission': 'automatic',
'trim': 'GTI TSI S-A',
'vin': 'WVWZZZAWZPU046413',
'year': 2023}
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720498769%27 HTTP/1.1" 200 None
2026-03-29 20:10:21 [motorway.uk] INFO: Saving data for 20498769: {'created_time': 1774815021.634062, 'last_price_update_time': 1774815021.634072, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20498769') HTTP/1.1" 204 0
2026-03-29 20:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f21a790>
2026-03-29 20:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9213%252F20479213%252Finstrument_cluster-1774691114621.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9213/20479213/instrument_cluster-1774691114621.jpg saved to cache
2026-03-29 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c
2026-03-29 20:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9213/20479213/docs_service_history-1774690025211.jpg?ixlib=js-3.8.0&auto=format&s=245e745dd50747ed5dd9b567bda3d288> (referer: None)
2026-03-29 20:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9213/20479213/interior_dashboard-1774686568491.jpg> (referer: None)
2026-03-29 20:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_rear_passenger-1774695181814.jpg> (referer: None)
2026-03-29 20:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f44b250>
2026-03-29 20:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9213%252F20479213%252Fdocs_service_history-1774690025211.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D245e745dd50747ed5dd9b567bda3d288') HTTP/1.1" 204 0
2026-03-29 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9213/20479213/docs_service_history-1774690025211.jpg?ixlib=js-3.8.0&auto=format&s=245e745dd50747ed5dd9b567bda3d288 saved to cache
2026-03-29 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c
2026-03-29 20:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c90c350>
2026-03-29 20:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9213%252F20479213%252Finterior_dashboard-1774686568491.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9213/20479213/interior_dashboard-1774686568491.jpg saved to cache
2026-03-29 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9ae010>
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2017%252F18272017%252Fexterior_rear_passenger-1774695181814.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_rear_passenger-1774695181814.jpg saved to cache
2026-03-29 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9213/20479213/interior_front_seats-1774686646834.jpg> (referer: None)
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2017/18272017/interior_front_seats-1774695870297.jpg> (referer: None)
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0409/20500409/docs_service_history-1774778067599.jpg?ixlib=js-3.8.0&auto=format&s=6e0334a50d02108825835b9bb50b5cf5> (referer: None)
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2017/18272017/interior_rear_seats-1774695892532.jpg> (referer: None)
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2017/18272017/interior_boot-1774695948015.jpg> (referer: None)
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_front_driver-1774695140071.jpg> (referer: None)
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_front_passenger-1774361637182.jpg> (referer: None)
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_front_driver-1774686251910.jpg> (referer: None)
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_rear_passenger-1774686306614.jpg> (referer: None)
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_front_passenger-1774695199729.jpg> (referer: None)
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9213/20479213/interior_boot-1774686618268.jpg> (referer: None)
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0409/20500409/instrument_cluster-1774777821199.jpg> (referer: None)
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0409/20500409/interior_boot-1774777790118.jpg> (referer: None)
2026-03-29 20:10:22 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9213/20479213/interior_rear_seats-1774690942582.png>.
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db49950>
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9213%252F20479213%252Finterior_front_seats-1774686646834.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9213/20479213/interior_front_seats-1774686646834.jpg saved to cache
2026-03-29 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c
2026-03-29 20:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_front_passenger-1774686297640.jpg> (referer: None)
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c91be90>
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2017%252F18272017%252Finterior_front_seats-1774695870297.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2017/18272017/interior_front_seats-1774695870297.jpg saved to cache
2026-03-29 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5b76d0>
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0409%252F20500409%252Fdocs_service_history-1774778067599.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6e0334a50d02108825835b9bb50b5cf5') HTTP/1.1" 204 0
2026-03-29 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0409/20500409/docs_service_history-1774778067599.jpg?ixlib=js-3.8.0&auto=format&s=6e0334a50d02108825835b9bb50b5cf5 saved to cache
2026-03-29 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95e934b1-801f-5013-bc1d-82bb393ad01a
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5b4c90>
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2017%252F18272017%252Finterior_rear_seats-1774695892532.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2017/18272017/interior_rear_seats-1774695892532.jpg saved to cache
2026-03-29 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d48ff90>
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2017%252F18272017%252Finterior_boot-1774695948015.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2017/18272017/interior_boot-1774695948015.jpg saved to cache
2026-03-29 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d48e250>
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2017%252F18272017%252Fexterior_front_driver-1774695140071.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_front_driver-1774695140071.jpg saved to cache
2026-03-29 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d667950>
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1513%252F20421513%252Fexterior_front_passenger-1774361637182.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_front_passenger-1774361637182.jpg saved to cache
2026-03-29 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05cb53a8-4f85-5142-8548-a8943301ebe7
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddaa090>
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9213%252F20479213%252Fexterior_front_driver-1774686251910.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_front_driver-1774686251910.jpg saved to cache
2026-03-29 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de0f850>
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9213%252F20479213%252Fexterior_rear_passenger-1774686306614.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_rear_passenger-1774686306614.jpg saved to cache
2026-03-29 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cabc6d0>
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2017%252F18272017%252Fexterior_front_passenger-1774695199729.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_front_passenger-1774695199729.jpg saved to cache
2026-03-29 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0
2026-03-29 20:10:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cbc13e4e-30a7-5555-be71-5525f9b0d6e0, skipping ID generation
2026-03-29 20:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0 with scrape type 1
2026-03-29 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cbc13e4e-30a7-5555-be71-5525f9b0d6e0 sending to next pipeline
2026-03-29 20:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cbc13e4e-30a7-5555-be71-5525f9b0d6e0, identifier: 18272017
2026-03-29 20:10:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f219cd0>
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9213%252F20479213%252Finterior_boot-1774686618268.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9213/20479213/interior_boot-1774686618268.jpg saved to cache
2026-03-29 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c
2026-03-29 20:10:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9ae910>
2026-03-29 20:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F20500409%252Finstrument_cluster-1774777821199.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/20500409/instrument_cluster-1774777821199.jpg saved to cache
2026-03-29 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95e934b1-801f-5013-bc1d-82bb393ad01a
2026-03-29 20:10:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6b1d90>
2026-03-29 20:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0409%252F20500409%252Finterior_boot-1774777790118.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0409/20500409/interior_boot-1774777790118.jpg saved to cache
2026-03-29 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95e934b1-801f-5013-bc1d-82bb393ad01a
2026-03-29 20:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cbc13e4e-30a7-5555-be71-5525f9b0d6e0 with identifier: 18272017
2026-03-29 20:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cbc13e4e-30a7-5555-be71-5525f9b0d6e0 with identifier: 18272017
2026-03-29 20:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cbc13e4e-30a7-5555-be71-5525f9b0d6e0 with identifier: 18272017 to the API
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_front_passenger-1774695199729.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'cbc13e4e-30a7-5555-be71-5525f9b0d6e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL13 VVA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18272017',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 75644,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1632456,
'Height': 2384,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_front_driver-1774695140071.jpg',
'Width': 3178},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1675898,
'Height': 2377,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_rear_driver-1774695156813.jpg',
'Width': 3169},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1800159,
'Height': 2438,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_front_passenger-1774695199729.jpg',
'Width': 3251},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1883673,
'Height': 2546,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2017/18272017/exterior_rear_passenger-1774695181814.jpg',
'Width': 3395},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4255657,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2017/18272017/interior_front_seats-1774695870297.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4019391,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2017/18272017/interior_rear_seats-1774695892532.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2054886,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2017/18272017/interior_dashboard-1774695930400.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3728669,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2017/18272017/instrument_cluster-1774695937168.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4401858,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2017/18272017/interior_boot-1774695948015.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbc13e4e-30a7-5555-be71-5525f9b0d6e0/cbc13e4e-30a7-5555-be71-5525f9b0d6e0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229901,
'Height': 1428,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2017/18272017/docs_service_history-1774696273099.jpg?ixlib=js-3.8.0&auto=format&s=cebbce1b5e98e07c1c446a868a7fe202',
'Width': 2016}],
'price': 2279,
'price_includes_vat': False,
'registration_date': '2013-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Fabia SE 12V',
'transmission': 'manual',
'trim': 'SE 12V',
'vin': 'TMBFH25JXD3090004',
'year': 2013}
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718272017%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Saving data for 18272017: {'created_time': 1774815024.672443, 'last_price_update_time': 1774815024.672457, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18272017') HTTP/1.1" 204 0
2026-03-29 20:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=900&page=25&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1f1cd0>
2026-03-29 20:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9213%252F20479213%252Fexterior_front_passenger-1774686297640.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_front_passenger-1774686297640.jpg saved to cache
2026-03-29 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 19778480
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719778480%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 19778480: 0
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20022290
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 13467302
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 19297070
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20020700
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720020700%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 20020700: 1
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 11255946
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 19632065
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 17285204
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 16536787
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 1653589
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20323347
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20483472
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 17018395
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 4109910
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 19834070
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20450033
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20441111
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 15806242
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20168276
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 13753529
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 15549773
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 15733189
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715733189%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 15733189: 1
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 14461251
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20474635
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 19400973
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20423010
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20470703
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 10736639
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20469304
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 19886474
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 18670827
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718670827%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 18670827: 1
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 19915940
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 14572470
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714572470%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 14572470: 1
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20268898
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20241032
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720241032%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 20241032: 1
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20251701
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720251701%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 20251701: 1
2026-03-29 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4701/20304701/docs_service_history-1774339800756.jpg?ixlib=js-3.8.0&auto=format&s=262d6b9e3d42de3b279214af150dd647> (referer: None)
2026-03-29 20:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4701/20304701/docs_service_history-1774339799868.jpg?ixlib=js-3.8.0&auto=format&s=9d0071091587da48b66df33be3029b13> (referer: None)
2026-03-29 20:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_front_passenger-1774777353692.jpg> (referer: None)
2026-03-29 20:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0409/20500409/interior_rear_seats-1774777754259.jpg> (referer: None)
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d616650>
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4701%252F20304701%252Fdocs_service_history-1774339800756.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D262d6b9e3d42de3b279214af150dd647') HTTP/1.1" 204 0
2026-03-29 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4701/20304701/docs_service_history-1774339800756.jpg?ixlib=js-3.8.0&auto=format&s=262d6b9e3d42de3b279214af150dd647 saved to cache
2026-03-29 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a505728c-0e68-5d43-a634-6c70d3b26c44
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4a5610>
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4701%252F20304701%252Fdocs_service_history-1774339799868.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9d0071091587da48b66df33be3029b13') HTTP/1.1" 204 0
2026-03-29 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4701/20304701/docs_service_history-1774339799868.jpg?ixlib=js-3.8.0&auto=format&s=9d0071091587da48b66df33be3029b13 saved to cache
2026-03-29 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a505728c-0e68-5d43-a634-6c70d3b26c44
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d529590>
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F20500409%252Fexterior_front_passenger-1774777353692.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_front_passenger-1774777353692.jpg saved to cache
2026-03-29 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95e934b1-801f-5013-bc1d-82bb393ad01a
2026-03-29 20:10:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d56b6d0>
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0409%252F20500409%252Finterior_rear_seats-1774777754259.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0409/20500409/interior_rear_seats-1774777754259.jpg saved to cache
2026-03-29 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95e934b1-801f-5013-bc1d-82bb393ad01a
2026-03-29 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_rear_driver-1774777321612.jpg> (referer: None)
2026-03-29 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9213/20479213/interior_rear_seats-1774690942582.png> (referer: None)
2026-03-29 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4701/20304701/interior_boot-1774339660025.jpg> (referer: None)
2026-03-29 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0409/20500409/interior_front_seats-1774780217725.jpg> (referer: None)
2026-03-29 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_rear_passenger-1774777341214.jpg> (referer: None)
2026-03-29 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_front_driver-1774361318349.jpg> (referer: None)
2026-03-29 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0409/20500409/interior_dashboard-1774777779316.jpg> (referer: None)
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d200a90>
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F20500409%252Fexterior_rear_driver-1774777321612.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_rear_driver-1774777321612.jpg saved to cache
2026-03-29 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95e934b1-801f-5013-bc1d-82bb393ad01a
2026-03-29 20:10:25 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:10:25 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-29 20:10:25 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 54 120
2026-03-29 20:10:25 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 186 9
2026-03-29 20:10:25 [PIL.PngImagePlugin] DEBUG: STREAM b'iDOT' 207 28
2026-03-29 20:10:25 [PIL.PngImagePlugin] DEBUG: b'iDOT' 207 28 (unknown)
2026-03-29 20:10:25 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 247 16384
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc2e1d0>
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_5.png HTTP/1.1" 201 0
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9213%252F20479213%252Finterior_rear_seats-1774690942582.png') HTTP/1.1" 204 0
2026-03-29 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9213/20479213/interior_rear_seats-1774690942582.png saved to cache
2026-03-29 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c
2026-03-29 20:10:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c, skipping ID generation
2026-03-29 20:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c with scrape type 1
2026-03-29 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c sending to next pipeline
2026-03-29 20:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c, identifier: 20479213
2026-03-29 20:10:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d217dd0>
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4701%252F20304701%252Finterior_boot-1774339660025.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4701/20304701/interior_boot-1774339660025.jpg saved to cache
2026-03-29 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a505728c-0e68-5d43-a634-6c70d3b26c44
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4c7190>
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0409%252F20500409%252Finterior_front_seats-1774780217725.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0409/20500409/interior_front_seats-1774780217725.jpg saved to cache
2026-03-29 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95e934b1-801f-5013-bc1d-82bb393ad01a
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f48a150>
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F20500409%252Fexterior_rear_passenger-1774777341214.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_rear_passenger-1774777341214.jpg saved to cache
2026-03-29 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95e934b1-801f-5013-bc1d-82bb393ad01a
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1ac410>
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1513%252F20421513%252Fexterior_front_driver-1774361318349.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_front_driver-1774361318349.jpg saved to cache
2026-03-29 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05cb53a8-4f85-5142-8548-a8943301ebe7
2026-03-29 20:10:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05cb53a8-4f85-5142-8548-a8943301ebe7, skipping ID generation
2026-03-29 20:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05cb53a8-4f85-5142-8548-a8943301ebe7 with scrape type 1
2026-03-29 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05cb53a8-4f85-5142-8548-a8943301ebe7 sending to next pipeline
2026-03-29 20:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 05cb53a8-4f85-5142-8548-a8943301ebe7, identifier: 20421513
2026-03-29 20:10:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d216850>
2026-03-29 20:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F20500409%252Finterior_dashboard-1774777779316.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/20500409/interior_dashboard-1774777779316.jpg saved to cache
2026-03-29 20:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95e934b1-801f-5013-bc1d-82bb393ad01a
2026-03-29 20:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c with identifier: 20479213
2026-03-29 20:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c with identifier: 20479213
2026-03-29 20:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c with identifier: 20479213 to the API
2026-03-29 20:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9213/20479213/interior_rear_seats-1774690942582.png>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DK71 LYW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20479213',
'listing': 'auction',
'location': 'Merseyside Liverpool',
'make': 'Mercedes',
'model': 'GLB',
'odometer': 42500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1720074,
'Height': 2640,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_front_driver-1774686251910.jpg',
'Width': 3520},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1528948,
'Height': 2626,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_rear_driver-1774686288067.jpg',
'Width': 3501},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2167511,
'Height': 2989,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_front_passenger-1774686297640.jpg',
'Width': 3985},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1827460,
'Height': 2495,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9213/20479213/exterior_rear_passenger-1774686306614.jpg',
'Width': 3326},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3024662,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9213/20479213/interior_front_seats-1774686646834.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 23222123,
'Height': 4032,
'OriginUrl': 'https://motorway-photos.imgix.net/9213/20479213/interior_rear_seats-1774690942582.png',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1868220,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9213/20479213/interior_dashboard-1774686568491.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549377,
'Height': 1702,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9213/20479213/instrument_cluster-1774691114621.jpg',
'Width': 2269},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4734471,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9213/20479213/interior_boot-1774686618268.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c/b1bb6bd7-33bf-533b-9b5c-59bc7b1bbc3c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634882,
'Height': 2944,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9213/20479213/docs_service_history-1774690025211.jpg?ixlib=js-3.8.0&auto=format&s=245e745dd50747ed5dd9b567bda3d288',
'Width': 2143}],
'price': 23430,
'price_includes_vat': False,
'registration_date': '2021-12-16',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLB 200 AMG Line Premium + A',
'transmission': 'automatic',
'trim': '200 AMG Line Premium + A',
'vin': 'W1N2476872W168482',
'year': 2021}
2026-03-29 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720479213%27 HTTP/1.1" 200 None
2026-03-29 20:10:27 [motorway.uk] INFO: Saving data for 20479213: {'created_time': 1774815027.581962, 'last_price_update_time': 1774815027.581972, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20479213') HTTP/1.1" 204 0
2026-03-29 20:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 05cb53a8-4f85-5142-8548-a8943301ebe7 with identifier: 20421513
2026-03-29 20:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 05cb53a8-4f85-5142-8548-a8943301ebe7 with identifier: 20421513
2026-03-29 20:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 05cb53a8-4f85-5142-8548-a8943301ebe7 with identifier: 20421513 to the API
2026-03-29 20:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_front_driver-1774361318349.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '05cb53a8-4f85-5142-8548-a8943301ebe7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YG69 HEX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20421513',
'listing': 'auction',
'location': 'Nottingham Nottingham',
'make': 'Mercedes',
'model': 'CLA Class',
'odometer': 44300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1967697,
'Height': 2855,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_front_driver-1774361318349.jpg',
'Width': 3807},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1821283,
'Height': 2758,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_rear_driver-1774361350433.jpg',
'Width': 3677},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1586337,
'Height': 2769,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_front_passenger-1774361637182.jpg',
'Width': 3692},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1478410,
'Height': 2652,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1513/20421513/exterior_rear_passenger-1774361771447.jpg',
'Width': 3536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3632841,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1513/20421513/interior_front_seats-1774363016317.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3096298,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1513/20421513/interior_rear_seats-1774363311572.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2024354,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1513/20421513/interior_dashboard-1774522409419.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2336148,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1513/20421513/instrument_cluster-1774363092187.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3473207,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1513/20421513/interior_boot-1774363186898.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05cb53a8-4f85-5142-8548-a8943301ebe7/05cb53a8-4f85-5142-8548-a8943301ebe7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58437,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1513/20421513/docs_service_history-1774520670422.jpg?ixlib=js-3.8.0&auto=format&s=8597cb81d9a0b60347c986abf273c013',
'Width': 596}],
'price': 14763,
'price_includes_vat': False,
'registration_date': '2019-09-25',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes CLA 200 AMG Line Premium Auto',
'transmission': 'automatic',
'trim': 'CLA 200 AMG Line Premium Auto',
'vin': 'WDD1183872N031359',
'year': 2019}
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720421513%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [motorway.uk] INFO: Saving data for 20421513: {'created_time': 1774815028.100384, 'last_price_update_time': 1774815028.100397, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20421513') HTTP/1.1" 204 0
2026-03-29 20:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=936&page=26&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 8035510
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278035510%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [motorway.uk] INFO: Scrape type for 8035510: 0
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20487217
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 9709671
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279709671%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [motorway.uk] INFO: Scrape type for 9709671: 1
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 18815814
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20223018
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20483589
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 12179919
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20468816
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20377393
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 17155088
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20267868
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 3064694
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 19938092
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719938092%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [motorway.uk] INFO: Scrape type for 19938092: 1
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20502804
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 19713153
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 19838319
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719838319%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [motorway.uk] INFO: Scrape type for 19838319: 1
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20050031
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720050031%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [motorway.uk] INFO: Scrape type for 20050031: 1
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 16344729
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20490281
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 16868488
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 19871523
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20412314
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20415492
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720415492%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [motorway.uk] INFO: Scrape type for 20415492: 1
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 17316820
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20175981
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20453641
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720453641%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [motorway.uk] INFO: Scrape type for 20453641: 0
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20478408
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20469298
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20319525
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720319525%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [motorway.uk] INFO: Scrape type for 20319525: 1
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 16548854
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20052855
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20374311
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 17186648
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717186648%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [motorway.uk] INFO: Scrape type for 17186648: 1
2026-03-29 20:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19667593.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 17160787
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20384196
2026-03-29 20:10:28 [motorway.uk] INFO: Found listing with ID: 20037779
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720037779%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [motorway.uk] INFO: Scrape type for 20037779: 1
2026-03-29 20:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4701/20304701/interior_rear_seats-1774696269575.jpg> (referer: None)
2026-03-29 20:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20435734.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_front_driver-1774777310798.jpg> (referer: None)
2026-03-29 20:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4701/20304701/interior_front_seats-1774339614248.jpg> (referer: None)
2026-03-29 20:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 416dc92a-3ada-5389-ad1b-a107bf0bc1cf with identifier: 19667593
2026-03-29 20:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 416dc92a-3ada-5389-ad1b-a107bf0bc1cf with scrape type 1
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 416dc92a-3ada-5389-ad1b-a107bf0bc1cf
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7593%252F19667593%252Fexterior_front_driver-1774705007571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7593/19667593/exterior_front_driver-1774705007571.jpg not downloaded yet
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7593%252F19667593%252Fexterior_rear_driver-1774705019412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7593/19667593/exterior_rear_driver-1774705019412.jpg not downloaded yet
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7593%252F19667593%252Fexterior_front_passenger-1774705051418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7593/19667593/exterior_front_passenger-1774705051418.jpg not downloaded yet
2026-03-29 20:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4c6ed0>
2026-03-29 20:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4701%252F20304701%252Finterior_rear_seats-1774696269575.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4701/20304701/interior_rear_seats-1774696269575.jpg saved to cache
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a505728c-0e68-5d43-a634-6c70d3b26c44
2026-03-29 20:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2891630a-9dc5-508a-9a79-85f6ebd3ab43 with identifier: 20435734
2026-03-29 20:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2891630a-9dc5-508a-9a79-85f6ebd3ab43 with scrape type 1
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2891630a-9dc5-508a-9a79-85f6ebd3ab43
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5734%252F20435734%252Fexterior_front_driver-1774697904554.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5734/20435734/exterior_front_driver-1774697904554.jpg not downloaded yet
2026-03-29 20:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2db7d0>
2026-03-29 20:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0409%252F20500409%252Fexterior_front_driver-1774777310798.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_front_driver-1774777310798.jpg saved to cache
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95e934b1-801f-5013-bc1d-82bb393ad01a
2026-03-29 20:10:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95e934b1-801f-5013-bc1d-82bb393ad01a, skipping ID generation
2026-03-29 20:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95e934b1-801f-5013-bc1d-82bb393ad01a with scrape type 1
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95e934b1-801f-5013-bc1d-82bb393ad01a sending to next pipeline
2026-03-29 20:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 95e934b1-801f-5013-bc1d-82bb393ad01a, identifier: 20500409
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce95110>
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4701%252F20304701%252Finterior_front_seats-1774339614248.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4701/20304701/interior_front_seats-1774339614248.jpg saved to cache
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a505728c-0e68-5d43-a634-6c70d3b26c44
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7593%252F19667593%252Fexterior_rear_passenger-1774705036577.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7593/19667593/exterior_rear_passenger-1774705036577.jpg not downloaded yet
2026-03-29 20:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 95e934b1-801f-5013-bc1d-82bb393ad01a with identifier: 20500409
2026-03-29 20:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 95e934b1-801f-5013-bc1d-82bb393ad01a with identifier: 20500409
2026-03-29 20:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 95e934b1-801f-5013-bc1d-82bb393ad01a with identifier: 20500409 to the API
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_front_driver-1774777310798.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '95e934b1-801f-5013-bc1d-82bb393ad01a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LS14 KWG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20500409',
'listing': 'auction',
'location': 'Gloucestershire Cirencester',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 57000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2330465,
'Height': 2842,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_front_driver-1774777310798.jpg',
'Width': 3789},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1409326,
'Height': 2420,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_rear_driver-1774777321612.jpg',
'Width': 3227},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2011800,
'Height': 2744,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_front_passenger-1774777353692.jpg',
'Width': 3659},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1968648,
'Height': 2744,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0409/20500409/exterior_rear_passenger-1774777341214.jpg',
'Width': 3658},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2905341,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0409/20500409/interior_front_seats-1774780217725.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3523179,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0409/20500409/interior_rear_seats-1774777754259.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3014721,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0409/20500409/interior_dashboard-1774777779316.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2596777,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0409/20500409/instrument_cluster-1774777821199.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3493840,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0409/20500409/interior_boot-1774777790118.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e934b1-801f-5013-bc1d-82bb393ad01a/95e934b1-801f-5013-bc1d-82bb393ad01a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 675927,
'Height': 3553,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0409/20500409/docs_service_history-1774778067599.jpg?ixlib=js-3.8.0&auto=format&s=6e0334a50d02108825835b9bb50b5cf5',
'Width': 2420}],
'price': 9285,
'price_includes_vat': False,
'registration_date': '2014-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque DYNAMICSD4A',
'transmission': 'automatic',
'trim': 'Evoque DYNAMICSD4A',
'vin': 'SALVA2AE2EH861271',
'year': 2014}
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720500409%27 HTTP/1.1" 200 None
2026-03-29 20:10:29 [motorway.uk] INFO: Saving data for 20500409: {'created_time': 1774815029.694992, 'last_price_update_time': 1774815029.695002, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20500409') HTTP/1.1" 204 0
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5734%252F20435734%252Fexterior_rear_driver-1774697891691.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5734/20435734/exterior_rear_driver-1774697891691.jpg not downloaded yet
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7593%252F19667593%252Finterior_front_seats-1774705773393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7593/19667593/interior_front_seats-1774705773393.jpg not downloaded yet
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5734%252F20435734%252Fexterior_front_passenger-1774697865111.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5734/20435734/exterior_front_passenger-1774697865111.jpg not downloaded yet
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7593%252F19667593%252Finterior_rear_seats-1774706831684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7593/19667593/interior_rear_seats-1774706831684.jpg not downloaded yet
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5734%252F20435734%252Fexterior_rear_passenger-1774697826816.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5734/20435734/exterior_rear_passenger-1774697826816.jpg not downloaded yet
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7593%252F19667593%252Finterior_dashboard-1774706990542.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7593/19667593/interior_dashboard-1774706990542.jpg not downloaded yet
2026-03-29 20:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_rear_driver-1774339212467.jpg> (referer: None)
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5734%252F20435734%252Finterior_front_seats-1774698554006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5734/20435734/interior_front_seats-1774698554006.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7593%252F19667593%252Finstrument_cluster-1774705864214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7593/19667593/instrument_cluster-1774705864214.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5734%252F20435734%252Finterior_rear_seats-1774698592239.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5734/20435734/interior_rear_seats-1774698592239.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7593%252F19667593%252Finterior_boot-1774705878465.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7593/19667593/interior_boot-1774705878465.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5734%252F20435734%252Finterior_dashboard-1774698647856.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5734/20435734/interior_dashboard-1774698647856.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7593%252F19667593%252Fdamage_scratches-1774705138519.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7593/19667593/damage_scratches-1774705138519.jpg not downloaded yet
2026-03-29 20:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/1329664.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5734%252F20435734%252Finstrument_cluster-1774698959493.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5734/20435734/instrument_cluster-1774698959493.jpg not downloaded yet
2026-03-29 20:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20240702.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5734%252F20435734%252Finterior_boot-1774698756068.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5734/20435734/interior_boot-1774698756068.jpg not downloaded yet
2026-03-29 20:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca36890>
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4701%252F20304701%252Fexterior_rear_driver-1774339212467.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_rear_driver-1774339212467.jpg saved to cache
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a505728c-0e68-5d43-a634-6c70d3b26c44
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5734%252F20435734%252Fdamage_scratches-1774701389228.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5734/20435734/damage_scratches-1774701389228.jpg not downloaded yet
2026-03-29 20:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00affa57-1b73-56aa-99ca-06869cee6459 with identifier: 1329664
2026-03-29 20:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00affa57-1b73-56aa-99ca-06869cee6459 with scrape type 1
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00affa57-1b73-56aa-99ca-06869cee6459
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9664%252F1329664%252Fexterior_front_driver-1772037435653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9664/1329664/exterior_front_driver-1772037435653.jpg not downloaded yet
2026-03-29 20:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8785243-1ae1-5cdc-abf4-bc9a3477dfae with identifier: 20240702
2026-03-29 20:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8785243-1ae1-5cdc-abf4-bc9a3477dfae with scrape type 1
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8785243-1ae1-5cdc-abf4-bc9a3477dfae
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0702%252F20240702%252Fexterior_front_driver-1774711106800.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0702/20240702/exterior_front_driver-1774711106800.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9664%252F1329664%252Fexterior_rear_driver-1772037462564.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9664/1329664/exterior_rear_driver-1772037462564.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0702%252F20240702%252Fexterior_rear_driver-1774711121235.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0702/20240702/exterior_rear_driver-1774711121235.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9664%252F1329664%252Fexterior_front_passenger-1772037486634.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9664/1329664/exterior_front_passenger-1772037486634.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0702%252F20240702%252Fexterior_front_passenger-1774711167005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0702/20240702/exterior_front_passenger-1774711167005.jpg not downloaded yet
2026-03-29 20:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4701/20304701/interior_dashboard-1774339648513.jpg> (referer: None)
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9664%252F1329664%252Fexterior_rear_passenger-1772037511270.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9664/1329664/exterior_rear_passenger-1772037511270.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0702%252F20240702%252Fexterior_rear_passenger-1774711142358.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0702/20240702/exterior_rear_passenger-1774711142358.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9664%252F1329664%252Finterior_front_seats-1772109712384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9664/1329664/interior_front_seats-1772109712384.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0702%252F20240702%252Finterior_front_seats-1774713106164.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0702/20240702/interior_front_seats-1774713106164.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9664%252F1329664%252Finterior_rear_seats-1772109717324.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9664/1329664/interior_rear_seats-1772109717324.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0702%252F20240702%252Finterior_rear_seats-1774711637093.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0702/20240702/interior_rear_seats-1774711637093.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9664%252F1329664%252Finterior_dashboard-1774776927292.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9664/1329664/interior_dashboard-1774776927292.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0702%252F20240702%252Finterior_dashboard-1774713133527.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0702/20240702/interior_dashboard-1774713133527.jpg not downloaded yet
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dde6250>
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4701%252F20304701%252Finterior_dashboard-1774339648513.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4701/20304701/interior_dashboard-1774339648513.jpg saved to cache
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a505728c-0e68-5d43-a634-6c70d3b26c44
2026-03-29 20:10:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a505728c-0e68-5d43-a634-6c70d3b26c44, skipping ID generation
2026-03-29 20:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a505728c-0e68-5d43-a634-6c70d3b26c44 with scrape type 1
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a505728c-0e68-5d43-a634-6c70d3b26c44 sending to next pipeline
2026-03-29 20:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a505728c-0e68-5d43-a634-6c70d3b26c44, identifier: 20304701
2026-03-29 20:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7593/19667593/exterior_front_passenger-1774705051418.jpg> (referer: None)
2026-03-29 20:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a505728c-0e68-5d43-a634-6c70d3b26c44 with identifier: 20304701
2026-03-29 20:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a505728c-0e68-5d43-a634-6c70d3b26c44 with identifier: 20304701
2026-03-29 20:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a505728c-0e68-5d43-a634-6c70d3b26c44 with identifier: 20304701 to the API
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4701/20304701/interior_dashboard-1774339648513.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a505728c-0e68-5d43-a634-6c70d3b26c44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YY16 JCU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20304701',
'listing': 'auction',
'location': 'Norfolk Dereham',
'make': 'Citroen',
'model': 'C1',
'odometer': 76649,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1603182,
'Height': 2638,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_front_driver-1774339194494.jpg',
'Width': 3517},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763540,
'Height': 1912,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_rear_driver-1774339212467.jpg',
'Width': 2549},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1194334,
'Height': 2380,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_front_passenger-1774339243874.jpg',
'Width': 3173},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 886435,
'Height': 2079,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4701/20304701/exterior_rear_passenger-1774339225270.jpg',
'Width': 2772},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4169054,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4701/20304701/interior_front_seats-1774339614248.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3300737,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4701/20304701/interior_rear_seats-1774696269575.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3571517,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4701/20304701/interior_dashboard-1774339648513.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3540369,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4701/20304701/interior_boot-1774339660025.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634614,
'Height': 1463,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4701/20304701/docs_service_history-1774339799868.jpg?ixlib=js-3.8.0&auto=format&s=9d0071091587da48b66df33be3029b13',
'Width': 4653},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a505728c-0e68-5d43-a634-6c70d3b26c44/a505728c-0e68-5d43-a634-6c70d3b26c44_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555164,
'Height': 2171,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4701/20304701/docs_service_history-1774339800756.jpg?ixlib=js-3.8.0&auto=format&s=262d6b9e3d42de3b279214af150dd647',
'Width': 2954}],
'price': 1879,
'price_includes_vat': False,
'registration_date': '2016-03-30',
'seats_number': None,
'seller_name': None,
'title': 'Citroen C1 Feel PureTech',
'transmission': 'manual',
'trim': 'Feel PureTech',
'vin': 'VF7PAHMTCFR776179',
'year': 2016}
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720304701%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [motorway.uk] INFO: Saving data for 20304701: {'created_time': 1774815031.519844, 'last_price_update_time': 1774815031.519854, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20304701') HTTP/1.1" 204 0
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9664%252F1329664%252Finterior_boot-1774776936770.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9664/1329664/interior_boot-1774776936770.jpg not downloaded yet
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0702%252F20240702%252Finstrument_cluster-1774712017199.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0702/20240702/instrument_cluster-1774712017199.jpg not downloaded yet
2026-03-29 20:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20251701.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9664%252F1329664%252Fdocs_service_history-1774776987049.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3c0b5d58ba5293c0a07a2a87bd9eab71%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9664/1329664/docs_service_history-1774776987049.jpg?ixlib=js-3.8.0&auto=format&s=3c0b5d58ba5293c0a07a2a87bd9eab71 not downloaded yet
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0702%252F20240702%252Finterior_boot-1774711727957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0702/20240702/interior_boot-1774711727957.jpg not downloaded yet
2026-03-29 20:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db76c50>
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_416dc92a-3ada-5389-ad1b-a107bf0bc1cf/416dc92a-3ada-5389-ad1b-a107bf0bc1cf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7593%252F19667593%252Fexterior_front_passenger-1774705051418.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7593/19667593/exterior_front_passenger-1774705051418.jpg saved to cache
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 416dc92a-3ada-5389-ad1b-a107bf0bc1cf
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9664%252F1329664%252Fdocs_service_history-1774711533611.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D91b8ef9625df7e5eb10b57c4ae678eed%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9664/1329664/docs_service_history-1774711533611.jpg?ixlib=js-3.8.0&auto=format&s=91b8ef9625df7e5eb10b57c4ae678eed not downloaded yet
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0702%252F20240702%252Fdocs_service_history-1774713085739.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1c222b6246e35faee1029bf167c6f13b%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0702/20240702/docs_service_history-1774713085739.jpg?ixlib=js-3.8.0&auto=format&s=1c222b6246e35faee1029bf167c6f13b not downloaded yet
2026-03-29 20:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1ec8950-96b1-5602-9c90-871743530b4f with identifier: 20251701
2026-03-29 20:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1ec8950-96b1-5602-9c90-871743530b4f with scrape type 1
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1ec8950-96b1-5602-9c90-871743530b4f
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20251701%252Fexterior_front_driver-1773672512789.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20251701/exterior_front_driver-1773672512789.jpg not downloaded yet
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20251701%252Fexterior_rear_driver-1773672535895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20251701/exterior_rear_driver-1773672535895.jpg not downloaded yet
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20251701%252Fexterior_front_passenger-1773672564962.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20251701/exterior_front_passenger-1773672564962.jpg not downloaded yet
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20251701%252Fexterior_rear_passenger-1773672548203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20251701/exterior_rear_passenger-1773672548203.jpg not downloaded yet
2026-03-29 20:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7593/19667593/exterior_rear_passenger-1774705036577.jpg> (referer: None)
2026-03-29 20:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14572470.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7593/19667593/interior_dashboard-1774706990542.jpg> (referer: None)
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1701%252F20251701%252Finterior_front_seats-1773673332162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1701/20251701/interior_front_seats-1773673332162.jpg not downloaded yet
2026-03-29 20:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5734/20435734/exterior_front_driver-1774697904554.jpg> (referer: None)
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1701%252F20251701%252Finterior_rear_seats-1773673522269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1701/20251701/interior_rear_seats-1773673522269.jpg not downloaded yet
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20251701%252Finterior_dashboard-1773673405667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20251701/interior_dashboard-1773673405667.jpg not downloaded yet
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20251701%252Finstrument_cluster-1773673441090.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20251701/instrument_cluster-1773673441090.jpg not downloaded yet
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1701%252F20251701%252Finterior_boot-1773673424020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1701/20251701/interior_boot-1773673424020.jpg not downloaded yet
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1701%252F20251701%252Fdocs_service_history-1773673791782.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dabdebf97187f3a782ddccf13b8db27f3%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1701/20251701/docs_service_history-1773673791782.jpg?ixlib=js-3.8.0&auto=format&s=abdebf97187f3a782ddccf13b8db27f3 not downloaded yet
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f388250>
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_416dc92a-3ada-5389-ad1b-a107bf0bc1cf/416dc92a-3ada-5389-ad1b-a107bf0bc1cf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7593%252F19667593%252Fexterior_rear_passenger-1774705036577.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7593/19667593/exterior_rear_passenger-1774705036577.jpg saved to cache
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 416dc92a-3ada-5389-ad1b-a107bf0bc1cf
2026-03-29 20:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b31b43d2-37e8-55e5-a775-9c02c668bd04 with identifier: 14572470
2026-03-29 20:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b31b43d2-37e8-55e5-a775-9c02c668bd04 with scrape type 1
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b31b43d2-37e8-55e5-a775-9c02c668bd04
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2470%252F14572470%252Fexterior_front_driver-1774701593752.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2470/14572470/exterior_front_driver-1774701593752.jpg not downloaded yet
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e07e3d0>
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_416dc92a-3ada-5389-ad1b-a107bf0bc1cf/416dc92a-3ada-5389-ad1b-a107bf0bc1cf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7593%252F19667593%252Finterior_dashboard-1774706990542.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7593/19667593/interior_dashboard-1774706990542.jpg saved to cache
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 416dc92a-3ada-5389-ad1b-a107bf0bc1cf
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2470%252F14572470%252Fexterior_rear_driver-1774701611671.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2470/14572470/exterior_rear_driver-1774701611671.jpg not downloaded yet
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d470590>
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2891630a-9dc5-508a-9a79-85f6ebd3ab43/2891630a-9dc5-508a-9a79-85f6ebd3ab43_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5734%252F20435734%252Fexterior_front_driver-1774697904554.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5734/20435734/exterior_front_driver-1774697904554.jpg saved to cache
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2891630a-9dc5-508a-9a79-85f6ebd3ab43
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2470%252F14572470%252Fexterior_front_passenger-1774701641305.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2470/14572470/exterior_front_passenger-1774701641305.jpg not downloaded yet
2026-03-29 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17939747.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20241032.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2470%252F14572470%252Fexterior_rear_passenger-1774701625395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2470/14572470/exterior_rear_passenger-1774701625395.jpg not downloaded yet
2026-03-29 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0702/20240702/exterior_rear_driver-1774711121235.jpg> (referer: None)
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2470%252F14572470%252Finterior_front_seats-1774702055678.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2470/14572470/interior_front_seats-1774702055678.jpg not downloaded yet
2026-03-29 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=972&page=27&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2470%252F14572470%252Finterior_rear_seats-1774702063274.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2470/14572470/interior_rear_seats-1774702063274.jpg not downloaded yet
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2470%252F14572470%252Finterior_dashboard-1774708169762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2470/14572470/interior_dashboard-1774708169762.jpg not downloaded yet
2026-03-29 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1701/20251701/exterior_front_passenger-1773672564962.jpg> (referer: None)
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2470%252F14572470%252Finstrument_cluster-1774702150666.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2470/14572470/instrument_cluster-1774702150666.jpg not downloaded yet
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2470%252F14572470%252Finterior_boot-1774702493339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2470/14572470/interior_boot-1774702493339.jpg not downloaded yet
2026-03-29 20:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a645b64-685e-595e-80d8-b5ae53403e75 with identifier: 17939747
2026-03-29 20:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a645b64-685e-595e-80d8-b5ae53403e75 with scrape type 1
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a645b64-685e-595e-80d8-b5ae53403e75
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9747%252F17939747%252F17939747-exterior_front_driver-modified-1774782180384.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9747/17939747/17939747-exterior_front_driver-modified-1774782180384.jpeg not downloaded yet
2026-03-29 20:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a916e09-9d40-54d4-9a14-cf16f4f23f02 with identifier: 20241032
2026-03-29 20:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a916e09-9d40-54d4-9a14-cf16f4f23f02 with scrape type 1
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a916e09-9d40-54d4-9a14-cf16f4f23f02
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1032%252F20241032%252Fexterior_front_driver-1774693375911.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1032/20241032/exterior_front_driver-1774693375911.jpg not downloaded yet
2026-03-29 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5734/20435734/instrument_cluster-1774698959493.jpg> (referer: None)
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2470%252F14572470%252Fdocs_service_history-1774702721314.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D616f5c268dcaa1c33f93a74e5bcd00f8%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2470/14572470/docs_service_history-1774702721314.jpg?ixlib=js-3.8.0&auto=format&s=616f5c268dcaa1c33f93a74e5bcd00f8 not downloaded yet
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9747%252F17939747%252Fexterior_rear_driver-1774779846431.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9747/17939747/exterior_rear_driver-1774779846431.jpeg not downloaded yet
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1032%252F20241032%252Fexterior_rear_driver-1774693389823.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1032/20241032/exterior_rear_driver-1774693389823.jpg not downloaded yet
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddd7e50>
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8785243-1ae1-5cdc-abf4-bc9a3477dfae/e8785243-1ae1-5cdc-abf4-bc9a3477dfae_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0702%252F20240702%252Fexterior_rear_driver-1774711121235.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0702/20240702/exterior_rear_driver-1774711121235.jpg saved to cache
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8785243-1ae1-5cdc-abf4-bc9a3477dfae
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9747%252F17939747%252Fexterior_front_passenger-1774779800787.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9747/17939747/exterior_front_passenger-1774779800787.jpeg not downloaded yet
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1032%252F20241032%252Fexterior_front_passenger-1774693424051.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1032/20241032/exterior_front_passenger-1774693424051.jpg not downloaded yet
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20411853
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720411853%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [motorway.uk] INFO: Scrape type for 20411853: 1
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc2dcd0>
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1ec8950-96b1-5602-9c90-871743530b4f/b1ec8950-96b1-5602-9c90-871743530b4f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20251701%252Fexterior_front_passenger-1773672564962.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20251701/exterior_front_passenger-1773672564962.jpg saved to cache
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1ec8950-96b1-5602-9c90-871743530b4f
2026-03-29 20:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18670827.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9747%252F17939747%252Fexterior_rear_passenger-1774779835495.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9747/17939747/exterior_rear_passenger-1774779835495.jpeg not downloaded yet
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1032%252F20241032%252Fexterior_rear_passenger-1774693430279.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1032/20241032/exterior_rear_passenger-1774693430279.jpg not downloaded yet
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 18697582
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 3263792
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273263792%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [motorway.uk] INFO: Scrape type for 3263792: 1
2026-03-29 20:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20020700.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d23a2d0>
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2891630a-9dc5-508a-9a79-85f6ebd3ab43/2891630a-9dc5-508a-9a79-85f6ebd3ab43_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5734%252F20435734%252Finstrument_cluster-1774698959493.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5734/20435734/instrument_cluster-1774698959493.jpg saved to cache
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2891630a-9dc5-508a-9a79-85f6ebd3ab43
2026-03-29 20:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9664/1329664/docs_service_history-1774776987049.jpg?ixlib=js-3.8.0&auto=format&s=3c0b5d58ba5293c0a07a2a87bd9eab71> (referer: None)
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9747%252F17939747%252Finterior_front_seats-1774780072361.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9747/17939747/interior_front_seats-1774780072361.jpeg not downloaded yet
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1032%252F20241032%252Finterior_front_seats-1774693704628.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1032/20241032/interior_front_seats-1774693704628.jpg not downloaded yet
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20388810
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720388810%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [motorway.uk] INFO: Scrape type for 20388810: 1
2026-03-29 20:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17186648.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9747%252F17939747%252Finterior_rear_seats-1774780176375.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9747/17939747/interior_rear_seats-1774780176375.jpeg not downloaded yet
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1032%252F20241032%252Finterior_rear_seats-1774693718900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1032/20241032/interior_rear_seats-1774693718900.jpg not downloaded yet
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20267620
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20355104
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720355104%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [motorway.uk] INFO: Scrape type for 20355104: 1
2026-03-29 20:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad6b5004-3705-5814-9427-5686c3448766 with identifier: 18670827
2026-03-29 20:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad6b5004-3705-5814-9427-5686c3448766 with scrape type 1
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad6b5004-3705-5814-9427-5686c3448766
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0827%252F18670827%252Fexterior_front_driver-1774777245992.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0827/18670827/exterior_front_driver-1774777245992.jpg not downloaded yet
2026-03-29 20:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffdc9cbb-d217-5695-a85f-7af2d8f97b48 with identifier: 20020700
2026-03-29 20:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffdc9cbb-d217-5695-a85f-7af2d8f97b48 with scrape type 1
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffdc9cbb-d217-5695-a85f-7af2d8f97b48
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0700%252F20020700%252F20020700-exterior_front_driver-modified-1774795446391.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0700/20020700/20020700-exterior_front_driver-modified-1774795446391.jpeg not downloaded yet
2026-03-29 20:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5734/20435734/interior_dashboard-1774698647856.jpg> (referer: None)
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9747%252F17939747%252F17939747-interior_dashboard-modified-1774782206680.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9747/17939747/17939747-interior_dashboard-modified-1774782206680.jpeg not downloaded yet
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1032%252F20241032%252Finterior_dashboard-1774693797636.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1032/20241032/interior_dashboard-1774693797636.jpg not downloaded yet
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 16997942
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716997942%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [motorway.uk] INFO: Scrape type for 16997942: 1
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0827%252F18670827%252Fexterior_rear_driver-1774777314186.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0827/18670827/exterior_rear_driver-1774777314186.jpg not downloaded yet
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0700%252F20020700%252F20020700-exterior_rear_driver-modified-1774795473119.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0700/20020700/20020700-exterior_rear_driver-modified-1774795473119.jpeg not downloaded yet
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4717d0>
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00affa57-1b73-56aa-99ca-06869cee6459/00affa57-1b73-56aa-99ca-06869cee6459_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9664%252F1329664%252Fdocs_service_history-1774776987049.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3c0b5d58ba5293c0a07a2a87bd9eab71') HTTP/1.1" 204 0
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9664/1329664/docs_service_history-1774776987049.jpg?ixlib=js-3.8.0&auto=format&s=3c0b5d58ba5293c0a07a2a87bd9eab71 saved to cache
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00affa57-1b73-56aa-99ca-06869cee6459
2026-03-29 20:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce21505d-a833-5986-9251-1f578cac70a6 with identifier: 17186648
2026-03-29 20:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce21505d-a833-5986-9251-1f578cac70a6 with scrape type 1
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce21505d-a833-5986-9251-1f578cac70a6
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6648%252F17186648%252Fexterior_front_driver-1774702416473.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6648/17186648/exterior_front_driver-1774702416473.jpg not downloaded yet
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9747%252F17939747%252Finstrument_cluster-1774780231675.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9747/17939747/instrument_cluster-1774780231675.jpeg not downloaded yet
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1032%252F20241032%252Finterior_boot-1774693759201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1032/20241032/interior_boot-1774693759201.jpg not downloaded yet
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20235987
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20327167
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 18355209
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20500674
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20417268
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20488448
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 4592998
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20289196
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 17884848
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20406554
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20396431
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20479789
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20496248
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 16533872
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20491744
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 19390207
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719390207%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [motorway.uk] INFO: Scrape type for 19390207: 1
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0827%252F18670827%252Fexterior_front_passenger-1774777349769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0827/18670827/exterior_front_passenger-1774777349769.jpg not downloaded yet
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0700%252F20020700%252F20020700-exterior_front_passenger-modified-1774795508454.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0700/20020700/20020700-exterior_front_passenger-modified-1774795508454.jpeg not downloaded yet
2026-03-29 20:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1701/20251701/docs_service_history-1773673791782.jpg?ixlib=js-3.8.0&auto=format&s=abdebf97187f3a782ddccf13b8db27f3> (referer: None)
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6648%252F17186648%252Fexterior_rear_driver-1774698859676.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6648/17186648/exterior_rear_driver-1774698859676.jpg not downloaded yet
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9747%252F17939747%252Finterior_boot-1774780282898.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9747/17939747/interior_boot-1774780282898.jpeg not downloaded yet
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1032%252F20241032%252Fdocs_service_history-1774695949751.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D697d5a8cd6c33742451a22c20c60973b%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1032/20241032/docs_service_history-1774695949751.jpg?ixlib=js-3.8.0&auto=format&s=697d5a8cd6c33742451a22c20c60973b not downloaded yet
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20065341
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720065341%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [motorway.uk] INFO: Scrape type for 20065341: 1
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0827%252F18670827%252Fexterior_rear_passenger-1774777328467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0827/18670827/exterior_rear_passenger-1774777328467.jpg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0700%252F20020700%252F20020700-exterior_rear_passenger-modified-1774795536697.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0700/20020700/20020700-exterior_rear_passenger-modified-1774795536697.jpeg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6648%252F17186648%252Fexterior_front_passenger-1774698896937.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6648/17186648/exterior_front_passenger-1774698896937.jpg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9747%252F17939747%252Fdocs_service_history-1774781010912.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2247b50cf43fe29ea502642f65518d32%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9747/17939747/docs_service_history-1774781010912.jpeg?ixlib=js-3.8.0&auto=format&s=2247b50cf43fe29ea502642f65518d32 not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1032%252F20241032%252Fdocs_service_history-1774695949785.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5ff43b1ee105a45ad67f14d56f84ec57%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1032/20241032/docs_service_history-1774695949785.jpg?ixlib=js-3.8.0&auto=format&s=5ff43b1ee105a45ad67f14d56f84ec57 not downloaded yet
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 20491588
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491588%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [motorway.uk] INFO: Scrape type for 20491588: 1
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0827%252F18670827%252Finterior_front_seats-1774777745728.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0827/18670827/interior_front_seats-1774777745728.jpg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0700%252F20020700%252Finterior_front_seats-1774794004391.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0700/20020700/interior_front_seats-1774794004391.jpeg not downloaded yet
2026-03-29 20:10:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c679750>
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2891630a-9dc5-508a-9a79-85f6ebd3ab43/2891630a-9dc5-508a-9a79-85f6ebd3ab43_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5734%252F20435734%252Finterior_dashboard-1774698647856.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5734/20435734/interior_dashboard-1774698647856.jpg saved to cache
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2891630a-9dc5-508a-9a79-85f6ebd3ab43
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6648%252F17186648%252Fexterior_rear_passenger-1774698874301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6648/17186648/exterior_rear_passenger-1774698874301.jpg not downloaded yet
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 19412192
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719412192%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [motorway.uk] INFO: Scrape type for 19412192: 1
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0827%252F18670827%252Finterior_rear_seats-1774777730798.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0827/18670827/interior_rear_seats-1774777730798.jpg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0700%252F20020700%252Finterior_rear_seats-1774794085065.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0700/20020700/interior_rear_seats-1774794085065.jpeg not downloaded yet
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d055c50>
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1ec8950-96b1-5602-9c90-871743530b4f/b1ec8950-96b1-5602-9c90-871743530b4f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1701%252F20251701%252Fdocs_service_history-1773673791782.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dabdebf97187f3a782ddccf13b8db27f3') HTTP/1.1" 204 0
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1701/20251701/docs_service_history-1773673791782.jpg?ixlib=js-3.8.0&auto=format&s=abdebf97187f3a782ddccf13b8db27f3 saved to cache
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1ec8950-96b1-5602-9c90-871743530b4f
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6648%252F17186648%252Finterior_front_seats-1774699653895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6648/17186648/interior_front_seats-1774699653895.jpg not downloaded yet
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 8144237
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 20178701
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 9608672
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 20487398
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 20473693
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473693%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [motorway.uk] INFO: Scrape type for 20473693: 1
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0827%252F18670827%252Finterior_dashboard-1774777725401.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0827/18670827/interior_dashboard-1774777725401.jpg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0700%252F20020700%252F20020700-interior_dashboard-modified-1774795213941.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0700/20020700/20020700-interior_dashboard-modified-1774795213941.jpeg not downloaded yet
2026-03-29 20:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2470/14572470/exterior_rear_driver-1774701611671.jpg> (referer: None)
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6648%252F17186648%252Finterior_rear_seats-1774699693215.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6648/17186648/interior_rear_seats-1774699693215.jpg not downloaded yet
2026-03-29 20:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2470/14572470/exterior_front_driver-1774701593752.jpg> (referer: None)
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 19953302
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 20149199
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 20426141
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 10536049
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 20307524
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0827%252F18670827%252Finterior_boot-1774777691250.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0827/18670827/interior_boot-1774777691250.jpg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0700%252F20020700%252Finstrument_cluster-1774794179833.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0700/20020700/instrument_cluster-1774794179833.jpeg not downloaded yet
2026-03-29 20:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2470/14572470/exterior_front_passenger-1774701641305.jpg> (referer: None)
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6648%252F17186648%252Finterior_dashboard-1774699773541.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6648/17186648/interior_dashboard-1774699773541.jpg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0827%252F18670827%252Fdocs_service_history-1774778165784.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De3f805dfb96a831090d68d798e6928bf%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0827/18670827/docs_service_history-1774778165784.jpg?ixlib=js-3.8.0&auto=format&s=e3f805dfb96a831090d68d798e6928bf not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0700%252F20020700%252F20020700-interior_boot-modified-1774795225161.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0700/20020700/20020700-interior_boot-modified-1774795225161.jpeg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6648%252F17186648%252Finstrument_cluster-1774699742344.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6648/17186648/instrument_cluster-1774699742344.jpg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0827%252F18670827%252Fdocs_service_history-1774778168327.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da094b6670c53d3c4c8d07c8fe5021ec1%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0827/18670827/docs_service_history-1774778168327.jpg?ixlib=js-3.8.0&auto=format&s=a094b6670c53d3c4c8d07c8fe5021ec1 not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0700%252F20020700%252F20020700-damage_scratches-modified-1774795887847.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0700/20020700/20020700-damage_scratches-modified-1774795887847.jpeg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6648%252F17186648%252Finterior_boot-1774699790392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6648/17186648/interior_boot-1774699790392.jpg not downloaded yet
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c22d0>
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31b43d2-37e8-55e5-a775-9c02c668bd04/b31b43d2-37e8-55e5-a775-9c02c668bd04_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2470%252F14572470%252Fexterior_rear_driver-1774701611671.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2470/14572470/exterior_rear_driver-1774701611671.jpg saved to cache
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b31b43d2-37e8-55e5-a775-9c02c668bd04
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f306350>
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31b43d2-37e8-55e5-a775-9c02c668bd04/b31b43d2-37e8-55e5-a775-9c02c668bd04_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2470%252F14572470%252Fexterior_front_driver-1774701593752.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2470/14572470/exterior_front_driver-1774701593752.jpg saved to cache
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b31b43d2-37e8-55e5-a775-9c02c668bd04
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6648%252F17186648%252Fdocs_service_history-1774700256985.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2e60397adee16f9b350df68a137e22ad%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6648/17186648/docs_service_history-1774700256985.jpg?ixlib=js-3.8.0&auto=format&s=2e60397adee16f9b350df68a137e22ad not downloaded yet
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de54d10>
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31b43d2-37e8-55e5-a775-9c02c668bd04/b31b43d2-37e8-55e5-a775-9c02c668bd04_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2470%252F14572470%252Fexterior_front_passenger-1774701641305.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2470/14572470/exterior_front_passenger-1774701641305.jpg saved to cache
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b31b43d2-37e8-55e5-a775-9c02c668bd04
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2470/14572470/exterior_rear_passenger-1774701625395.jpg> (referer: None)
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1032/20241032/exterior_rear_passenger-1774693430279.jpg> (referer: None)
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0702/20240702/interior_boot-1774711727957.jpg> (referer: None)
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2470/14572470/interior_rear_seats-1774702063274.jpg> (referer: None)
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2470/14572470/interior_front_seats-1774702055678.jpg> (referer: None)
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9747/17939747/interior_front_seats-1774780072361.jpeg> (referer: None)
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1032/20241032/interior_front_seats-1774693704628.jpg> (referer: None)
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6648/17186648/exterior_rear_passenger-1774698874301.jpg> (referer: None)
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1701/20251701/interior_boot-1773673424020.jpg> (referer: None)
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0700/20020700/20020700-interior_dashboard-modified-1774795213941.jpeg> (referer: None)
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6648/17186648/interior_front_seats-1774699653895.jpg> (referer: None)
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0700/20020700/interior_front_seats-1774794004391.jpeg> (referer: None)
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0700/20020700/20020700-damage_scratches-modified-1774795887847.jpeg> (referer: None)
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e109a10>
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31b43d2-37e8-55e5-a775-9c02c668bd04/b31b43d2-37e8-55e5-a775-9c02c668bd04_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2470%252F14572470%252Fexterior_rear_passenger-1774701625395.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2470/14572470/exterior_rear_passenger-1774701625395.jpg saved to cache
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b31b43d2-37e8-55e5-a775-9c02c668bd04
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d056010>
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a916e09-9d40-54d4-9a14-cf16f4f23f02/4a916e09-9d40-54d4-9a14-cf16f4f23f02_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1032%252F20241032%252Fexterior_rear_passenger-1774693430279.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1032/20241032/exterior_rear_passenger-1774693430279.jpg saved to cache
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a916e09-9d40-54d4-9a14-cf16f4f23f02
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d056010>
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8785243-1ae1-5cdc-abf4-bc9a3477dfae/e8785243-1ae1-5cdc-abf4-bc9a3477dfae_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0702%252F20240702%252Finterior_boot-1774711727957.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0702/20240702/interior_boot-1774711727957.jpg saved to cache
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8785243-1ae1-5cdc-abf4-bc9a3477dfae
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4f8f90>
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31b43d2-37e8-55e5-a775-9c02c668bd04/b31b43d2-37e8-55e5-a775-9c02c668bd04_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2470%252F14572470%252Finterior_rear_seats-1774702063274.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2470/14572470/interior_rear_seats-1774702063274.jpg saved to cache
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b31b43d2-37e8-55e5-a775-9c02c668bd04
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5cc690>
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31b43d2-37e8-55e5-a775-9c02c668bd04/b31b43d2-37e8-55e5-a775-9c02c668bd04_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2470%252F14572470%252Finterior_front_seats-1774702055678.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2470/14572470/interior_front_seats-1774702055678.jpg saved to cache
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b31b43d2-37e8-55e5-a775-9c02c668bd04
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003\x87h\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xf8\xd2\x003}J\x00\x00\x00\x00'
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d106a50>
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a645b64-685e-595e-80d8-b5ae53403e75/2a645b64-685e-595e-80d8-b5ae53403e75_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9747%252F17939747%252Finterior_front_seats-1774780072361.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9747/17939747/interior_front_seats-1774780072361.jpeg saved to cache
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a645b64-685e-595e-80d8-b5ae53403e75
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d106a90>
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a916e09-9d40-54d4-9a14-cf16f4f23f02/4a916e09-9d40-54d4-9a14-cf16f4f23f02_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1032%252F20241032%252Finterior_front_seats-1774693704628.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1032/20241032/interior_front_seats-1774693704628.jpg saved to cache
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a916e09-9d40-54d4-9a14-cf16f4f23f02
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2925d0>
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce21505d-a833-5986-9251-1f578cac70a6/ce21505d-a833-5986-9251-1f578cac70a6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6648%252F17186648%252Fexterior_rear_passenger-1774698874301.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6648/17186648/exterior_rear_passenger-1774698874301.jpg saved to cache
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce21505d-a833-5986-9251-1f578cac70a6
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5ced50>
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1ec8950-96b1-5602-9c90-871743530b4f/b1ec8950-96b1-5602-9c90-871743530b4f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1701%252F20251701%252Finterior_boot-1773673424020.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1701/20251701/interior_boot-1773673424020.jpg saved to cache
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1ec8950-96b1-5602-9c90-871743530b4f
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4faed0>
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc9cbb-d217-5695-a85f-7af2d8f97b48/ffdc9cbb-d217-5695-a85f-7af2d8f97b48_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0700%252F20020700%252F20020700-interior_dashboard-modified-1774795213941.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0700/20020700/20020700-interior_dashboard-modified-1774795213941.jpeg saved to cache
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffdc9cbb-d217-5695-a85f-7af2d8f97b48
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e11a610>
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce21505d-a833-5986-9251-1f578cac70a6/ce21505d-a833-5986-9251-1f578cac70a6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6648%252F17186648%252Finterior_front_seats-1774699653895.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6648/17186648/interior_front_seats-1774699653895.jpg saved to cache
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce21505d-a833-5986-9251-1f578cac70a6
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x007JB\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xd1\xa7\x007@$\x00\x00\x00\x00'
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5dc510>
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc9cbb-d217-5695-a85f-7af2d8f97b48/ffdc9cbb-d217-5695-a85f-7af2d8f97b48_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0700%252F20020700%252Finterior_front_seats-1774794004391.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0700/20020700/interior_front_seats-1774794004391.jpeg saved to cache
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffdc9cbb-d217-5695-a85f-7af2d8f97b48
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5cd0d0>
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc9cbb-d217-5695-a85f-7af2d8f97b48/ffdc9cbb-d217-5695-a85f-7af2d8f97b48_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0700%252F20020700%252F20020700-damage_scratches-modified-1774795887847.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0700/20020700/20020700-damage_scratches-modified-1774795887847.jpeg saved to cache
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffdc9cbb-d217-5695-a85f-7af2d8f97b48
2026-03-29 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15733189.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6648/17186648/docs_service_history-1774700256985.jpg?ixlib=js-3.8.0&auto=format&s=2e60397adee16f9b350df68a137e22ad> (referer: None)
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6648/17186648/interior_boot-1774699790392.jpg> (referer: None)
2026-03-29 20:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3509e2de-99d6-5cef-aab3-282e8c3f954a with identifier: 15733189
2026-03-29 20:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3509e2de-99d6-5cef-aab3-282e8c3f954a with scrape type 1
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3509e2de-99d6-5cef-aab3-282e8c3f954a
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3189%252F15733189%252Fexterior_front_driver-1774714867869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_front_driver-1774714867869.jpg not downloaded yet
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3189%252F15733189%252Fexterior_rear_driver-1774714879785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_rear_driver-1774714879785.jpg not downloaded yet
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3189%252F15733189%252Fexterior_front_passenger-1774714892155.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_front_passenger-1774714892155.jpg not downloaded yet
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3263792.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20388810.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5d3d10>
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce21505d-a833-5986-9251-1f578cac70a6/ce21505d-a833-5986-9251-1f578cac70a6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6648%252F17186648%252Fdocs_service_history-1774700256985.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2e60397adee16f9b350df68a137e22ad') HTTP/1.1" 204 0
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6648/17186648/docs_service_history-1774700256985.jpg?ixlib=js-3.8.0&auto=format&s=2e60397adee16f9b350df68a137e22ad saved to cache
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce21505d-a833-5986-9251-1f578cac70a6
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0a8910>
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce21505d-a833-5986-9251-1f578cac70a6/ce21505d-a833-5986-9251-1f578cac70a6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6648%252F17186648%252Finterior_boot-1774699790392.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6648/17186648/interior_boot-1774699790392.jpg saved to cache
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce21505d-a833-5986-9251-1f578cac70a6
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3189%252F15733189%252Fexterior_rear_passenger-1774714883257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_rear_passenger-1774714883257.jpg not downloaded yet
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3189%252F15733189%252Finterior_front_seats-1774715380933.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3189/15733189/interior_front_seats-1774715380933.jpg not downloaded yet
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0827/18670827/docs_service_history-1774778168327.jpg?ixlib=js-3.8.0&auto=format&s=a094b6670c53d3c4c8d07c8fe5021ec1> (referer: None)
2026-03-29 20:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 109fe503-0a63-54e6-afcc-d130318c1bde with identifier: 3263792
2026-03-29 20:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 109fe503-0a63-54e6-afcc-d130318c1bde with scrape type 1
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 109fe503-0a63-54e6-afcc-d130318c1bde
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3792%252F3263792%252Fexterior_front_driver-1774696082768.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_front_driver-1774696082768.jpg not downloaded yet
2026-03-29 20:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 145d9490-e6c8-55eb-af14-58fe94bae51b with identifier: 20388810
2026-03-29 20:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 145d9490-e6c8-55eb-af14-58fe94bae51b with scrape type 1
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 145d9490-e6c8-55eb-af14-58fe94bae51b
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8810%252F20388810%252Fexterior_front_driver-1774782439411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8810/20388810/exterior_front_driver-1774782439411.jpg not downloaded yet
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3189%252F15733189%252Finterior_rear_seats-1774715279627.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3189/15733189/interior_rear_seats-1774715279627.jpg not downloaded yet
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3792%252F3263792%252Fexterior_rear_driver-1774696135603.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_rear_driver-1774696135603.jpg not downloaded yet
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8810%252F20388810%252Fexterior_rear_driver-1774782429109.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8810/20388810/exterior_rear_driver-1774782429109.jpg not downloaded yet
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3189%252F15733189%252Finterior_dashboard-1774715410139.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3189/15733189/interior_dashboard-1774715410139.jpg not downloaded yet
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3792%252F3263792%252Fexterior_front_passenger-1774696101447.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_front_passenger-1774696101447.jpg not downloaded yet
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8810%252F20388810%252Fexterior_front_passenger-1774717139228.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8810/20388810/exterior_front_passenger-1774717139228.jpg not downloaded yet
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3189%252F15733189%252Finstrument_cluster-1774715388107.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3189/15733189/instrument_cluster-1774715388107.jpg not downloaded yet
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d584350>
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6b5004-3705-5814-9427-5686c3448766/ad6b5004-3705-5814-9427-5686c3448766_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0827%252F18670827%252Fdocs_service_history-1774778168327.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da094b6670c53d3c4c8d07c8fe5021ec1') HTTP/1.1" 204 0
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0827/18670827/docs_service_history-1774778168327.jpg?ixlib=js-3.8.0&auto=format&s=a094b6670c53d3c4c8d07c8fe5021ec1 saved to cache
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad6b5004-3705-5814-9427-5686c3448766
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3792%252F3263792%252Fexterior_rear_passenger-1774696122492.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_rear_passenger-1774696122492.jpg not downloaded yet
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8810%252F20388810%252Fexterior_rear_passenger-1774782409493.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8810/20388810/exterior_rear_passenger-1774782409493.jpg not downloaded yet
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0827/18670827/docs_service_history-1774778165784.jpg?ixlib=js-3.8.0&auto=format&s=e3f805dfb96a831090d68d798e6928bf> (referer: None)
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3189%252F15733189%252Finterior_boot-1774715345189.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3189/15733189/interior_boot-1774715345189.jpg not downloaded yet
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3792%252F3263792%252Finterior_front_seats-1774696346722.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3792/3263792/interior_front_seats-1774696346722.jpg not downloaded yet
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8810%252F20388810%252Finterior_front_seats-1774717308572.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8810/20388810/interior_front_seats-1774717308572.jpg not downloaded yet
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3189%252F15733189%252Fdocs_service_history-1774716498807.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7212725ab9618e854c875b27d833196d%27 HTTP/1.1" 200 None
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3189/15733189/docs_service_history-1774716498807.jpg?ixlib=js-3.8.0&auto=format&s=7212725ab9618e854c875b27d833196d not downloaded yet
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3792%252F3263792%252Finterior_rear_seats-1774696233536.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3792/3263792/interior_rear_seats-1774696233536.jpg not downloaded yet
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8810%252F20388810%252Finterior_rear_seats-1774717316913.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8810/20388810/interior_rear_seats-1774717316913.jpg not downloaded yet
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3792%252F3263792%252Finterior_dashboard-1774696294274.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3792/3263792/interior_dashboard-1774696294274.jpg not downloaded yet
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8810%252F20388810%252Finterior_dashboard-1774782393073.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8810/20388810/interior_dashboard-1774782393073.jpg not downloaded yet
2026-03-29 20:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_front_driver-1774714867869.jpg> (referer: None)
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3792%252F3263792%252Finstrument_cluster-1774696340876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3792/3263792/instrument_cluster-1774696340876.jpg not downloaded yet
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8810%252F20388810%252Finstrument_cluster-1774717418834.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8810/20388810/instrument_cluster-1774717418834.jpg not downloaded yet
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6bcc90>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6b5004-3705-5814-9427-5686c3448766/ad6b5004-3705-5814-9427-5686c3448766_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0827%252F18670827%252Fdocs_service_history-1774778165784.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De3f805dfb96a831090d68d798e6928bf') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0827/18670827/docs_service_history-1774778165784.jpg?ixlib=js-3.8.0&auto=format&s=e3f805dfb96a831090d68d798e6928bf saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad6b5004-3705-5814-9427-5686c3448766
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3792%252F3263792%252Finterior_boot-1774696314655.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3792/3263792/interior_boot-1774696314655.jpg not downloaded yet
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8810%252F20388810%252Finterior_boot-1774717335020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8810/20388810/interior_boot-1774717335020.jpg not downloaded yet
2026-03-29 20:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6648/17186648/interior_dashboard-1774699773541.jpg> (referer: None)
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6ed490>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3189%252F15733189%252Fexterior_front_driver-1774714867869.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_front_driver-1774714867869.jpg saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3509e2de-99d6-5cef-aab3-282e8c3f954a
2026-03-29 20:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_rear_passenger-1774714883257.jpg> (referer: None)
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3792%252F3263792%252F3263792-docs_service_history-default-1774778029429.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ee230e54a67aa8de3f5c5cb9cd5a0f6%27 HTTP/1.1" 200 None
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3792/3263792/3263792-docs_service_history-default-1774778029429.jpg?ixlib=js-3.8.0&auto=format&s=3ee230e54a67aa8de3f5c5cb9cd5a0f6 not downloaded yet
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8810%252F20388810%252Fdocs_service_history-1774717461530.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D41eeae3179e2b19670ef3f4f5dbb8aea%27 HTTP/1.1" 200 None
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8810/20388810/docs_service_history-1774717461530.jpg?ixlib=js-3.8.0&auto=format&s=41eeae3179e2b19670ef3f4f5dbb8aea not downloaded yet
2026-03-29 20:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0827/18670827/interior_dashboard-1774777725401.jpg> (referer: None)
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cac9710>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce21505d-a833-5986-9251-1f578cac70a6/ce21505d-a833-5986-9251-1f578cac70a6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6648%252F17186648%252Finterior_dashboard-1774699773541.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6648/17186648/interior_dashboard-1774699773541.jpg saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce21505d-a833-5986-9251-1f578cac70a6
2026-03-29 20:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_front_passenger-1774714892155.jpg> (referer: None)
2026-03-29 20:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_rear_driver-1774714879785.jpg> (referer: None)
2026-03-29 20:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1008&page=28&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2caca610>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3189%252F15733189%252Fexterior_rear_passenger-1774714883257.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_rear_passenger-1774714883257.jpg saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3509e2de-99d6-5cef-aab3-282e8c3f954a
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7a5610>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6b5004-3705-5814-9427-5686c3448766/ad6b5004-3705-5814-9427-5686c3448766_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0827%252F18670827%252Finterior_dashboard-1774777725401.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0827/18670827/interior_dashboard-1774777725401.jpg saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad6b5004-3705-5814-9427-5686c3448766
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7a5cd0>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3189%252F15733189%252Fexterior_front_passenger-1774714892155.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_front_passenger-1774714892155.jpg saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3509e2de-99d6-5cef-aab3-282e8c3f954a
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d163650>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3189%252F15733189%252Fexterior_rear_driver-1774714879785.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_rear_driver-1774714879785.jpg saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3509e2de-99d6-5cef-aab3-282e8c3f954a
2026-03-29 20:10:38 [motorway.uk] INFO: Found listing with ID: 20304692
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720304692%27 HTTP/1.1" 200 None
2026-03-29 20:10:39 [motorway.uk] INFO: Scrape type for 20304692: 1
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 15783679
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 17667845
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717667845%27 HTTP/1.1" 200 None
2026-03-29 20:10:39 [motorway.uk] INFO: Scrape type for 17667845: 1
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 17291886
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 17331311
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20377284
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 18264016
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20486192
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20489798
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 18016902
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20194798
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 19772114
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20365288
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720365288%27 HTTP/1.1" 200 None
2026-03-29 20:10:39 [motorway.uk] INFO: Scrape type for 20365288: 1
2026-03-29 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8810/20388810/docs_service_history-1774717461530.jpg?ixlib=js-3.8.0&auto=format&s=41eeae3179e2b19670ef3f4f5dbb8aea> (referer: None)
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 19121650
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 13570427
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 13327562
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 17966792
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20229861
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20471278
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20454392
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20165611
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 19472539
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20422592
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20385998
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720385998%27 HTTP/1.1" 200 None
2026-03-29 20:10:39 [motorway.uk] INFO: Scrape type for 20385998: 1
2026-03-29 20:10:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 16437364
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20369773
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 18202599
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20493993
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720493993%27 HTTP/1.1" 200 None
2026-03-29 20:10:39 [motorway.uk] INFO: Scrape type for 20493993: 1
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 9310356
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20226525
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 3894223
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 9990352
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279990352%27 HTTP/1.1" 200 None
2026-03-29 20:10:39 [motorway.uk] INFO: Scrape type for 9990352: 1
2026-03-29 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6648/17186648/instrument_cluster-1774699742344.jpg> (referer: None)
2026-03-29 20:10:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3792/3263792/3263792-docs_service_history-default-1774778029429.jpg?ixlib=js-3.8.0&auto=format&s=3ee230e54a67aa8de3f5c5cb9cd5a0f6> (referer: None)
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 19838996
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 13722608
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20486496
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486496%27 HTTP/1.1" 200 None
2026-03-29 20:10:39 [motorway.uk] INFO: Scrape type for 20486496: 1
2026-03-29 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0700/20020700/instrument_cluster-1774794179833.jpeg> (referer: None)
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c669b90>
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8810%252F20388810%252Fdocs_service_history-1774717461530.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D41eeae3179e2b19670ef3f4f5dbb8aea') HTTP/1.1" 204 0
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8810/20388810/docs_service_history-1774717461530.jpg?ixlib=js-3.8.0&auto=format&s=41eeae3179e2b19670ef3f4f5dbb8aea saved to cache
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 145d9490-e6c8-55eb-af14-58fe94bae51b
2026-03-29 20:10:39 [motorway.uk] INFO: Found listing with ID: 20043212
2026-03-29 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0827/18670827/interior_boot-1774777691250.jpg> (referer: None)
2026-03-29 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3792/3263792/instrument_cluster-1774696340876.jpg> (referer: None)
2026-03-29 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6648/17186648/interior_rear_seats-1774699693215.jpg> (referer: None)
2026-03-29 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3189/15733189/instrument_cluster-1774715388107.jpg> (referer: None)
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f35fe10>
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce21505d-a833-5986-9251-1f578cac70a6/ce21505d-a833-5986-9251-1f578cac70a6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6648%252F17186648%252Finstrument_cluster-1774699742344.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6648/17186648/instrument_cluster-1774699742344.jpg saved to cache
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce21505d-a833-5986-9251-1f578cac70a6
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d160890>
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3792%252F3263792%252F3263792-docs_service_history-default-1774778029429.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ee230e54a67aa8de3f5c5cb9cd5a0f6') HTTP/1.1" 204 0
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3792/3263792/3263792-docs_service_history-default-1774778029429.jpg?ixlib=js-3.8.0&auto=format&s=3ee230e54a67aa8de3f5c5cb9cd5a0f6 saved to cache
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 109fe503-0a63-54e6-afcc-d130318c1bde
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*[]\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02+\xc3\x00*Q?\x00\x00\x00\x00'
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2caca150>
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc9cbb-d217-5695-a85f-7af2d8f97b48/ffdc9cbb-d217-5695-a85f-7af2d8f97b48_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0700%252F20020700%252Finstrument_cluster-1774794179833.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0700/20020700/instrument_cluster-1774794179833.jpeg saved to cache
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffdc9cbb-d217-5695-a85f-7af2d8f97b48
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d273010>
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6b5004-3705-5814-9427-5686c3448766/ad6b5004-3705-5814-9427-5686c3448766_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0827%252F18670827%252Finterior_boot-1774777691250.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0827/18670827/interior_boot-1774777691250.jpg saved to cache
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad6b5004-3705-5814-9427-5686c3448766
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d272950>
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3792%252F3263792%252Finstrument_cluster-1774696340876.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3792/3263792/instrument_cluster-1774696340876.jpg saved to cache
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 109fe503-0a63-54e6-afcc-d130318c1bde
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6faad0>
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce21505d-a833-5986-9251-1f578cac70a6/ce21505d-a833-5986-9251-1f578cac70a6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6648%252F17186648%252Finterior_rear_seats-1774699693215.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6648/17186648/interior_rear_seats-1774699693215.jpg saved to cache
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce21505d-a833-5986-9251-1f578cac70a6
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2199d0>
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3189%252F15733189%252Finstrument_cluster-1774715388107.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3189/15733189/instrument_cluster-1774715388107.jpg saved to cache
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3509e2de-99d6-5cef-aab3-282e8c3f954a
2026-03-29 20:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0700/20020700/interior_rear_seats-1774794085065.jpeg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0700/20020700/20020700-interior_boot-modified-1774795225161.jpeg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0827/18670827/interior_rear_seats-1774777730798.jpg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8810/20388810/interior_dashboard-1774782393073.jpg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8810/20388810/instrument_cluster-1774717418834.jpg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3792/3263792/interior_boot-1774696314655.jpg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8810/20388810/interior_boot-1774717335020.jpg> (referer: None)
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x005mG\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02f\xe1\x005c)\x00\x00\x00\x00'
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c692990>
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc9cbb-d217-5695-a85f-7af2d8f97b48/ffdc9cbb-d217-5695-a85f-7af2d8f97b48_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0700%252F20020700%252Finterior_rear_seats-1774794085065.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0700/20020700/interior_rear_seats-1774794085065.jpeg saved to cache
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffdc9cbb-d217-5695-a85f-7af2d8f97b48
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c690150>
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc9cbb-d217-5695-a85f-7af2d8f97b48/ffdc9cbb-d217-5695-a85f-7af2d8f97b48_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0700%252F20020700%252F20020700-interior_boot-modified-1774795225161.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0700/20020700/20020700-interior_boot-modified-1774795225161.jpeg saved to cache
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffdc9cbb-d217-5695-a85f-7af2d8f97b48
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d91b150>
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6b5004-3705-5814-9427-5686c3448766/ad6b5004-3705-5814-9427-5686c3448766_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0827%252F18670827%252Finterior_rear_seats-1774777730798.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0827/18670827/interior_rear_seats-1774777730798.jpg saved to cache
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad6b5004-3705-5814-9427-5686c3448766
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4ec1d0>
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8810%252F20388810%252Finterior_dashboard-1774782393073.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8810/20388810/interior_dashboard-1774782393073.jpg saved to cache
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 145d9490-e6c8-55eb-af14-58fe94bae51b
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5b7190>
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8810%252F20388810%252Finstrument_cluster-1774717418834.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8810/20388810/instrument_cluster-1774717418834.jpg saved to cache
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 145d9490-e6c8-55eb-af14-58fe94bae51b
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd3c110>
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3792%252F3263792%252Finterior_boot-1774696314655.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3792/3263792/interior_boot-1774696314655.jpg saved to cache
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 109fe503-0a63-54e6-afcc-d130318c1bde
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca4e3d0>
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8810%252F20388810%252Finterior_boot-1774717335020.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8810/20388810/interior_boot-1774717335020.jpg saved to cache
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 145d9490-e6c8-55eb-af14-58fe94bae51b
2026-03-29 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3792/3263792/interior_dashboard-1774696294274.jpg> (referer: None)
2026-03-29 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3792/3263792/interior_front_seats-1774696346722.jpg> (referer: None)
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db48910>
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3792%252F3263792%252Finterior_dashboard-1774696294274.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3792/3263792/interior_dashboard-1774696294274.jpg saved to cache
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 109fe503-0a63-54e6-afcc-d130318c1bde
2026-03-29 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3792/3263792/interior_rear_seats-1774696233536.jpg> (referer: None)
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d229cd0>
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3792%252F3263792%252Finterior_front_seats-1774696346722.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3792/3263792/interior_front_seats-1774696346722.jpg saved to cache
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 109fe503-0a63-54e6-afcc-d130318c1bde
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db483d0>
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3792%252F3263792%252Finterior_rear_seats-1774696233536.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3792/3263792/interior_rear_seats-1774696233536.jpg saved to cache
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 109fe503-0a63-54e6-afcc-d130318c1bde
2026-03-29 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_rear_passenger-1774696122492.jpg> (referer: None)
2026-03-29 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8810/20388810/exterior_rear_passenger-1774782409493.jpg> (referer: None)
2026-03-29 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8810/20388810/interior_front_seats-1774717308572.jpg> (referer: None)
2026-03-29 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8810/20388810/interior_rear_seats-1774717316913.jpg> (referer: None)
2026-03-29 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3189/15733189/docs_service_history-1774716498807.jpg?ixlib=js-3.8.0&auto=format&s=7212725ab9618e854c875b27d833196d> (referer: None)
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d22be90>
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3792%252F3263792%252Fexterior_rear_passenger-1774696122492.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_rear_passenger-1774696122492.jpg saved to cache
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 109fe503-0a63-54e6-afcc-d130318c1bde
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d918790>
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8810%252F20388810%252Fexterior_rear_passenger-1774782409493.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8810/20388810/exterior_rear_passenger-1774782409493.jpg saved to cache
2026-03-29 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 145d9490-e6c8-55eb-af14-58fe94bae51b
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c82b510>
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8810%252F20388810%252Finterior_front_seats-1774717308572.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8810/20388810/interior_front_seats-1774717308572.jpg saved to cache
2026-03-29 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 145d9490-e6c8-55eb-af14-58fe94bae51b
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc92010>
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8810%252F20388810%252Finterior_rear_seats-1774717316913.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8810/20388810/interior_rear_seats-1774717316913.jpg saved to cache
2026-03-29 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 145d9490-e6c8-55eb-af14-58fe94bae51b
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd3c910>
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3189%252F15733189%252Fdocs_service_history-1774716498807.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7212725ab9618e854c875b27d833196d') HTTP/1.1" 204 0
2026-03-29 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3189/15733189/docs_service_history-1774716498807.jpg?ixlib=js-3.8.0&auto=format&s=7212725ab9618e854c875b27d833196d saved to cache
2026-03-29 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3509e2de-99d6-5cef-aab3-282e8c3f954a
2026-03-29 20:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3189/15733189/interior_boot-1774715345189.jpg> (referer: None)
2026-03-29 20:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1044&page=29&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_front_passenger-1774696101447.jpg> (referer: None)
2026-03-29 20:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8810/20388810/exterior_front_passenger-1774717139228.jpg> (referer: None)
2026-03-29 20:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3189/15733189/interior_dashboard-1774715410139.jpg> (referer: None)
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f63ead0>
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3189%252F15733189%252Finterior_boot-1774715345189.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3189/15733189/interior_boot-1774715345189.jpg saved to cache
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3509e2de-99d6-5cef-aab3-282e8c3f954a
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20481167
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720481167%27 HTTP/1.1" 200 None
2026-03-29 20:10:44 [motorway.uk] INFO: Scrape type for 20481167: 1
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2d7990>
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3792%252F3263792%252Fexterior_front_passenger-1774696101447.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_front_passenger-1774696101447.jpg saved to cache
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 109fe503-0a63-54e6-afcc-d130318c1bde
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca6df50>
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8810%252F20388810%252Fexterior_front_passenger-1774717139228.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8810/20388810/exterior_front_passenger-1774717139228.jpg saved to cache
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 145d9490-e6c8-55eb-af14-58fe94bae51b
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f44bbd0>
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3189%252F15733189%252Finterior_dashboard-1774715410139.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3189/15733189/interior_dashboard-1774715410139.jpg saved to cache
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3509e2de-99d6-5cef-aab3-282e8c3f954a
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 11262426
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 19102337
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20421191
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20228423
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20365167
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720365167%27 HTTP/1.1" 200 None
2026-03-29 20:10:44 [motorway.uk] INFO: Scrape type for 20365167: 1
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 16886677
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20489690
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 5776267
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20487109
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20254081
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 18038036
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20473354
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20172363
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720172363%27 HTTP/1.1" 200 None
2026-03-29 20:10:44 [motorway.uk] INFO: Scrape type for 20172363: 1
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20323228
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20486197
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 16378604
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20456017
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720456017%27 HTTP/1.1" 200 None
2026-03-29 20:10:44 [motorway.uk] INFO: Scrape type for 20456017: 1
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 17631330
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 12503630
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 19805155
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20484488
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 19543159
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719543159%27 HTTP/1.1" 200 None
2026-03-29 20:10:44 [motorway.uk] INFO: Scrape type for 19543159: 1
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 11178434
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711178434%27 HTTP/1.1" 200 None
2026-03-29 20:10:44 [motorway.uk] INFO: Scrape type for 11178434: 1
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20434695
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20490377
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20488936
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20484850
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 19905225
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 18671000
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 15950437
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 12936291
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 19919784
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20285746
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 20473072
2026-03-29 20:10:44 [motorway.uk] INFO: Found listing with ID: 19988748
2026-03-29 20:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8810/20388810/exterior_rear_driver-1774782429109.jpg> (referer: None)
2026-03-29 20:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_front_driver-1774696082768.jpg> (referer: None)
2026-03-29 20:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_rear_driver-1774696135603.jpg> (referer: None)
2026-03-29 20:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8810/20388810/exterior_front_driver-1774782439411.jpg> (referer: None)
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0afc50>
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8810%252F20388810%252Fexterior_rear_driver-1774782429109.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8810/20388810/exterior_rear_driver-1774782429109.jpg saved to cache
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 145d9490-e6c8-55eb-af14-58fe94bae51b
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db4a9d0>
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3792%252F3263792%252Fexterior_front_driver-1774696082768.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_front_driver-1774696082768.jpg saved to cache
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 109fe503-0a63-54e6-afcc-d130318c1bde
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd3edd0>
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3792%252F3263792%252Fexterior_rear_driver-1774696135603.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_rear_driver-1774696135603.jpg saved to cache
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 109fe503-0a63-54e6-afcc-d130318c1bde
2026-03-29 20:10:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 109fe503-0a63-54e6-afcc-d130318c1bde, skipping ID generation
2026-03-29 20:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 109fe503-0a63-54e6-afcc-d130318c1bde with scrape type 1
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 109fe503-0a63-54e6-afcc-d130318c1bde sending to next pipeline
2026-03-29 20:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 109fe503-0a63-54e6-afcc-d130318c1bde, identifier: 3263792
2026-03-29 20:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd4ba90>
2026-03-29 20:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8810%252F20388810%252Fexterior_front_driver-1774782439411.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8810/20388810/exterior_front_driver-1774782439411.jpg saved to cache
2026-03-29 20:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 145d9490-e6c8-55eb-af14-58fe94bae51b
2026-03-29 20:10:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 145d9490-e6c8-55eb-af14-58fe94bae51b, skipping ID generation
2026-03-29 20:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 145d9490-e6c8-55eb-af14-58fe94bae51b with scrape type 1
2026-03-29 20:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 145d9490-e6c8-55eb-af14-58fe94bae51b sending to next pipeline
2026-03-29 20:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 145d9490-e6c8-55eb-af14-58fe94bae51b, identifier: 20388810
2026-03-29 20:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 109fe503-0a63-54e6-afcc-d130318c1bde with identifier: 3263792
2026-03-29 20:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:10:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Orange HTTP/1.1" 200 None
2026-03-29 20:10:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 109fe503-0a63-54e6-afcc-d130318c1bde with identifier: 3263792
2026-03-29 20:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 109fe503-0a63-54e6-afcc-d130318c1bde with identifier: 3263792 to the API
2026-03-29 20:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_rear_driver-1774696135603.jpg>
{'auction_title': '',
'category': None,
'color': 'Orange',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '109fe503-0a63-54e6-afcc-d130318c1bde',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF17 YMS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3263792',
'listing': 'auction',
'location': 'Northumberland Morpeth',
'make': 'Vauxhall',
'model': 'Mokka',
'odometer': 29000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 923672,
'Height': 1865,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_front_driver-1774696082768.jpg',
'Width': 2487},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482729,
'Height': 1517,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_rear_driver-1774696135603.jpg',
'Width': 2023},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 892886,
'Height': 1861,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_front_passenger-1774696101447.jpg',
'Width': 2481},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570379,
'Height': 1593,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3792/3263792/exterior_rear_passenger-1774696122492.jpg',
'Width': 2124},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1019764,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/3792/3263792/interior_front_seats-1774696346722.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1002709,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/3792/3263792/interior_rear_seats-1774696233536.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2118058,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3792/3263792/interior_dashboard-1774696294274.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 932953,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3792/3263792/instrument_cluster-1774696340876.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2510854,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/3792/3263792/interior_boot-1774696314655.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109fe503-0a63-54e6-afcc-d130318c1bde/109fe503-0a63-54e6-afcc-d130318c1bde_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657109,
'Height': 3967,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3792/3263792/3263792-docs_service_history-default-1774778029429.jpg?ixlib=js-3.8.0&auto=format&s=3ee230e54a67aa8de3f5c5cb9cd5a0f6',
'Width': 2232}],
'price': 9701,
'price_includes_vat': False,
'registration_date': '2017-05-11',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Mokka X Elite NAV Turbo Auto',
'transmission': 'automatic',
'trim': 'X Elite NAV Turbo Auto',
'vin': 'W0LJD7E89HB162806',
'year': 2017}
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273263792%27 HTTP/1.1" 200 None
2026-03-29 20:10:46 [motorway.uk] INFO: Saving data for 3263792: {'created_time': 1774815046.488068, 'last_price_update_time': 1774815046.488079, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3263792') HTTP/1.1" 204 0
2026-03-29 20:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 145d9490-e6c8-55eb-af14-58fe94bae51b with identifier: 20388810
2026-03-29 20:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 145d9490-e6c8-55eb-af14-58fe94bae51b with identifier: 20388810
2026-03-29 20:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 145d9490-e6c8-55eb-af14-58fe94bae51b with identifier: 20388810 to the API
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/8810/20388810/exterior_front_driver-1774782439411.jpg>
{'auction_title': '',
'category': None,
'color': 'Orange',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '145d9490-e6c8-55eb-af14-58fe94bae51b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MW23 UBR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20388810',
'listing': 'auction',
'location': 'Falkirk Denny',
'make': 'Kia',
'model': 'ProCeed',
'odometer': 23805,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2633271,
'Height': 2631,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8810/20388810/exterior_front_driver-1774782439411.jpg',
'Width': 3508},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2479519,
'Height': 2580,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8810/20388810/exterior_rear_driver-1774782429109.jpg',
'Width': 3440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1669375,
'Height': 2601,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8810/20388810/exterior_front_passenger-1774717139228.jpg',
'Width': 3468},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2712082,
'Height': 2878,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8810/20388810/exterior_rear_passenger-1774782409493.jpg',
'Width': 3837},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4105163,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8810/20388810/interior_front_seats-1774717308572.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4250490,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8810/20388810/interior_rear_seats-1774717316913.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2688309,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8810/20388810/interior_dashboard-1774782393073.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2577856,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8810/20388810/instrument_cluster-1774717418834.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3424804,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8810/20388810/interior_boot-1774717335020.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_145d9490-e6c8-55eb-af14-58fe94bae51b/145d9490-e6c8-55eb-af14-58fe94bae51b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407291,
'Height': 1920,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8810/20388810/docs_service_history-1774717461530.jpg?ixlib=js-3.8.0&auto=format&s=41eeae3179e2b19670ef3f4f5dbb8aea',
'Width': 2975}],
'price': 15575,
'price_includes_vat': False,
'registration_date': '2023-05-22',
'seats_number': None,
'seller_name': None,
'title': 'Kia Proceed GT-LINE ISG',
'transmission': 'manual',
'trim': 'Proceed GT-LINE ISG',
'vin': 'U5YH2G15LPL068386',
'year': 2023}
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720388810%27 HTTP/1.1" 200 None
2026-03-29 20:10:46 [motorway.uk] INFO: Saving data for 20388810: {'created_time': 1774815046.944653, 'last_price_update_time': 1774815046.944664, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20388810') HTTP/1.1" 204 0
2026-03-29 20:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20365288.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3189/15733189/interior_front_seats-1774715380933.jpg> (referer: None)
2026-03-29 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3189/15733189/interior_rear_seats-1774715279627.jpg> (referer: None)
2026-03-29 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0827/18670827/interior_front_seats-1774777745728.jpg> (referer: None)
2026-03-29 20:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc755122-c837-505d-8152-a768c0f41ca2 with identifier: 20365288
2026-03-29 20:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc755122-c837-505d-8152-a768c0f41ca2 with scrape type 1
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc755122-c837-505d-8152-a768c0f41ca2
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5288%252F20365288%252Fexterior_front_driver-1774268004183.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5288/20365288/exterior_front_driver-1774268004183.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5288%252F20365288%252Fexterior_rear_driver-1774267999285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5288/20365288/exterior_rear_driver-1774267999285.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5288%252F20365288%252Fexterior_front_passenger-1774267992508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5288/20365288/exterior_front_passenger-1774267992508.jpg not downloaded yet
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8a8250>
2026-03-29 20:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3189%252F15733189%252Finterior_front_seats-1774715380933.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3189/15733189/interior_front_seats-1774715380933.jpg saved to cache
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3509e2de-99d6-5cef-aab3-282e8c3f954a
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1ceb90>
2026-03-29 20:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3189%252F15733189%252Finterior_rear_seats-1774715279627.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3189/15733189/interior_rear_seats-1774715279627.jpg saved to cache
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3509e2de-99d6-5cef-aab3-282e8c3f954a
2026-03-29 20:10:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3509e2de-99d6-5cef-aab3-282e8c3f954a, skipping ID generation
2026-03-29 20:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3509e2de-99d6-5cef-aab3-282e8c3f954a with scrape type 1
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3509e2de-99d6-5cef-aab3-282e8c3f954a sending to next pipeline
2026-03-29 20:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3509e2de-99d6-5cef-aab3-282e8c3f954a, identifier: 15733189
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d98e550>
2026-03-29 20:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6b5004-3705-5814-9427-5686c3448766/ad6b5004-3705-5814-9427-5686c3448766_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0827%252F18670827%252Finterior_front_seats-1774777745728.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0827/18670827/interior_front_seats-1774777745728.jpg saved to cache
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad6b5004-3705-5814-9427-5686c3448766
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5288%252F20365288%252Fexterior_rear_passenger-1774267986965.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5288/20365288/exterior_rear_passenger-1774267986965.jpg not downloaded yet
2026-03-29 20:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3509e2de-99d6-5cef-aab3-282e8c3f954a with identifier: 15733189
2026-03-29 20:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3509e2de-99d6-5cef-aab3-282e8c3f954a with identifier: 15733189
2026-03-29 20:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3509e2de-99d6-5cef-aab3-282e8c3f954a with identifier: 15733189 to the API
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3189/15733189/interior_rear_seats-1774715279627.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '3509e2de-99d6-5cef-aab3-282e8c3f954a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MC19 LKJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15733189',
'listing': 'auction',
'location': 'Staffordshire Stafford',
'make': 'BMW',
'model': '3 Series',
'odometer': 60600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673178,
'Height': 1584,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_front_driver-1774714867869.jpg',
'Width': 2112},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1117173,
'Height': 2068,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_rear_driver-1774714879785.jpg',
'Width': 2757},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1050425,
'Height': 1898,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_front_passenger-1774714892155.jpg',
'Width': 2530},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720823,
'Height': 1620,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3189/15733189/exterior_rear_passenger-1774714883257.jpg',
'Width': 2160},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3113777,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3189/15733189/interior_front_seats-1774715380933.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3245159,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3189/15733189/interior_rear_seats-1774715279627.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1841657,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3189/15733189/interior_dashboard-1774715410139.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1481838,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3189/15733189/instrument_cluster-1774715388107.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5145279,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3189/15733189/interior_boot-1774715345189.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3509e2de-99d6-5cef-aab3-282e8c3f954a/3509e2de-99d6-5cef-aab3-282e8c3f954a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3001601,
'Height': 1291,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3189/15733189/docs_service_history-1774716498807.jpg?ixlib=js-3.8.0&auto=format&s=7212725ab9618e854c875b27d833196d',
'Width': 2925}],
'price': 15237,
'price_includes_vat': False,
'registration_date': '2019-05-28',
'seats_number': None,
'seller_name': None,
'title': 'BMW 320I M Sport',
'transmission': 'automatic',
'trim': '320I M Sport',
'vin': 'WBA5F72090AK39032',
'year': 2019}
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715733189%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [motorway.uk] INFO: Saving data for 15733189: {'created_time': 1774815048.547315, 'last_price_update_time': 1774815048.547327, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15733189') HTTP/1.1" 204 0
2026-03-29 20:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20493993.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5288%252F20365288%252Finterior_front_seats-1774268948940.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5288/20365288/interior_front_seats-1774268948940.jpg not downloaded yet
2026-03-29 20:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20385998.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20304692.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5288%252F20365288%252Finterior_rear_seats-1774268957259.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5288/20365288/interior_rear_seats-1774268957259.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5288%252F20365288%252Finterior_dashboard-1774268961420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5288/20365288/interior_dashboard-1774268961420.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5288%252F20365288%252Finstrument_cluster-1774268864740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5288/20365288/instrument_cluster-1774268864740.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5288%252F20365288%252Finterior_boot-1774268954881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5288/20365288/interior_boot-1774268954881.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5288%252F20365288%252Fdocs_service_history-1774269177708.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2a4800c951c6f8b3cb9518a09a4b9e0e%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5288/20365288/docs_service_history-1774269177708.jpg?ixlib=js-3.8.0&auto=format&s=2a4800c951c6f8b3cb9518a09a4b9e0e not downloaded yet
2026-03-29 20:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae439839-690d-549b-828f-04973605ecae with identifier: 20493993
2026-03-29 20:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae439839-690d-549b-828f-04973605ecae with scrape type 1
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae439839-690d-549b-828f-04973605ecae
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3993%252F20493993%252Fexterior_front_driver-1774773886643.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3993/20493993/exterior_front_driver-1774773886643.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3993%252F20493993%252Fexterior_rear_driver-1774773920890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3993/20493993/exterior_rear_driver-1774773920890.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3993%252F20493993%252Fexterior_front_passenger-1774773939250.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3993/20493993/exterior_front_passenger-1774773939250.jpg not downloaded yet
2026-03-29 20:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb01764f-293f-5b7d-99de-cae0bbe39ab4 with identifier: 20385998
2026-03-29 20:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb01764f-293f-5b7d-99de-cae0bbe39ab4 with scrape type 1
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb01764f-293f-5b7d-99de-cae0bbe39ab4
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5998%252F20385998%252Fexterior_front_driver-1774685187810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5998/20385998/exterior_front_driver-1774685187810.jpg not downloaded yet
2026-03-29 20:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 031c4a2e-4170-5253-a34b-08772621777e with identifier: 20304692
2026-03-29 20:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 031c4a2e-4170-5253-a34b-08772621777e with scrape type 1
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 031c4a2e-4170-5253-a34b-08772621777e
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4692%252F20304692%252Fexterior_front_driver-1774703021397.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4692/20304692/exterior_front_driver-1774703021397.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3993%252F20493993%252Fexterior_rear_passenger-1774773904899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3993/20493993/exterior_rear_passenger-1774773904899.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5998%252F20385998%252Fexterior_rear_driver-1774685198706.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5998/20385998/exterior_rear_driver-1774685198706.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4692%252F20304692%252Fexterior_rear_driver-1774703040204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4692/20304692/exterior_rear_driver-1774703040204.jpg not downloaded yet
2026-03-29 20:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20473693.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3993%252F20493993%252Finterior_front_seats-1774774437206.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3993/20493993/interior_front_seats-1774774437206.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5998%252F20385998%252Fexterior_front_passenger-1774685254209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5998/20385998/exterior_front_passenger-1774685254209.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4692%252F20304692%252Fexterior_front_passenger-1774703061523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4692/20304692/exterior_front_passenger-1774703061523.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3993%252F20493993%252Finterior_rear_seats-1774774454186.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3993/20493993/interior_rear_seats-1774774454186.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5998%252F20385998%252Fexterior_rear_passenger-1774685228586.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5998/20385998/exterior_rear_passenger-1774685228586.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4692%252F20304692%252Fexterior_rear_passenger-1774703051107.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4692/20304692/exterior_rear_passenger-1774703051107.jpg not downloaded yet
2026-03-29 20:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5288/20365288/exterior_front_driver-1774268004183.jpg> (referer: None)
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3993%252F20493993%252Finterior_dashboard-1774774864412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3993/20493993/interior_dashboard-1774774864412.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5998%252F20385998%252Finterior_front_seats-1774685803815.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5998/20385998/interior_front_seats-1774685803815.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4692%252F20304692%252Finterior_front_seats-1774703455418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4692/20304692/interior_front_seats-1774703455418.jpg not downloaded yet
2026-03-29 20:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22dfed24-39b7-5fad-91f0-ac37609cf2d5 with identifier: 20473693
2026-03-29 20:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22dfed24-39b7-5fad-91f0-ac37609cf2d5 with scrape type 1
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22dfed24-39b7-5fad-91f0-ac37609cf2d5
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3693%252F20473693%252Fexterior_front_driver-1774698066996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3693/20473693/exterior_front_driver-1774698066996.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3993%252F20493993%252Finterior_boot-1774775304432.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3993/20493993/interior_boot-1774775304432.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5998%252F20385998%252Finterior_rear_seats-1774685835264.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5998/20385998/interior_rear_seats-1774685835264.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4692%252F20304692%252Finterior_rear_seats-1774703579134.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4692/20304692/interior_rear_seats-1774703579134.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3693%252F20473693%252Fexterior_rear_driver-1774693106015.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3693/20473693/exterior_rear_driver-1774693106015.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3993%252F20493993%252Fdocs_service_history-1774774658498.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D317a76a5f637f979adea629af144fb4e%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3993/20493993/docs_service_history-1774774658498.jpg?ixlib=js-3.8.0&auto=format&s=317a76a5f637f979adea629af144fb4e not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5998%252F20385998%252Finterior_dashboard-1774685875859.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5998/20385998/interior_dashboard-1774685875859.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4692%252F20304692%252Finterior_dashboard-1774703660077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4692/20304692/interior_dashboard-1774703660077.jpg not downloaded yet
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d481f90>
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc755122-c837-505d-8152-a768c0f41ca2/cc755122-c837-505d-8152-a768c0f41ca2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5288%252F20365288%252Fexterior_front_driver-1774268004183.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5288/20365288/exterior_front_driver-1774268004183.jpg saved to cache
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc755122-c837-505d-8152-a768c0f41ca2
2026-03-29 20:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5288/20365288/exterior_rear_passenger-1774267986965.jpg> (referer: None)
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3693%252F20473693%252Fexterior_front_passenger-1774693099410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3693/20473693/exterior_front_passenger-1774693099410.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3993%252F20493993%252Fdocs_service_history-1774774693551.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D42d259fec08ec64e1198d3fbcbc41030%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3993/20493993/docs_service_history-1774774693551.jpg?ixlib=js-3.8.0&auto=format&s=42d259fec08ec64e1198d3fbcbc41030 not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5998%252F20385998%252Finstrument_cluster-1774685891319.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5998/20385998/instrument_cluster-1774685891319.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4692%252F20304692%252Finstrument_cluster-1774703548694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4692/20304692/instrument_cluster-1774703548694.jpg not downloaded yet
2026-03-29 20:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5288/20365288/exterior_rear_driver-1774267999285.jpg> (referer: None)
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3693%252F20473693%252Fexterior_rear_passenger-1774693095144.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3693/20473693/exterior_rear_passenger-1774693095144.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5998%252F20385998%252Finterior_boot-1774685895875.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5998/20385998/interior_boot-1774685895875.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4692%252F20304692%252Finterior_boot-1774703672043.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4692/20304692/interior_boot-1774703672043.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3693%252F20473693%252Finterior_front_seats-1774694336277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3693/20473693/interior_front_seats-1774694336277.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5998%252F20385998%252Fdocs_service_history-1774686193588.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D69ace1058e52e0fd14bd2cb1283d0a31%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5998/20385998/docs_service_history-1774686193588.jpg?ixlib=js-3.8.0&auto=format&s=69ace1058e52e0fd14bd2cb1283d0a31 not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4692%252F20304692%252Fdocs_service_history-1774704499888.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8c7bf7bf99d8ebde9fb58de8471f6853%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4692/20304692/docs_service_history-1774704499888.jpg?ixlib=js-3.8.0&auto=format&s=8c7bf7bf99d8ebde9fb58de8471f6853 not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3693%252F20473693%252Finterior_rear_seats-1774694394237.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3693/20473693/interior_rear_seats-1774694394237.jpg not downloaded yet
2026-03-29 20:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5288/20365288/exterior_front_passenger-1774267992508.jpg> (referer: None)
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3693%252F20473693%252Finterior_dashboard-1774694350455.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3693/20473693/interior_dashboard-1774694350455.jpg not downloaded yet
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d039610>
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc755122-c837-505d-8152-a768c0f41ca2/cc755122-c837-505d-8152-a768c0f41ca2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5288%252F20365288%252Fexterior_rear_passenger-1774267986965.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5288/20365288/exterior_rear_passenger-1774267986965.jpg saved to cache
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc755122-c837-505d-8152-a768c0f41ca2
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1c3790>
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc755122-c837-505d-8152-a768c0f41ca2/cc755122-c837-505d-8152-a768c0f41ca2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5288%252F20365288%252Fexterior_rear_driver-1774267999285.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5288/20365288/exterior_rear_driver-1774267999285.jpg saved to cache
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc755122-c837-505d-8152-a768c0f41ca2
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3693%252F20473693%252Finterior_boot-1774694337931.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3693/20473693/interior_boot-1774694337931.jpg not downloaded yet
2026-03-29 20:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9990352.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1c1790>
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc755122-c837-505d-8152-a768c0f41ca2/cc755122-c837-505d-8152-a768c0f41ca2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5288%252F20365288%252Fexterior_front_passenger-1774267992508.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5288/20365288/exterior_front_passenger-1774267992508.jpg saved to cache
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc755122-c837-505d-8152-a768c0f41ca2
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3693%252F20473693%252Fdocs_service_history-1774694711756.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D975c44c238df2a088ef0abe9174ad7a6%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3693/20473693/docs_service_history-1774694711756.jpg?ixlib=js-3.8.0&auto=format&s=975c44c238df2a088ef0abe9174ad7a6 not downloaded yet
2026-03-29 20:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1080&page=30&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3693%252F20473693%252Fdamage_scratches-1774693369865.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3693/20473693/damage_scratches-1774693369865.jpg not downloaded yet
2026-03-29 20:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86e65671-ceba-58c8-abbf-5ec91843ad59 with identifier: 9990352
2026-03-29 20:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86e65671-ceba-58c8-abbf-5ec91843ad59 with scrape type 1
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86e65671-ceba-58c8-abbf-5ec91843ad59
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0352%252F9990352%252Fexterior_front_driver-1774377547804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0352/9990352/exterior_front_driver-1774377547804.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0352%252F9990352%252Fexterior_rear_driver-1774377560601.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0352/9990352/exterior_rear_driver-1774377560601.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0352%252F9990352%252Fexterior_front_passenger-1774377552488.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0352/9990352/exterior_front_passenger-1774377552488.jpg not downloaded yet
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20500109
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20492540
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720492540%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [motorway.uk] INFO: Scrape type for 20492540: 1
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0352%252F9990352%252Fexterior_rear_passenger-1774377551971.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0352/9990352/exterior_rear_passenger-1774377551971.jpg not downloaded yet
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 4255654
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20381378
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 19391206
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719391206%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [motorway.uk] INFO: Scrape type for 19391206: 1
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0352%252F9990352%252Finterior_front_seats-1774378283109.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0352/9990352/interior_front_seats-1774378283109.jpg not downloaded yet
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 12889821
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 2216003
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20466618
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20454779
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20175346
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20488633
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20418638
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20394387
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20484190
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20488957
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20381560
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20490401
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490401%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [motorway.uk] INFO: Scrape type for 20490401: 1
2026-03-29 20:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3693/20473693/exterior_front_passenger-1774693099410.jpg> (referer: None)
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0352%252F9990352%252Finterior_rear_seats-1774378284561.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0352/9990352/interior_rear_seats-1774378284561.jpg not downloaded yet
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 19925842
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20301602
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720301602%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [motorway.uk] INFO: Scrape type for 20301602: 1
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0352%252F9990352%252Finterior_dashboard-1774378317289.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0352/9990352/interior_dashboard-1774378317289.jpg not downloaded yet
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20482735
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720482735%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [motorway.uk] INFO: Scrape type for 20482735: 1
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0352%252F9990352%252Finstrument_cluster-1774378414215.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0352/9990352/instrument_cluster-1774378414215.jpg not downloaded yet
2026-03-29 20:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4692/20304692/exterior_front_driver-1774703021397.jpg> (referer: None)
2026-03-29 20:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4692/20304692/exterior_rear_passenger-1774703051107.jpg> (referer: None)
2026-03-29 20:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4692/20304692/interior_dashboard-1774703660077.jpg> (referer: None)
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20445456
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 17007661
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 16212102
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716212102%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [motorway.uk] INFO: Scrape type for 16212102: 1
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0352%252F9990352%252Finterior_boot-1774382457057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0352/9990352/interior_boot-1774382457057.jpg not downloaded yet
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 3155170
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20438840
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20141953
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 18015367
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 3408584
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20257689
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720257689%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [motorway.uk] INFO: Scrape type for 20257689: 1
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0352%252F9990352%252Fdocs_service_history-1774382368414.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7282e5a1b4beb6d29f3c7d7da224d05e%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0352/9990352/docs_service_history-1774382368414.jpg?ixlib=js-3.8.0&auto=format&s=7282e5a1b4beb6d29f3c7d7da224d05e not downloaded yet
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20465447
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720465447%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [motorway.uk] INFO: Scrape type for 20465447: 1
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d203a50>
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22dfed24-39b7-5fad-91f0-ac37609cf2d5/22dfed24-39b7-5fad-91f0-ac37609cf2d5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3693%252F20473693%252Fexterior_front_passenger-1774693099410.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3693/20473693/exterior_front_passenger-1774693099410.jpg saved to cache
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22dfed24-39b7-5fad-91f0-ac37609cf2d5
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20172367
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 19146005
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 10030504
2026-03-29 20:10:50 [motorway.uk] INFO: Found listing with ID: 20428748
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720428748%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [motorway.uk] INFO: Scrape type for 20428748: 1
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d66a7d0>
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_031c4a2e-4170-5253-a34b-08772621777e/031c4a2e-4170-5253-a34b-08772621777e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4692%252F20304692%252Fexterior_front_driver-1774703021397.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4692/20304692/exterior_front_driver-1774703021397.jpg saved to cache
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 031c4a2e-4170-5253-a34b-08772621777e
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d233f50>
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_031c4a2e-4170-5253-a34b-08772621777e/031c4a2e-4170-5253-a34b-08772621777e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4692%252F20304692%252Fexterior_rear_passenger-1774703051107.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4692/20304692/exterior_rear_passenger-1774703051107.jpg saved to cache
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 031c4a2e-4170-5253-a34b-08772621777e
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd650d0>
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_031c4a2e-4170-5253-a34b-08772621777e/031c4a2e-4170-5253-a34b-08772621777e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4692%252F20304692%252Finterior_dashboard-1774703660077.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4692/20304692/interior_dashboard-1774703660077.jpg saved to cache
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 031c4a2e-4170-5253-a34b-08772621777e
2026-03-29 20:10:51 [motorway.uk] INFO: Found listing with ID: 20494737
2026-03-29 20:10:51 [motorway.uk] INFO: Found listing with ID: 20445682
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3693/20473693/docs_service_history-1774694711756.jpg?ixlib=js-3.8.0&auto=format&s=975c44c238df2a088ef0abe9174ad7a6> (referer: None)
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3693/20473693/interior_rear_seats-1774694394237.jpg> (referer: None)
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8e7a90>
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22dfed24-39b7-5fad-91f0-ac37609cf2d5/22dfed24-39b7-5fad-91f0-ac37609cf2d5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3693%252F20473693%252Fdocs_service_history-1774694711756.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D975c44c238df2a088ef0abe9174ad7a6') HTTP/1.1" 204 0
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3693/20473693/docs_service_history-1774694711756.jpg?ixlib=js-3.8.0&auto=format&s=975c44c238df2a088ef0abe9174ad7a6 saved to cache
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22dfed24-39b7-5fad-91f0-ac37609cf2d5
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c76a9d0>
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22dfed24-39b7-5fad-91f0-ac37609cf2d5/22dfed24-39b7-5fad-91f0-ac37609cf2d5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3693%252F20473693%252Finterior_rear_seats-1774694394237.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3693/20473693/interior_rear_seats-1774694394237.jpg saved to cache
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22dfed24-39b7-5fad-91f0-ac37609cf2d5
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17667845.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0352/9990352/docs_service_history-1774382368414.jpg?ixlib=js-3.8.0&auto=format&s=7282e5a1b4beb6d29f3c7d7da224d05e> (referer: None)
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3693/20473693/interior_dashboard-1774694350455.jpg> (referer: None)
2026-03-29 20:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 030e60cb-3b03-5f48-8c49-7349d9a3fe94 with identifier: 17667845
2026-03-29 20:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 030e60cb-3b03-5f48-8c49-7349d9a3fe94 with scrape type 1
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 030e60cb-3b03-5f48-8c49-7349d9a3fe94
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7845%252F17667845%252Fexterior_front_driver-1773833372626.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7845/17667845/exterior_front_driver-1773833372626.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7845%252F17667845%252Fexterior_rear_driver-1773833394595.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7845/17667845/exterior_rear_driver-1773833394595.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7845%252F17667845%252Fexterior_front_passenger-1773833436586.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7845/17667845/exterior_front_passenger-1773833436586.jpg not downloaded yet
2026-03-29 20:10:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c646290>
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e65671-ceba-58c8-abbf-5ec91843ad59/86e65671-ceba-58c8-abbf-5ec91843ad59_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0352%252F9990352%252Fdocs_service_history-1774382368414.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7282e5a1b4beb6d29f3c7d7da224d05e') HTTP/1.1" 204 0
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0352/9990352/docs_service_history-1774382368414.jpg?ixlib=js-3.8.0&auto=format&s=7282e5a1b4beb6d29f3c7d7da224d05e saved to cache
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86e65671-ceba-58c8-abbf-5ec91843ad59
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8b2110>
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22dfed24-39b7-5fad-91f0-ac37609cf2d5/22dfed24-39b7-5fad-91f0-ac37609cf2d5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3693%252F20473693%252Finterior_dashboard-1774694350455.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3693/20473693/interior_dashboard-1774694350455.jpg saved to cache
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22dfed24-39b7-5fad-91f0-ac37609cf2d5
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7845%252F17667845%252Fexterior_rear_passenger-1773833416112.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7845/17667845/exterior_rear_passenger-1773833416112.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7845%252F17667845%252Finterior_front_seats-1774517009410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7845/17667845/interior_front_seats-1774517009410.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7845%252F17667845%252Finterior_rear_seats-1774516971609.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7845/17667845/interior_rear_seats-1774516971609.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7845%252F17667845%252Finterior_dashboard-1774517008915.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7845/17667845/interior_dashboard-1774517008915.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7845%252F17667845%252Finstrument_cluster-1774517041423.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7845/17667845/instrument_cluster-1774517041423.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7845%252F17667845%252Finterior_boot-1774517007470.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7845/17667845/interior_boot-1774517007470.jpg not downloaded yet
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11178434.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7845%252F17667845%252Fdocs_service_history-1774517314976.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D34cf2b68e3fc6a10d6c9a4e7fe1c97d6%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7845/17667845/docs_service_history-1774517314976.jpg?ixlib=js-3.8.0&auto=format&s=34cf2b68e3fc6a10d6c9a4e7fe1c97d6 not downloaded yet
2026-03-29 20:10:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0352/9990352/instrument_cluster-1774378414215.jpg> (referer: None)
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0352/9990352/interior_boot-1774382457057.jpg> (referer: None)
2026-03-29 20:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19543159.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c89b953-3e40-578e-aed6-c9df6407b948 with identifier: 11178434
2026-03-29 20:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c89b953-3e40-578e-aed6-c9df6407b948 with scrape type 1
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c89b953-3e40-578e-aed6-c9df6407b948
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8434%252F11178434%252Fexterior_front_driver-1774776909211.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8434/11178434/exterior_front_driver-1774776909211.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8434%252F11178434%252Fexterior_rear_driver-1774776982570.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8434/11178434/exterior_rear_driver-1774776982570.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8434%252F11178434%252Fexterior_front_passenger-1774776926348.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8434/11178434/exterior_front_passenger-1774776926348.jpg not downloaded yet
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4acb50>
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e65671-ceba-58c8-abbf-5ec91843ad59/86e65671-ceba-58c8-abbf-5ec91843ad59_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0352%252F9990352%252Finstrument_cluster-1774378414215.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0352/9990352/instrument_cluster-1774378414215.jpg saved to cache
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86e65671-ceba-58c8-abbf-5ec91843ad59
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8434%252F11178434%252Fexterior_rear_passenger-1774776953403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8434/11178434/exterior_rear_passenger-1774776953403.jpg not downloaded yet
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d47b0d0>
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e65671-ceba-58c8-abbf-5ec91843ad59/86e65671-ceba-58c8-abbf-5ec91843ad59_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0352%252F9990352%252Finterior_boot-1774382457057.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0352/9990352/interior_boot-1774382457057.jpg saved to cache
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86e65671-ceba-58c8-abbf-5ec91843ad59
2026-03-29 20:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20456017.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8434%252F11178434%252Finterior_front_seats-1774777003739.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8434/11178434/interior_front_seats-1774777003739.jpg not downloaded yet
2026-03-29 20:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40b0ea32-4fba-5fd6-a636-6dd16f0287fa with identifier: 19543159
2026-03-29 20:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40b0ea32-4fba-5fd6-a636-6dd16f0287fa with scrape type 1
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40b0ea32-4fba-5fd6-a636-6dd16f0287fa
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3159%252F19543159%252Fexterior_front_driver-1774607173481.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3159/19543159/exterior_front_driver-1774607173481.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8434%252F11178434%252Finterior_rear_seats-1774777084861.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8434/11178434/interior_rear_seats-1774777084861.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3159%252F19543159%252Fexterior_rear_driver-1774607179648.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3159/19543159/exterior_rear_driver-1774607179648.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8434%252F11178434%252Finterior_dashboard-1774777124209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8434/11178434/interior_dashboard-1774777124209.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3159%252F19543159%252Fexterior_front_passenger-1774607177403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3159/19543159/exterior_front_passenger-1774607177403.jpg not downloaded yet
2026-03-29 20:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7845/17667845/docs_service_history-1774517314976.jpg?ixlib=js-3.8.0&auto=format&s=34cf2b68e3fc6a10d6c9a4e7fe1c97d6> (referer: None)
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8434%252F11178434%252Finstrument_cluster-1774777181016.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8434/11178434/instrument_cluster-1774777181016.jpg not downloaded yet
2026-03-29 20:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c244f7b2-a6a9-5e44-8d29-af15e570473e with identifier: 20456017
2026-03-29 20:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c244f7b2-a6a9-5e44-8d29-af15e570473e with scrape type 1
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c244f7b2-a6a9-5e44-8d29-af15e570473e
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6017%252F20456017%252Fexterior_front_driver-1774536792937.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6017/20456017/exterior_front_driver-1774536792937.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3159%252F19543159%252Fexterior_rear_passenger-1774607182221.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3159/19543159/exterior_rear_passenger-1774607182221.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8434%252F11178434%252Finterior_boot-1774777140985.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8434/11178434/interior_boot-1774777140985.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6017%252F20456017%252Fexterior_rear_driver-1774536743041.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6017/20456017/exterior_rear_driver-1774536743041.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3159%252F19543159%252Finterior_front_seats-1774607769622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3159/19543159/interior_front_seats-1774607769622.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8434%252F11178434%252Fdocs_service_history-1774778046975.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1f9c5a683845881846b195eac5a55a8c%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8434/11178434/docs_service_history-1774778046975.jpg?ixlib=js-3.8.0&auto=format&s=1f9c5a683845881846b195eac5a55a8c not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6017%252F20456017%252Fexterior_front_passenger-1774536782009.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6017/20456017/exterior_front_passenger-1774536782009.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3159%252F19543159%252Finterior_rear_seats-1774607764545.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3159/19543159/interior_rear_seats-1774607764545.jpg not downloaded yet
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c647550>
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030e60cb-3b03-5f48-8c49-7349d9a3fe94/030e60cb-3b03-5f48-8c49-7349d9a3fe94_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7845%252F17667845%252Fdocs_service_history-1774517314976.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D34cf2b68e3fc6a10d6c9a4e7fe1c97d6') HTTP/1.1" 204 0
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7845/17667845/docs_service_history-1774517314976.jpg?ixlib=js-3.8.0&auto=format&s=34cf2b68e3fc6a10d6c9a4e7fe1c97d6 saved to cache
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 030e60cb-3b03-5f48-8c49-7349d9a3fe94
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6017%252F20456017%252Fexterior_rear_passenger-1774536765411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6017/20456017/exterior_rear_passenger-1774536765411.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3159%252F19543159%252Finterior_dashboard-1774607776968.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3159/19543159/interior_dashboard-1774607776968.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6017%252F20456017%252Finterior_front_seats-1774537519207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6017/20456017/interior_front_seats-1774537519207.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3159%252F19543159%252Finstrument_cluster-1774607934533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3159/19543159/instrument_cluster-1774607934533.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6017%252F20456017%252Finterior_rear_seats-1774537680436.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6017/20456017/interior_rear_seats-1774537680436.jpg not downloaded yet
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3159%252F19543159%252Finterior_boot-1774607767838.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3159/19543159/interior_boot-1774607767838.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6017%252F20456017%252Finterior_dashboard-1774537598050.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6017/20456017/interior_dashboard-1774537598050.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3159%252F19543159%252Fdocs_service_history-1774608063120.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D066ba7bab884e0f500db89ca9174b071%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3159/19543159/docs_service_history-1774608063120.jpg?ixlib=js-3.8.0&auto=format&s=066ba7bab884e0f500db89ca9174b071 not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6017%252F20456017%252Finstrument_cluster-1774537598032.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6017/20456017/instrument_cluster-1774537598032.jpg not downloaded yet
2026-03-29 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8434/11178434/exterior_rear_passenger-1774776953403.jpg> (referer: None)
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6017%252F20456017%252Finterior_boot-1774537629238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6017/20456017/interior_boot-1774537629238.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6017%252F20456017%252Fdocs_service_history-1774700792687.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De868eddc5d9f12039c8409d5cf4f5e00%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6017/20456017/docs_service_history-1774700792687.jpg?ixlib=js-3.8.0&auto=format&s=e868eddc5d9f12039c8409d5cf4f5e00 not downloaded yet
2026-03-29 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8434/11178434/interior_dashboard-1774777124209.jpg> (referer: None)
2026-03-29 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7845/17667845/instrument_cluster-1774517041423.jpg> (referer: None)
2026-03-29 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7845/17667845/interior_dashboard-1774517008915.jpg> (referer: None)
2026-03-29 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7845/17667845/interior_boot-1774517007470.jpg> (referer: None)
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f68a990>
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c89b953-3e40-578e-aed6-c9df6407b948/8c89b953-3e40-578e-aed6-c9df6407b948_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8434%252F11178434%252Fexterior_rear_passenger-1774776953403.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8434/11178434/exterior_rear_passenger-1774776953403.jpg saved to cache
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c89b953-3e40-578e-aed6-c9df6407b948
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3e8910>
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c89b953-3e40-578e-aed6-c9df6407b948/8c89b953-3e40-578e-aed6-c9df6407b948_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8434%252F11178434%252Finterior_dashboard-1774777124209.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8434/11178434/interior_dashboard-1774777124209.jpg saved to cache
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c89b953-3e40-578e-aed6-c9df6407b948
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5991d0>
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030e60cb-3b03-5f48-8c49-7349d9a3fe94/030e60cb-3b03-5f48-8c49-7349d9a3fe94_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7845%252F17667845%252Finstrument_cluster-1774517041423.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7845/17667845/instrument_cluster-1774517041423.jpg saved to cache
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 030e60cb-3b03-5f48-8c49-7349d9a3fe94
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce33190>
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030e60cb-3b03-5f48-8c49-7349d9a3fe94/030e60cb-3b03-5f48-8c49-7349d9a3fe94_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7845%252F17667845%252Finterior_dashboard-1774517008915.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7845/17667845/interior_dashboard-1774517008915.jpg saved to cache
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 030e60cb-3b03-5f48-8c49-7349d9a3fe94
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce33a90>
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030e60cb-3b03-5f48-8c49-7349d9a3fe94/030e60cb-3b03-5f48-8c49-7349d9a3fe94_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7845%252F17667845%252Finterior_boot-1774517007470.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7845/17667845/interior_boot-1774517007470.jpg saved to cache
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 030e60cb-3b03-5f48-8c49-7349d9a3fe94
2026-03-29 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6017/20456017/docs_service_history-1774700792687.jpg?ixlib=js-3.8.0&auto=format&s=e868eddc5d9f12039c8409d5cf4f5e00> (referer: None)
2026-03-29 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3159/19543159/docs_service_history-1774608063120.jpg?ixlib=js-3.8.0&auto=format&s=066ba7bab884e0f500db89ca9174b071> (referer: None)
2026-03-29 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6017/20456017/interior_boot-1774537629238.jpg> (referer: None)
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de29d10>
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c244f7b2-a6a9-5e44-8d29-af15e570473e/c244f7b2-a6a9-5e44-8d29-af15e570473e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6017%252F20456017%252Fdocs_service_history-1774700792687.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De868eddc5d9f12039c8409d5cf4f5e00') HTTP/1.1" 204 0
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6017/20456017/docs_service_history-1774700792687.jpg?ixlib=js-3.8.0&auto=format&s=e868eddc5d9f12039c8409d5cf4f5e00 saved to cache
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c244f7b2-a6a9-5e44-8d29-af15e570473e
2026-03-29 20:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20365167.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d476250>
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b0ea32-4fba-5fd6-a636-6dd16f0287fa/40b0ea32-4fba-5fd6-a636-6dd16f0287fa_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3159%252F19543159%252Fdocs_service_history-1774608063120.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D066ba7bab884e0f500db89ca9174b071') HTTP/1.1" 204 0
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3159/19543159/docs_service_history-1774608063120.jpg?ixlib=js-3.8.0&auto=format&s=066ba7bab884e0f500db89ca9174b071 saved to cache
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40b0ea32-4fba-5fd6-a636-6dd16f0287fa
2026-03-29 20:10:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5bf150>
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c244f7b2-a6a9-5e44-8d29-af15e570473e/c244f7b2-a6a9-5e44-8d29-af15e570473e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6017%252F20456017%252Finterior_boot-1774537629238.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6017/20456017/interior_boot-1774537629238.jpg saved to cache
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c244f7b2-a6a9-5e44-8d29-af15e570473e
2026-03-29 20:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20172363.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1116&page=31&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bfb6965-8c67-5edc-8a39-19641176d740 with identifier: 20365167
2026-03-29 20:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bfb6965-8c67-5edc-8a39-19641176d740 with scrape type 1
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3bfb6965-8c67-5edc-8a39-19641176d740
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5167%252F20365167%252Fexterior_front_driver-1774701021805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5167/20365167/exterior_front_driver-1774701021805.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5167%252F20365167%252Fexterior_rear_driver-1774701021417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5167/20365167/exterior_rear_driver-1774701021417.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5167%252F20365167%252Fexterior_front_passenger-1774701027622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5167/20365167/exterior_front_passenger-1774701027622.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5167%252F20365167%252Fexterior_rear_passenger-1774701020390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5167/20365167/exterior_rear_passenger-1774701020390.jpg not downloaded yet
2026-03-29 20:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db7c31b-fc36-5c73-bd3c-84e714f03a1c with identifier: 20172363
2026-03-29 20:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db7c31b-fc36-5c73-bd3c-84e714f03a1c with scrape type 1
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3db7c31b-fc36-5c73-bd3c-84e714f03a1c
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2363%252F20172363%252Fexterior_front_driver-1774700437184.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2363/20172363/exterior_front_driver-1774700437184.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5167%252F20365167%252Finterior_front_seats-1774702043039.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5167/20365167/interior_front_seats-1774702043039.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2363%252F20172363%252Fexterior_rear_driver-1774700461674.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2363/20172363/exterior_rear_driver-1774700461674.jpg not downloaded yet
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20255071
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20418634
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720418634%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [motorway.uk] INFO: Scrape type for 20418634: 1
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5167%252F20365167%252Finterior_rear_seats-1774701942080.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5167/20365167/interior_rear_seats-1774701942080.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2363%252F20172363%252Fexterior_front_passenger-1774700486500.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2363/20172363/exterior_front_passenger-1774700486500.jpg not downloaded yet
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20499940
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20473047
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20441126
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20467526
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20285675
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720285675%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [motorway.uk] INFO: Scrape type for 20285675: 1
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5167%252F20365167%252Finterior_dashboard-1774701965178.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5167/20365167/interior_dashboard-1774701965178.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2363%252F20172363%252Fexterior_rear_passenger-1774700474779.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2363/20172363/exterior_rear_passenger-1774700474779.jpg not downloaded yet
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20295392
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 10200221
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710200221%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [motorway.uk] INFO: Scrape type for 10200221: 1
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5167%252F20365167%252Finterior_boot-1774701943930.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5167/20365167/interior_boot-1774701943930.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2363%252F20172363%252Finterior_front_seats-1774700955485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2363/20172363/interior_front_seats-1774700955485.jpg not downloaded yet
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 13316160
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20479742
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20477549
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720477549%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [motorway.uk] INFO: Scrape type for 20477549: 1
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5167%252F20365167%252Fdocs_service_history-1774702280804.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd1ab380485ff381fc2a013644a8218a2%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5167/20365167/docs_service_history-1774702280804.jpg?ixlib=js-3.8.0&auto=format&s=d1ab380485ff381fc2a013644a8218a2 not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2363%252F20172363%252Finterior_rear_seats-1774701003689.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2363/20172363/interior_rear_seats-1774701003689.jpg not downloaded yet
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 16662751
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 12330372
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712330372%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [motorway.uk] INFO: Scrape type for 12330372: 1
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5167%252F20365167%252Fdocs_service_history-1774702328833.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D39ff14721d7f7c5a238aeec09683b799%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5167/20365167/docs_service_history-1774702328833.jpg?ixlib=js-3.8.0&auto=format&s=39ff14721d7f7c5a238aeec09683b799 not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2363%252F20172363%252Finterior_dashboard-1774701031233.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2363/20172363/interior_dashboard-1774701031233.jpg not downloaded yet
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 19684886
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 17190543
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 14032750
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20240321
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20020846
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 14443515
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20470846
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720470846%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [motorway.uk] INFO: Scrape type for 20470846: 1
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2363%252F20172363%252Finstrument_cluster-1774701000213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2363/20172363/instrument_cluster-1774701000213.jpg not downloaded yet
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 17982437
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 20156998
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 18987203
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 5963462
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 17363006
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717363006%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [motorway.uk] INFO: Scrape type for 17363006: 1
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2363%252F20172363%252Finterior_boot-1774701070580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2363/20172363/interior_boot-1774701070580.jpg not downloaded yet
2026-03-29 20:10:54 [motorway.uk] INFO: Found listing with ID: 18720332
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718720332%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [motorway.uk] INFO: Scrape type for 18720332: 1
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2363%252F20172363%252Fdocs_service_history-1774702254405.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De256d2c8ae5680307465127d9d8f19d6%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2363/20172363/docs_service_history-1774702254405.jpg?ixlib=js-3.8.0&auto=format&s=e256d2c8ae5680307465127d9d8f19d6 not downloaded yet
2026-03-29 20:10:55 [motorway.uk] INFO: Found listing with ID: 20374415
2026-03-29 20:10:55 [motorway.uk] INFO: Found listing with ID: 20438823
2026-03-29 20:10:55 [motorway.uk] INFO: Found listing with ID: 20489356
2026-03-29 20:10:55 [motorway.uk] INFO: Found listing with ID: 17446143
2026-03-29 20:10:55 [motorway.uk] INFO: Found listing with ID: 18406701
2026-03-29 20:10:55 [motorway.uk] INFO: Found listing with ID: 20403434
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720403434%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [motorway.uk] INFO: Scrape type for 20403434: 1
2026-03-29 20:10:55 [motorway.uk] INFO: Found listing with ID: 19912396
2026-03-29 20:10:55 [motorway.uk] INFO: Found listing with ID: 5587668
2026-03-29 20:10:55 [motorway.uk] INFO: Found listing with ID: 20325290
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6017/20456017/exterior_rear_passenger-1774536765411.jpg> (referer: None)
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3159/19543159/interior_boot-1774607767838.jpg> (referer: None)
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6017/20456017/instrument_cluster-1774537598032.jpg> (referer: None)
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3159/19543159/instrument_cluster-1774607934533.jpg> (referer: None)
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6017/20456017/interior_rear_seats-1774537680436.jpg> (referer: None)
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6017/20456017/interior_dashboard-1774537598050.jpg> (referer: None)
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3159/19543159/interior_dashboard-1774607776968.jpg> (referer: None)
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6017/20456017/interior_front_seats-1774537519207.jpg> (referer: None)
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490401.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d926090>
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c244f7b2-a6a9-5e44-8d29-af15e570473e/c244f7b2-a6a9-5e44-8d29-af15e570473e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6017%252F20456017%252Fexterior_rear_passenger-1774536765411.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6017/20456017/exterior_rear_passenger-1774536765411.jpg saved to cache
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c244f7b2-a6a9-5e44-8d29-af15e570473e
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4ce910>
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b0ea32-4fba-5fd6-a636-6dd16f0287fa/40b0ea32-4fba-5fd6-a636-6dd16f0287fa_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3159%252F19543159%252Finterior_boot-1774607767838.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3159/19543159/interior_boot-1774607767838.jpg saved to cache
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40b0ea32-4fba-5fd6-a636-6dd16f0287fa
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5345d0>
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c244f7b2-a6a9-5e44-8d29-af15e570473e/c244f7b2-a6a9-5e44-8d29-af15e570473e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6017%252F20456017%252Finstrument_cluster-1774537598032.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6017/20456017/instrument_cluster-1774537598032.jpg saved to cache
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c244f7b2-a6a9-5e44-8d29-af15e570473e
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4cd150>
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b0ea32-4fba-5fd6-a636-6dd16f0287fa/40b0ea32-4fba-5fd6-a636-6dd16f0287fa_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3159%252F19543159%252Finstrument_cluster-1774607934533.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3159/19543159/instrument_cluster-1774607934533.jpg saved to cache
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40b0ea32-4fba-5fd6-a636-6dd16f0287fa
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d47bf50>
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c244f7b2-a6a9-5e44-8d29-af15e570473e/c244f7b2-a6a9-5e44-8d29-af15e570473e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6017%252F20456017%252Finterior_rear_seats-1774537680436.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6017/20456017/interior_rear_seats-1774537680436.jpg saved to cache
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c244f7b2-a6a9-5e44-8d29-af15e570473e
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d08c410>
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c244f7b2-a6a9-5e44-8d29-af15e570473e/c244f7b2-a6a9-5e44-8d29-af15e570473e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6017%252F20456017%252Finterior_dashboard-1774537598050.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6017/20456017/interior_dashboard-1774537598050.jpg saved to cache
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c244f7b2-a6a9-5e44-8d29-af15e570473e
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4e9710>
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b0ea32-4fba-5fd6-a636-6dd16f0287fa/40b0ea32-4fba-5fd6-a636-6dd16f0287fa_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3159%252F19543159%252Finterior_dashboard-1774607776968.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3159/19543159/interior_dashboard-1774607776968.jpg saved to cache
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40b0ea32-4fba-5fd6-a636-6dd16f0287fa
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d58d850>
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c244f7b2-a6a9-5e44-8d29-af15e570473e/c244f7b2-a6a9-5e44-8d29-af15e570473e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6017%252F20456017%252Finterior_front_seats-1774537519207.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6017/20456017/interior_front_seats-1774537519207.jpg saved to cache
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c244f7b2-a6a9-5e44-8d29-af15e570473e
2026-03-29 20:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e26309d-13f6-5d2d-af5e-8497f127c4b6 with identifier: 20490401
2026-03-29 20:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e26309d-13f6-5d2d-af5e-8497f127c4b6 with scrape type 1
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e26309d-13f6-5d2d-af5e-8497f127c4b6
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0401%252F20490401%252Fexterior_front_driver-1774711566844.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0401/20490401/exterior_front_driver-1774711566844.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0401%252F20490401%252Fexterior_rear_driver-1774711268205.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0401/20490401/exterior_rear_driver-1774711268205.jpg not downloaded yet
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20428748.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0401%252F20490401%252Fexterior_front_passenger-1774711568204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0401/20490401/exterior_front_passenger-1774711568204.jpg not downloaded yet
2026-03-29 20:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0401%252F20490401%252Fexterior_rear_passenger-1774711281532.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0401/20490401/exterior_rear_passenger-1774711281532.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0401%252F20490401%252Finterior_front_seats-1774777439763.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0401/20490401/interior_front_seats-1774777439763.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0401%252F20490401%252Finterior_rear_seats-1774777448052.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0401/20490401/interior_rear_seats-1774777448052.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0401%252F20490401%252Finterior_dashboard-1774777484253.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0401/20490401/interior_dashboard-1774777484253.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0401%252F20490401%252Finterior_boot-1774777490598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0401/20490401/interior_boot-1774777490598.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0401%252F20490401%252Fdocs_service_history-1774777674909.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D00eabe76c452f6e500c9391e72f6d6ba%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0401/20490401/docs_service_history-1774777674909.jpg?ixlib=js-3.8.0&auto=format&s=00eabe76c452f6e500c9391e72f6d6ba not downloaded yet
2026-03-29 20:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 113b01dd-fecf-5310-b370-9f4fca3a8550 with identifier: 20428748
2026-03-29 20:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113b01dd-fecf-5310-b370-9f4fca3a8550 with scrape type 1
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 113b01dd-fecf-5310-b370-9f4fca3a8550
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F20428748%252Fexterior_front_driver-1774710865427.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/20428748/exterior_front_driver-1774710865427.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0401%252F20490401%252Fdamage_scratches-1774776477009.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0401/20490401/damage_scratches-1774776477009.jpg not downloaded yet
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2363/20172363/docs_service_history-1774702254405.jpg?ixlib=js-3.8.0&auto=format&s=e256d2c8ae5680307465127d9d8f19d6> (referer: None)
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F20428748%252Fexterior_rear_driver-1774710879007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/20428748/exterior_rear_driver-1774710879007.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F20428748%252Fexterior_front_passenger-1774710897595.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/20428748/exterior_front_passenger-1774710897595.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F20428748%252Fexterior_rear_passenger-1774710887724.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/20428748/exterior_rear_passenger-1774710887724.jpg not downloaded yet
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486496.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8748%252F20428748%252Finterior_front_seats-1774711625068.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8748/20428748/interior_front_seats-1774711625068.jpg not downloaded yet
2026-03-29 20:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8748%252F20428748%252Finterior_rear_seats-1774711638103.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8748/20428748/interior_rear_seats-1774711638103.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F20428748%252Finterior_dashboard-1774711703071.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/20428748/interior_dashboard-1774711703071.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F20428748%252Finstrument_cluster-1774711569156.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/20428748/instrument_cluster-1774711569156.jpg not downloaded yet
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1ce390>
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db7c31b-fc36-5c73-bd3c-84e714f03a1c/3db7c31b-fc36-5c73-bd3c-84e714f03a1c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2363%252F20172363%252Fdocs_service_history-1774702254405.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De256d2c8ae5680307465127d9d8f19d6') HTTP/1.1" 204 0
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2363/20172363/docs_service_history-1774702254405.jpg?ixlib=js-3.8.0&auto=format&s=e256d2c8ae5680307465127d9d8f19d6 saved to cache
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3db7c31b-fc36-5c73-bd3c-84e714f03a1c
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8748%252F20428748%252Finterior_boot-1774711704494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8748/20428748/interior_boot-1774711704494.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8748%252F20428748%252Fdocs_service_history-1774711977702.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D801f00997c5210d14f5ce1892eb8b42b%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8748/20428748/docs_service_history-1774711977702.jpg?ixlib=js-3.8.0&auto=format&s=801f00997c5210d14f5ce1892eb8b42b not downloaded yet
2026-03-29 20:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23c187b8-6419-5765-8743-f27acf19d4f7 with identifier: 20486496
2026-03-29 20:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23c187b8-6419-5765-8743-f27acf19d4f7 with scrape type 1
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23c187b8-6419-5765-8743-f27acf19d4f7
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6496%252F20486496%252Fexterior_front_driver-1774719347700.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6496/20486496/exterior_front_driver-1774719347700.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6496%252F20486496%252Fexterior_rear_driver-1774787394541.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6496/20486496/exterior_rear_driver-1774787394541.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6496%252F20486496%252Fexterior_front_passenger-1774719389380.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6496/20486496/exterior_front_passenger-1774719389380.jpg not downloaded yet
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20465447.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6496%252F20486496%252Fexterior_rear_passenger-1774719376490.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6496/20486496/exterior_rear_passenger-1774719376490.jpg not downloaded yet
2026-03-29 20:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6496%252F20486496%252Finterior_front_seats-1774719736492.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6496/20486496/interior_front_seats-1774719736492.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6496%252F20486496%252Finterior_rear_seats-1774719752788.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6496/20486496/interior_rear_seats-1774719752788.jpg not downloaded yet
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8748/20428748/exterior_front_driver-1774710865427.jpg> (referer: None)
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6496%252F20486496%252Finterior_dashboard-1774719806368.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6496/20486496/interior_dashboard-1774719806368.jpg not downloaded yet
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0401/20490401/exterior_rear_driver-1774711268205.jpg> (referer: None)
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6496%252F20486496%252Finstrument_cluster-1774719819964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6496/20486496/instrument_cluster-1774719819964.jpg not downloaded yet
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0401/20490401/exterior_front_driver-1774711566844.jpg> (referer: None)
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6496%252F20486496%252Finterior_boot-1774719867388.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6496/20486496/interior_boot-1774719867388.jpg not downloaded yet
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20257689.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f689c32a-ef09-5785-9c21-e525775f4c57 with identifier: 20465447
2026-03-29 20:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f689c32a-ef09-5785-9c21-e525775f4c57 with scrape type 1
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f689c32a-ef09-5785-9c21-e525775f4c57
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5447%252F20465447%252Fexterior_front_driver-1774703452581.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5447/20465447/exterior_front_driver-1774703452581.jpg not downloaded yet
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6496%252F20486496%252Fdamage_scratches-1774719454951.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6496/20486496/damage_scratches-1774719454951.jpg not downloaded yet
2026-03-29 20:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5447%252F20465447%252Fexterior_rear_driver-1774703545864.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5447/20465447/exterior_rear_driver-1774703545864.jpg not downloaded yet
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5447%252F20465447%252Fexterior_front_passenger-1774703497965.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5447/20465447/exterior_front_passenger-1774703497965.jpg not downloaded yet
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d176810>
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113b01dd-fecf-5310-b370-9f4fca3a8550/113b01dd-fecf-5310-b370-9f4fca3a8550_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F20428748%252Fexterior_front_driver-1774710865427.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/20428748/exterior_front_driver-1774710865427.jpg saved to cache
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 113b01dd-fecf-5310-b370-9f4fca3a8550
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5d3610>
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e26309d-13f6-5d2d-af5e-8497f127c4b6/6e26309d-13f6-5d2d-af5e-8497f127c4b6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0401%252F20490401%252Fexterior_rear_driver-1774711268205.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0401/20490401/exterior_rear_driver-1774711268205.jpg saved to cache
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e26309d-13f6-5d2d-af5e-8497f127c4b6
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f62e2d0>
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e26309d-13f6-5d2d-af5e-8497f127c4b6/6e26309d-13f6-5d2d-af5e-8497f127c4b6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0401%252F20490401%252Fexterior_front_driver-1774711566844.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0401/20490401/exterior_front_driver-1774711566844.jpg saved to cache
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e26309d-13f6-5d2d-af5e-8497f127c4b6
2026-03-29 20:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3048194c-ea3b-578f-9147-8f1b42e9790e with identifier: 20257689
2026-03-29 20:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3048194c-ea3b-578f-9147-8f1b42e9790e with scrape type 1
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3048194c-ea3b-578f-9147-8f1b42e9790e
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7689%252F20257689%252Fexterior_front_driver-1774617090307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7689/20257689/exterior_front_driver-1774617090307.jpg not downloaded yet
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5447%252F20465447%252Fexterior_rear_passenger-1774709512310.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5447/20465447/exterior_rear_passenger-1774709512310.jpg not downloaded yet
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7689%252F20257689%252Fexterior_rear_driver-1774617109123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7689/20257689/exterior_rear_driver-1774617109123.jpg not downloaded yet
2026-03-29 20:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1152&page=32&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5447%252F20465447%252Finterior_front_seats-1774708701745.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5447/20465447/interior_front_seats-1774708701745.jpg not downloaded yet
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7689%252F20257689%252Fexterior_front_passenger-1774617129696.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7689/20257689/exterior_front_passenger-1774617129696.jpg not downloaded yet
2026-03-29 20:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16212102.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5447%252F20465447%252Finterior_rear_seats-1774708733549.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5447/20465447/interior_rear_seats-1774708733549.jpg not downloaded yet
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7689%252F20257689%252Fexterior_rear_passenger-1774617119931.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7689/20257689/exterior_rear_passenger-1774617119931.jpg not downloaded yet
2026-03-29 20:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8748/20428748/exterior_rear_passenger-1774710887724.jpg> (referer: None)
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5447%252F20465447%252Finterior_dashboard-1774708764935.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5447/20465447/interior_dashboard-1774708764935.jpg not downloaded yet
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7689%252F20257689%252Finterior_front_seats-1774618098364.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7689/20257689/interior_front_seats-1774618098364.jpg not downloaded yet
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5447%252F20465447%252Finstrument_cluster-1774708788561.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5447/20465447/instrument_cluster-1774708788561.jpg not downloaded yet
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7689%252F20257689%252Finterior_rear_seats-1774618168929.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7689/20257689/interior_rear_seats-1774618168929.jpg not downloaded yet
2026-03-29 20:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2363/20172363/instrument_cluster-1774701000213.jpg> (referer: None)
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5447%252F20465447%252Finterior_boot-1774708785467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5447/20465447/interior_boot-1774708785467.jpg not downloaded yet
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7689%252F20257689%252Finterior_dashboard-1774618213052.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7689/20257689/interior_dashboard-1774618213052.jpg not downloaded yet
2026-03-29 20:10:58 [motorway.uk] INFO: Found listing with ID: 18037733
2026-03-29 20:10:58 [motorway.uk] INFO: Found listing with ID: 20357003
2026-03-29 20:10:58 [motorway.uk] INFO: Found listing with ID: 20419987
2026-03-29 20:10:58 [motorway.uk] INFO: Found listing with ID: 20487473
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487473%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [motorway.uk] INFO: Scrape type for 20487473: 1
2026-03-29 20:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f71a0c-7633-5a6b-af63-0aedb793178c with identifier: 16212102
2026-03-29 20:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f71a0c-7633-5a6b-af63-0aedb793178c with scrape type 1
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55f71a0c-7633-5a6b-af63-0aedb793178c
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2102%252F16212102%252Fexterior_front_driver-1774635628570.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2102/16212102/exterior_front_driver-1774635628570.jpg not downloaded yet
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5447%252F20465447%252Fdocs_service_history-1774709302146.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D13bcbf4500ce74df7274176548150225%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5447/20465447/docs_service_history-1774709302146.jpg?ixlib=js-3.8.0&auto=format&s=13bcbf4500ce74df7274176548150225 not downloaded yet
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7689%252F20257689%252Finstrument_cluster-1774618232515.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7689/20257689/instrument_cluster-1774618232515.jpg not downloaded yet
2026-03-29 20:10:58 [motorway.uk] INFO: Found listing with ID: 20355479
2026-03-29 20:10:58 [motorway.uk] INFO: Found listing with ID: 12517194
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712517194%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [motorway.uk] INFO: Scrape type for 12517194: 1
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2102%252F16212102%252Fexterior_rear_driver-1774633534668.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2102/16212102/exterior_rear_driver-1774633534668.jpg not downloaded yet
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5e4e90>
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113b01dd-fecf-5310-b370-9f4fca3a8550/113b01dd-fecf-5310-b370-9f4fca3a8550_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F20428748%252Fexterior_rear_passenger-1774710887724.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/20428748/exterior_rear_passenger-1774710887724.jpg saved to cache
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 113b01dd-fecf-5310-b370-9f4fca3a8550
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7689%252F20257689%252Finterior_boot-1774618221847.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7689/20257689/interior_boot-1774618221847.jpg not downloaded yet
2026-03-29 20:10:58 [motorway.uk] INFO: Found listing with ID: 17744204
2026-03-29 20:10:58 [motorway.uk] INFO: Found listing with ID: 20209184
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720209184%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [motorway.uk] INFO: Scrape type for 20209184: 1
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2102%252F16212102%252Fexterior_front_passenger-1774701589671.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2102/16212102/exterior_front_passenger-1774701589671.jpg not downloaded yet
2026-03-29 20:10:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca40610>
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db7c31b-fc36-5c73-bd3c-84e714f03a1c/3db7c31b-fc36-5c73-bd3c-84e714f03a1c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2363%252F20172363%252Finstrument_cluster-1774701000213.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2363/20172363/instrument_cluster-1774701000213.jpg saved to cache
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3db7c31b-fc36-5c73-bd3c-84e714f03a1c
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7689%252F20257689%252Fdocs_service_history-1774618442939.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2cda21f75dfc5346a164d1de6b26f627%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7689/20257689/docs_service_history-1774618442939.jpg?ixlib=js-3.8.0&auto=format&s=2cda21f75dfc5346a164d1de6b26f627 not downloaded yet
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 9654966
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279654966%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [motorway.uk] INFO: Scrape type for 9654966: 1
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2102%252F16212102%252Fexterior_rear_passenger-1774701606423.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2102/16212102/exterior_rear_passenger-1774701606423.jpg not downloaded yet
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 17811380
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20487082
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20405903
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20335691
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20492519
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 19185025
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20473857
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 18463422
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718463422%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [motorway.uk] INFO: Scrape type for 18463422: 1
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2102%252F16212102%252Finterior_front_seats-1774705778994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2102/16212102/interior_front_seats-1774705778994.jpg not downloaded yet
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20432038
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20466969
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 16001492
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716001492%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [motorway.uk] INFO: Scrape type for 16001492: 1
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2102%252F16212102%252Finterior_rear_seats-1774701710330.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2102/16212102/interior_rear_seats-1774701710330.jpg not downloaded yet
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20488676
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488676%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [motorway.uk] INFO: Scrape type for 20488676: 1
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2102%252F16212102%252Finterior_dashboard-1774704634276.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2102/16212102/interior_dashboard-1774704634276.jpg not downloaded yet
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6496/20486496/exterior_front_passenger-1774719389380.jpg> (referer: None)
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6496/20486496/interior_dashboard-1774719806368.jpg> (referer: None)
2026-03-29 20:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 19668749
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20386402
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720386402%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [motorway.uk] INFO: Scrape type for 20386402: 1
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2102%252F16212102%252Finstrument_cluster-1774704701902.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2102/16212102/instrument_cluster-1774704701902.jpg not downloaded yet
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20456408
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20144250
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 19436717
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20482913
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20165260
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20420247
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720420247%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [motorway.uk] INFO: Scrape type for 20420247: 1
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2102%252F16212102%252F16212102-interior_boot-modified-1774706557404.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2102/16212102/16212102-interior_boot-modified-1774706557404.jpeg not downloaded yet
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20458630
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 18085024
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20484226
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 15574359
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715574359%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [motorway.uk] INFO: Scrape type for 15574359: 1
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2102%252F16212102%252F16212102-docs_service_history-modified-1774717973532.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2ae75e2dbb71172f0a87cb4a8639656c%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2102/16212102/16212102-docs_service_history-modified-1774717973532.jpeg?ixlib=js-3.8.0&auto=format&s=2ae75e2dbb71172f0a87cb4a8639656c not downloaded yet
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18720332.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20469502
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20453801
2026-03-29 20:10:59 [motorway.uk] INFO: Found listing with ID: 20497569
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd3dcd0>
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23c187b8-6419-5765-8743-f27acf19d4f7/23c187b8-6419-5765-8743-f27acf19d4f7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6496%252F20486496%252Fexterior_front_passenger-1774719389380.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6496/20486496/exterior_front_passenger-1774719389380.jpg saved to cache
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23c187b8-6419-5765-8743-f27acf19d4f7
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db56e90>
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23c187b8-6419-5765-8743-f27acf19d4f7/23c187b8-6419-5765-8743-f27acf19d4f7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6496%252F20486496%252Finterior_dashboard-1774719806368.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6496/20486496/interior_dashboard-1774719806368.jpg saved to cache
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23c187b8-6419-5765-8743-f27acf19d4f7
2026-03-29 20:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b8bfc0a-a069-560c-a975-73ab8d29b195 with identifier: 18720332
2026-03-29 20:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b8bfc0a-a069-560c-a975-73ab8d29b195 with scrape type 1
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b8bfc0a-a069-560c-a975-73ab8d29b195
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0332%252F18720332%252F18720332-exterior_front_driver-modified-1774696815347.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0332/18720332/18720332-exterior_front_driver-modified-1774696815347.jpeg not downloaded yet
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5447/20465447/exterior_front_passenger-1774703497965.jpg> (referer: None)
2026-03-29 20:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0332%252F18720332%252Fexterior_rear_driver-1774694755811.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0332/18720332/exterior_rear_driver-1774694755811.jpeg not downloaded yet
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7689/20257689/exterior_rear_driver-1774617109123.jpg> (referer: None)
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7689/20257689/exterior_front_driver-1774617090307.jpg> (referer: None)
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7689/20257689/exterior_front_passenger-1774617129696.jpg> (referer: None)
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0332%252F18720332%252Fexterior_front_passenger-1774694740190.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0332/18720332/exterior_front_passenger-1774694740190.jpeg not downloaded yet
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2363/20172363/interior_boot-1774701070580.jpg> (referer: None)
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2102/16212102/exterior_front_passenger-1774701589671.jpg> (referer: None)
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0332%252F18720332%252Fexterior_rear_passenger-1774694745394.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0332/18720332/exterior_rear_passenger-1774694745394.jpeg not downloaded yet
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0332%252F18720332%252Finterior_front_seats-1774695016624.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0332/18720332/interior_front_seats-1774695016624.jpeg not downloaded yet
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0332%252F18720332%252Finterior_rear_seats-1774695052276.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0332/18720332/interior_rear_seats-1774695052276.jpeg not downloaded yet
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0332%252F18720332%252F18720332-interior_dashboard-modified-1774696787451.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0332/18720332/18720332-interior_dashboard-modified-1774696787451.jpeg not downloaded yet
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2102/16212102/interior_rear_seats-1774701710330.jpg> (referer: None)
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca4ff50>
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f689c32a-ef09-5785-9c21-e525775f4c57/f689c32a-ef09-5785-9c21-e525775f4c57_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5447%252F20465447%252Fexterior_front_passenger-1774703497965.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5447/20465447/exterior_front_passenger-1774703497965.jpg saved to cache
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f689c32a-ef09-5785-9c21-e525775f4c57
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0332%252F18720332%252Finterior_boot-1774695082012.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0332/18720332/interior_boot-1774695082012.jpeg not downloaded yet
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6496/20486496/interior_rear_seats-1774719752788.jpg> (referer: None)
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0332%252F18720332%252Fdocs_service_history-1774695937607.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D60d1fb723d3974ab0fda1a0fcba0c1ae%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0332/18720332/docs_service_history-1774695937607.jpeg?ixlib=js-3.8.0&auto=format&s=60d1fb723d3974ab0fda1a0fcba0c1ae not downloaded yet
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1c1a90>
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3048194c-ea3b-578f-9147-8f1b42e9790e/3048194c-ea3b-578f-9147-8f1b42e9790e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7689%252F20257689%252Fexterior_rear_driver-1774617109123.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7689/20257689/exterior_rear_driver-1774617109123.jpg saved to cache
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3048194c-ea3b-578f-9147-8f1b42e9790e
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5f3ad0>
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3048194c-ea3b-578f-9147-8f1b42e9790e/3048194c-ea3b-578f-9147-8f1b42e9790e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7689%252F20257689%252Fexterior_front_driver-1774617090307.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7689/20257689/exterior_front_driver-1774617090307.jpg saved to cache
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3048194c-ea3b-578f-9147-8f1b42e9790e
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c2690>
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3048194c-ea3b-578f-9147-8f1b42e9790e/3048194c-ea3b-578f-9147-8f1b42e9790e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7689%252F20257689%252Fexterior_front_passenger-1774617129696.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7689/20257689/exterior_front_passenger-1774617129696.jpg saved to cache
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3048194c-ea3b-578f-9147-8f1b42e9790e
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f434690>
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db7c31b-fc36-5c73-bd3c-84e714f03a1c/3db7c31b-fc36-5c73-bd3c-84e714f03a1c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2363%252F20172363%252Finterior_boot-1774701070580.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2363/20172363/interior_boot-1774701070580.jpg saved to cache
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3db7c31b-fc36-5c73-bd3c-84e714f03a1c
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5f1e10>
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f71a0c-7633-5a6b-af63-0aedb793178c/55f71a0c-7633-5a6b-af63-0aedb793178c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2102%252F16212102%252Fexterior_front_passenger-1774701589671.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2102/16212102/exterior_front_passenger-1774701589671.jpg saved to cache
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55f71a0c-7633-5a6b-af63-0aedb793178c
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d970450>
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f71a0c-7633-5a6b-af63-0aedb793178c/55f71a0c-7633-5a6b-af63-0aedb793178c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2102%252F16212102%252Finterior_rear_seats-1774701710330.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2102/16212102/interior_rear_seats-1774701710330.jpg saved to cache
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55f71a0c-7633-5a6b-af63-0aedb793178c
2026-03-29 20:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2102/16212102/16212102-docs_service_history-modified-1774717973532.jpeg?ixlib=js-3.8.0&auto=format&s=2ae75e2dbb71172f0a87cb4a8639656c> (referer: None)
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0332%252F18720332%252Fdocs_service_history-1774695957370.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6325f51c3bddaa2920cb07fb48380e7b%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0332/18720332/docs_service_history-1774695957370.jpeg?ixlib=js-3.8.0&auto=format&s=6325f51c3bddaa2920cb07fb48380e7b not downloaded yet
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e07f290>
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23c187b8-6419-5765-8743-f27acf19d4f7/23c187b8-6419-5765-8743-f27acf19d4f7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6496%252F20486496%252Finterior_rear_seats-1774719752788.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6496/20486496/interior_rear_seats-1774719752788.jpg saved to cache
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23c187b8-6419-5765-8743-f27acf19d4f7
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e07f490>
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f71a0c-7633-5a6b-af63-0aedb793178c/55f71a0c-7633-5a6b-af63-0aedb793178c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2102%252F16212102%252F16212102-docs_service_history-modified-1774717973532.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2ae75e2dbb71172f0a87cb4a8639656c') HTTP/1.1" 204 0
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2102/16212102/16212102-docs_service_history-modified-1774717973532.jpeg?ixlib=js-3.8.0&auto=format&s=2ae75e2dbb71172f0a87cb4a8639656c saved to cache
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55f71a0c-7633-5a6b-af63-0aedb793178c
2026-03-29 20:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5447/20465447/interior_front_seats-1774708701745.jpg> (referer: None)
2026-03-29 20:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20403434.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0332/18720332/18720332-exterior_front_driver-modified-1774696815347.jpeg> (referer: None)
2026-03-29 20:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20470846.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d66d1d0>
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f689c32a-ef09-5785-9c21-e525775f4c57/f689c32a-ef09-5785-9c21-e525775f4c57_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5447%252F20465447%252Finterior_front_seats-1774708701745.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5447/20465447/interior_front_seats-1774708701745.jpg saved to cache
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f689c32a-ef09-5785-9c21-e525775f4c57
2026-03-29 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19412192.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17363006.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5364a8e-77f5-5388-ac8f-4bf880ca6054 with identifier: 20403434
2026-03-29 20:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5364a8e-77f5-5388-ac8f-4bf880ca6054 with scrape type 1
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5364a8e-77f5-5388-ac8f-4bf880ca6054
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3434%252F20403434%252Fexterior_front_driver-1774687303825.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3434/20403434/exterior_front_driver-1774687303825.jpg not downloaded yet
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6c8290>
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0332%252F18720332%252F18720332-exterior_front_driver-modified-1774696815347.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0332/18720332/18720332-exterior_front_driver-modified-1774696815347.jpeg saved to cache
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b8bfc0a-a069-560c-a975-73ab8d29b195
2026-03-29 20:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bdf921a-cf51-5bff-9278-54857180be82 with identifier: 20470846
2026-03-29 20:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bdf921a-cf51-5bff-9278-54857180be82 with scrape type 1
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0bdf921a-cf51-5bff-9278-54857180be82
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20470846%252Fexterior_front_driver-1774613294804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20470846/exterior_front_driver-1774613294804.jpg not downloaded yet
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3434%252F20403434%252Fexterior_rear_driver-1774687333530.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3434/20403434/exterior_rear_driver-1774687333530.jpg not downloaded yet
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20470846%252Fexterior_rear_driver-1774613283732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20470846/exterior_rear_driver-1774613283732.jpg not downloaded yet
2026-03-29 20:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8b3e421-7612-5503-b70c-09e02323965e with identifier: 19412192
2026-03-29 20:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8b3e421-7612-5503-b70c-09e02323965e with scrape type 1
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8b3e421-7612-5503-b70c-09e02323965e
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2192%252F19412192%252Fexterior_front_driver-1773683224207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2192/19412192/exterior_front_driver-1773683224207.jpg already downloaded
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2192%252F19412192%252Fexterior_rear_driver-1773683239598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2192/19412192/exterior_rear_driver-1773683239598.jpg already downloaded
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2192%252F19412192%252Fexterior_front_passenger-1773683229787.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2192/19412192/exterior_front_passenger-1773683229787.jpg already downloaded
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2192%252F19412192%252Fexterior_rear_passenger-1773683234748.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2192/19412192/exterior_rear_passenger-1773683234748.jpg already downloaded
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2192%252F19412192%252Finterior_front_seats-1773683787488.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2192/19412192/interior_front_seats-1773683787488.jpg already downloaded
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2192%252F19412192%252Finterior_rear_seats-1773683784282.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2192/19412192/interior_rear_seats-1773683784282.jpg already downloaded
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2192%252F19412192%252Finterior_dashboard-1773748529771.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2192/19412192/interior_dashboard-1773748529771.jpg already downloaded
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2192%252F19412192%252Finterior_boot-1773748496170.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2192/19412192/interior_boot-1773748496170.jpg already downloaded
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2192%252F19412192%252Fdocs_service_history-1773747667829.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D75ee61caec6327d33d192f6c2f057102%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2192/19412192/docs_service_history-1773747667829.jpg?ixlib=js-3.8.0&auto=format&s=75ee61caec6327d33d192f6c2f057102 already downloaded
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2192%252F19412192%252Fdocs_service_history-1773748638838.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfea58e0100662c693aa85d58b4d539f1%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2192/19412192/docs_service_history-1773748638838.jpg?ixlib=js-3.8.0&auto=format&s=fea58e0100662c693aa85d58b4d539f1 already downloaded
2026-03-29 20:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c8b3e421-7612-5503-b70c-09e02323965e, identifier: 19412192
2026-03-29 20:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c99e01e8-50b4-578c-9b73-010a21651878 with identifier: 17363006
2026-03-29 20:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99e01e8-50b4-578c-9b73-010a21651878 with scrape type 1
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c99e01e8-50b4-578c-9b73-010a21651878
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3006%252F17363006%252Fexterior_front_driver-1774782357556.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3006/17363006/exterior_front_driver-1774782357556.jpg not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3434%252F20403434%252Fexterior_front_passenger-1774687319288.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3434/20403434/exterior_front_passenger-1774687319288.jpg not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20470846%252Fexterior_front_passenger-1774613289932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20470846/exterior_front_passenger-1774613289932.jpg not downloaded yet
2026-03-29 20:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c8b3e421-7612-5503-b70c-09e02323965e with identifier: 19412192
2026-03-29 20:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c8b3e421-7612-5503-b70c-09e02323965e with identifier: 19412192
2026-03-29 20:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c8b3e421-7612-5503-b70c-09e02323965e with identifier: 19412192 to the API
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19412192.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c8b3e421-7612-5503-b70c-09e02323965e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HJ23 XKE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19412192',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 20720,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/2192/19412192/exterior_front_driver-1773683224207.jpg',
'https://motorway-photos-redacted.imgix.net/2192/19412192/exterior_rear_driver-1773683239598.jpg',
'https://motorway-photos-redacted.imgix.net/2192/19412192/exterior_front_passenger-1773683229787.jpg',
'https://motorway-photos-redacted.imgix.net/2192/19412192/exterior_rear_passenger-1773683234748.jpg',
'https://motorway-photos.imgix.net/2192/19412192/interior_front_seats-1773683787488.jpg',
'https://motorway-photos.imgix.net/2192/19412192/interior_rear_seats-1773683784282.jpg',
'https://motorway-photos-modified.imgix.net/2192/19412192/interior_dashboard-1773748529771.jpg',
'https://motorway-photos-modified.imgix.net/2192/19412192/interior_boot-1773748496170.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/2192/19412192/docs_service_history-1773747667829.jpg?ixlib=js-3.8.0&auto=format&s=75ee61caec6327d33d192f6c2f057102',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/2192/19412192/docs_service_history-1773748638838.jpg?ixlib=js-3.8.0&auto=format&s=fea58e0100662c693aa85d58b4d539f1'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01d8e76-a775-579c-9232-ef46eacce2e4/b01d8e76-a775-579c-9232-ef46eacce2e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1118208,
'Height': 2098,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2192/19412192/exterior_front_driver-1773683224207.jpg',
'Width': 2797},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01d8e76-a775-579c-9232-ef46eacce2e4/b01d8e76-a775-579c-9232-ef46eacce2e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1077182,
'Height': 2094,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2192/19412192/exterior_rear_driver-1773683239598.jpg',
'Width': 2792},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01d8e76-a775-579c-9232-ef46eacce2e4/b01d8e76-a775-579c-9232-ef46eacce2e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1021038,
'Height': 2211,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2192/19412192/exterior_front_passenger-1773683229787.jpg',
'Width': 2948},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01d8e76-a775-579c-9232-ef46eacce2e4/b01d8e76-a775-579c-9232-ef46eacce2e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 995782,
'Height': 2099,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2192/19412192/exterior_rear_passenger-1773683234748.jpg',
'Width': 2798},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01d8e76-a775-579c-9232-ef46eacce2e4/b01d8e76-a775-579c-9232-ef46eacce2e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6951461,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2192/19412192/interior_front_seats-1773683787488.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01d8e76-a775-579c-9232-ef46eacce2e4/b01d8e76-a775-579c-9232-ef46eacce2e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8897599,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2192/19412192/interior_rear_seats-1773683784282.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01d8e76-a775-579c-9232-ef46eacce2e4/b01d8e76-a775-579c-9232-ef46eacce2e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1405903,
'Height': 2278,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2192/19412192/interior_dashboard-1773748529771.jpg',
'Width': 3038},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01d8e76-a775-579c-9232-ef46eacce2e4/b01d8e76-a775-579c-9232-ef46eacce2e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1458345,
'Height': 2148,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2192/19412192/interior_boot-1773748496170.jpg',
'Width': 2865},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01d8e76-a775-579c-9232-ef46eacce2e4/b01d8e76-a775-579c-9232-ef46eacce2e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1253518,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2192/19412192/docs_service_history-1773747667829.jpg?ixlib=js-3.8.0&auto=format&s=75ee61caec6327d33d192f6c2f057102',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01d8e76-a775-579c-9232-ef46eacce2e4/b01d8e76-a775-579c-9232-ef46eacce2e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119743,
'Height': 1533,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2192/19412192/docs_service_history-1773748638838.jpg?ixlib=js-3.8.0&auto=format&s=fea58e0100662c693aa85d58b4d539f1',
'Width': 1080}],
'price': 23050,
'price_includes_vat': False,
'registration_date': '2023-04-05',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Tiguan Elegance TSI S-A',
'transmission': 'automatic',
'trim': 'Elegance TSI S-A',
'vin': 'WVGZZZ5N3PW064414',
'year': 2023}
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719412192%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [motorway.uk] INFO: Saving data for 19412192: {'created_time': 1774815062.679159, 'last_price_update_time': 1774815062.67917, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19412192') HTTP/1.1" 204 0
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3006%252F17363006%252Fexterior_rear_driver-1774782423979.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3006/17363006/exterior_rear_driver-1774782423979.jpg not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3434%252F20403434%252Fexterior_rear_passenger-1774687312006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3434/20403434/exterior_rear_passenger-1774687312006.jpg not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0846%252F20470846%252Fexterior_rear_passenger-1774704359870.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0846/20470846/exterior_rear_passenger-1774704359870.jpg not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3006%252F17363006%252Fexterior_front_passenger-1774782384306.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3006/17363006/exterior_front_passenger-1774782384306.jpg not downloaded yet
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1188&page=33&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3434%252F20403434%252Finterior_front_seats-1774687657749.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3434/20403434/interior_front_seats-1774687657749.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0846%252F20470846%252Finterior_front_seats-1774699713515.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0846/20470846/interior_front_seats-1774699713515.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3006%252F17363006%252Fexterior_rear_passenger-1774782413379.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3006/17363006/exterior_rear_passenger-1774782413379.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3434%252F20403434%252Finterior_rear_seats-1774687650096.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3434/20403434/interior_rear_seats-1774687650096.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0846%252F20470846%252Finterior_rear_seats-1774699707804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0846/20470846/interior_rear_seats-1774699707804.jpg not downloaded yet
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16001492.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20481167.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3006%252F17363006%252Finterior_front_seats-1774782468965.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3006/17363006/interior_front_seats-1774782468965.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3434%252F20403434%252Finterior_dashboard-1774688961315.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3434/20403434/interior_dashboard-1774688961315.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20470846%252Finterior_dashboard-1774699721580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20470846/interior_dashboard-1774699721580.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3006%252F17363006%252Finterior_rear_seats-1774784529466.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3006/17363006/interior_rear_seats-1774784529466.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3434%252F20403434%252Finstrument_cluster-1774687731277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3434/20403434/instrument_cluster-1774687731277.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20470846%252Finstrument_cluster-1774699661704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20470846/instrument_cluster-1774699661704.jpg not downloaded yet
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20484945
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 14357475
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714357475%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [motorway.uk] INFO: Scrape type for 14357475: 1
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3006%252F17363006%252F17363006-interior_dashboard-modified-1774784527204.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3006/17363006/17363006-interior_dashboard-modified-1774784527204.jpeg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3434%252F20403434%252Finterior_boot-1774687652670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3434/20403434/interior_boot-1774687652670.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0846%252F20470846%252Finterior_boot-1774699711890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0846/20470846/interior_boot-1774699711890.jpg not downloaded yet
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20175875
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20016415
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 18975319
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20492267
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720492267%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [motorway.uk] INFO: Scrape type for 20492267: 1
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2102/16212102/16212102-interior_boot-modified-1774706557404.jpeg> (referer: None)
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3006%252F17363006%252F17363006-instrument_cluster-modified-1774784854820.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3006/17363006/17363006-instrument_cluster-modified-1774784854820.jpeg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3434%252F20403434%252Fwheels_front_driver-1774687393985.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3434/20403434/wheels_front_driver-1774687393985.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0846%252F20470846%252Fdocs_service_history-1774702095822.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0919e8bddad9df64242504ed9c541323%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0846/20470846/docs_service_history-1774702095822.jpg?ixlib=js-3.8.0&auto=format&s=0919e8bddad9df64242504ed9c541323 not downloaded yet
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20435647
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20487216
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 18947501
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20381015
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20482805
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720482805%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [motorway.uk] INFO: Scrape type for 20482805: 1
2026-03-29 20:11:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bea5b7c-0991-541e-8e0f-a466dfa480f2 with identifier: 16001492
2026-03-29 20:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bea5b7c-0991-541e-8e0f-a466dfa480f2 with scrape type 1
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5bea5b7c-0991-541e-8e0f-a466dfa480f2
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1492%252F16001492%252Fexterior_front_driver-1774616397970.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1492/16001492/exterior_front_driver-1774616397970.jpg not downloaded yet
2026-03-29 20:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bf73df3-b8db-5794-b12d-3169aab22e01 with identifier: 20481167
2026-03-29 20:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf73df3-b8db-5794-b12d-3169aab22e01 with scrape type 1
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4bf73df3-b8db-5794-b12d-3169aab22e01
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1167%252F20481167%252Fexterior_front_driver-1774714177630.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1167/20481167/exterior_front_driver-1774714177630.jpg not downloaded yet
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0332/18720332/docs_service_history-1774695937607.jpeg?ixlib=js-3.8.0&auto=format&s=60d1fb723d3974ab0fda1a0fcba0c1ae> (referer: None)
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0332/18720332/exterior_rear_driver-1774694755811.jpeg> (referer: None)
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3006%252F17363006%252Finterior_boot-1774782835869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3006/17363006/interior_boot-1774782835869.jpg not downloaded yet
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 9373677
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279373677%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [motorway.uk] INFO: Scrape type for 9373677: 1
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1492%252F16001492%252Fexterior_rear_driver-1774616471020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1492/16001492/exterior_rear_driver-1774616471020.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1167%252F20481167%252Fexterior_rear_driver-1774713204486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1167/20481167/exterior_rear_driver-1774713204486.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3006%252F17363006%252F17363006-docs_service_history-default-1774784449249.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddce07f7888009e062519419fe4516fae%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3006/17363006/17363006-docs_service_history-default-1774784449249.jpg?ixlib=js-3.8.0&auto=format&s=dce07f7888009e062519419fe4516fae not downloaded yet
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0332/18720332/exterior_front_passenger-1774694740190.jpeg> (referer: None)
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20339850
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20478886
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 19640893
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 16034385
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20490883
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490883%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [motorway.uk] INFO: Scrape type for 20490883: 1
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1492%252F16001492%252Fexterior_front_passenger-1774616438083.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1492/16001492/exterior_front_passenger-1774616438083.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1167%252F20481167%252Fexterior_front_passenger-1774713275748.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1167/20481167/exterior_front_passenger-1774713275748.jpg not downloaded yet
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8d3d10>
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f71a0c-7633-5a6b-af63-0aedb793178c/55f71a0c-7633-5a6b-af63-0aedb793178c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2102%252F16212102%252F16212102-interior_boot-modified-1774706557404.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2102/16212102/16212102-interior_boot-modified-1774706557404.jpeg saved to cache
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55f71a0c-7633-5a6b-af63-0aedb793178c
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0332/18720332/exterior_rear_passenger-1774694745394.jpeg> (referer: None)
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3006/17363006/exterior_rear_passenger-1774782413379.jpg> (referer: None)
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 18780849
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 18169442
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20467557
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20172298
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20481158
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20009659
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 19320604
2026-03-29 20:11:03 [motorway.uk] INFO: Found listing with ID: 20473409
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473409%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [motorway.uk] INFO: Scrape type for 20473409: 1
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1492%252F16001492%252Fexterior_rear_passenger-1774616423587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1492/16001492/exterior_rear_passenger-1774616423587.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1167%252F20481167%252Fexterior_rear_passenger-1774713228564.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1167/20481167/exterior_rear_passenger-1774713228564.jpg not downloaded yet
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de2a790>
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0332%252F18720332%252Fdocs_service_history-1774695937607.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D60d1fb723d3974ab0fda1a0fcba0c1ae') HTTP/1.1" 204 0
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0332/18720332/docs_service_history-1774695937607.jpeg?ixlib=js-3.8.0&auto=format&s=60d1fb723d3974ab0fda1a0fcba0c1ae saved to cache
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b8bfc0a-a069-560c-a975-73ab8d29b195
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daa1510>
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0332%252F18720332%252Fexterior_rear_driver-1774694755811.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0332/18720332/exterior_rear_driver-1774694755811.jpeg saved to cache
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b8bfc0a-a069-560c-a975-73ab8d29b195
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d74b0d0>
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0332%252F18720332%252Fexterior_front_passenger-1774694740190.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0332/18720332/exterior_front_passenger-1774694740190.jpeg saved to cache
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b8bfc0a-a069-560c-a975-73ab8d29b195
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0332/18720332/docs_service_history-1774695957370.jpeg?ixlib=js-3.8.0&auto=format&s=6325f51c3bddaa2920cb07fb48380e7b> (referer: None)
2026-03-29 20:11:04 [motorway.uk] INFO: Found listing with ID: 20388349
2026-03-29 20:11:04 [motorway.uk] INFO: Found listing with ID: 14416221
2026-03-29 20:11:04 [motorway.uk] INFO: Found listing with ID: 15999217
2026-03-29 20:11:04 [motorway.uk] INFO: Found listing with ID: 20500662
2026-03-29 20:11:04 [motorway.uk] INFO: Found listing with ID: 19873015
2026-03-29 20:11:04 [motorway.uk] INFO: Found listing with ID: 20398790
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720398790%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [motorway.uk] INFO: Scrape type for 20398790: 1
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1492%252F16001492%252Finterior_front_seats-1774616712217.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1492/16001492/interior_front_seats-1774616712217.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1167%252F20481167%252Finterior_front_seats-1774714959130.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1167/20481167/interior_front_seats-1774714959130.jpg not downloaded yet
2026-03-29 20:11:04 [motorway.uk] INFO: Found listing with ID: 13687661
2026-03-29 20:11:04 [motorway.uk] INFO: Found listing with ID: 13044273
2026-03-29 20:11:04 [motorway.uk] INFO: Found listing with ID: 11047706
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711047706%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [motorway.uk] INFO: Scrape type for 11047706: 1
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1492%252F16001492%252Finterior_dashboard-1774616733277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1492/16001492/interior_dashboard-1774616733277.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1167%252F20481167%252Finterior_rear_seats-1774714074431.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1167/20481167/interior_rear_seats-1774714074431.jpg not downloaded yet
2026-03-29 20:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7c9110>
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0332%252F18720332%252Fexterior_rear_passenger-1774694745394.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0332/18720332/exterior_rear_passenger-1774694745394.jpeg saved to cache
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b8bfc0a-a069-560c-a975-73ab8d29b195
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6c2490>
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99e01e8-50b4-578c-9b73-010a21651878/c99e01e8-50b4-578c-9b73-010a21651878_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3006%252F17363006%252Fexterior_rear_passenger-1774782413379.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3006/17363006/exterior_rear_passenger-1774782413379.jpg saved to cache
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c99e01e8-50b4-578c-9b73-010a21651878
2026-03-29 20:11:04 [motorway.uk] INFO: Found listing with ID: 20388848
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720388848%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [motorway.uk] INFO: Scrape type for 20388848: 1
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1492%252F16001492%252Finstrument_cluster-1774616772095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1492/16001492/instrument_cluster-1774616772095.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1167%252F20481167%252Finterior_dashboard-1774714993368.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1167/20481167/interior_dashboard-1774714993368.jpg not downloaded yet
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0e6350>
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0332%252F18720332%252Fdocs_service_history-1774695957370.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6325f51c3bddaa2920cb07fb48380e7b') HTTP/1.1" 204 0
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0332/18720332/docs_service_history-1774695957370.jpeg?ixlib=js-3.8.0&auto=format&s=6325f51c3bddaa2920cb07fb48380e7b saved to cache
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b8bfc0a-a069-560c-a975-73ab8d29b195
2026-03-29 20:11:04 [motorway.uk] INFO: Found listing with ID: 18340983
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1492%252F16001492%252Finterior_boot-1774616688198.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1492/16001492/interior_boot-1774616688198.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1167%252F20481167%252Finstrument_cluster-1774713924366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1167/20481167/instrument_cluster-1774713924366.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1492%252F16001492%252Fdocs_service_history-1774637032844.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3a9233f8538988ab1a49ac2d2baee3f4%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1492/16001492/docs_service_history-1774637032844.jpg?ixlib=js-3.8.0&auto=format&s=3a9233f8538988ab1a49ac2d2baee3f4 not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1167%252F20481167%252Finterior_boot-1774715006843.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1167/20481167/interior_boot-1774715006843.jpg not downloaded yet
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2102/16212102/instrument_cluster-1774704701902.jpg> (referer: None)
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1492%252F16001492%252Fwheels_front_driver-1774616515148.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1492/16001492/wheels_front_driver-1774616515148.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1167%252F20481167%252Fdocs_service_history-1774714209414.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db40db0db9349f5e5afc4e5b6c6c28bd8%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1167/20481167/docs_service_history-1774714209414.jpg?ixlib=js-3.8.0&auto=format&s=b40db0db9349f5e5afc4e5b6c6c28bd8 not downloaded yet
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0332/18720332/18720332-interior_dashboard-modified-1774696787451.jpeg> (referer: None)
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0846/20470846/exterior_rear_passenger-1774704359870.jpg> (referer: None)
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0332/18720332/interior_front_seats-1774695016624.jpeg> (referer: None)
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0332/18720332/interior_boot-1774695082012.jpeg> (referer: None)
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0846/20470846/interior_front_seats-1774699713515.jpg> (referer: None)
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0332/18720332/interior_rear_seats-1774695052276.jpeg> (referer: None)
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1492/16001492/interior_front_seats-1774616712217.jpg> (referer: None)
2026-03-29 20:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1167/20481167/exterior_rear_passenger-1774713228564.jpg> (referer: None)
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4bd310>
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f71a0c-7633-5a6b-af63-0aedb793178c/55f71a0c-7633-5a6b-af63-0aedb793178c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2102%252F16212102%252Finstrument_cluster-1774704701902.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2102/16212102/instrument_cluster-1774704701902.jpg saved to cache
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55f71a0c-7633-5a6b-af63-0aedb793178c
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce8e0d0>
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0332%252F18720332%252F18720332-interior_dashboard-modified-1774696787451.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0332/18720332/18720332-interior_dashboard-modified-1774696787451.jpeg saved to cache
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b8bfc0a-a069-560c-a975-73ab8d29b195
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a9510>
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bdf921a-cf51-5bff-9278-54857180be82/0bdf921a-cf51-5bff-9278-54857180be82_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0846%252F20470846%252Fexterior_rear_passenger-1774704359870.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0846/20470846/exterior_rear_passenger-1774704359870.jpg saved to cache
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0bdf921a-cf51-5bff-9278-54857180be82
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x0069\xa2\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xba\x05\x006/\x90\x00\x00\x00\x00'
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c82cd50>
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0332%252F18720332%252Finterior_front_seats-1774695016624.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0332/18720332/interior_front_seats-1774695016624.jpeg saved to cache
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b8bfc0a-a069-560c-a975-73ab8d29b195
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x006\xe73\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02[@\x006\xdd!\x00\x00\x00\x00'
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c82f3d0>
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0332%252F18720332%252Finterior_boot-1774695082012.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0332/18720332/interior_boot-1774695082012.jpeg saved to cache
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b8bfc0a-a069-560c-a975-73ab8d29b195
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca64a50>
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bdf921a-cf51-5bff-9278-54857180be82/0bdf921a-cf51-5bff-9278-54857180be82_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0846%252F20470846%252Finterior_front_seats-1774699713515.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0846/20470846/interior_front_seats-1774699713515.jpg saved to cache
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0bdf921a-cf51-5bff-9278-54857180be82
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x008\xa6\xaf\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02;\xc7\x008\x9c\x9d\x00\x00\x00\x00'
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db7ced0>
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0332%252F18720332%252Finterior_rear_seats-1774695052276.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0332/18720332/interior_rear_seats-1774695052276.jpeg saved to cache
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b8bfc0a-a069-560c-a975-73ab8d29b195
2026-03-29 20:11:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b8bfc0a-a069-560c-a975-73ab8d29b195, skipping ID generation
2026-03-29 20:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b8bfc0a-a069-560c-a975-73ab8d29b195 with scrape type 1
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b8bfc0a-a069-560c-a975-73ab8d29b195 sending to next pipeline
2026-03-29 20:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5b8bfc0a-a069-560c-a975-73ab8d29b195, identifier: 18720332
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4bf5d0>
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5b7c-0991-541e-8e0f-a466dfa480f2/5bea5b7c-0991-541e-8e0f-a466dfa480f2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1492%252F16001492%252Finterior_front_seats-1774616712217.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1492/16001492/interior_front_seats-1774616712217.jpg saved to cache
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bea5b7c-0991-541e-8e0f-a466dfa480f2
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d717690>
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf73df3-b8db-5794-b12d-3169aab22e01/4bf73df3-b8db-5794-b12d-3169aab22e01_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1167%252F20481167%252Fexterior_rear_passenger-1774713228564.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1167/20481167/exterior_rear_passenger-1774713228564.jpg saved to cache
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bf73df3-b8db-5794-b12d-3169aab22e01
2026-03-29 20:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5b8bfc0a-a069-560c-a975-73ab8d29b195 with identifier: 18720332
2026-03-29 20:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5b8bfc0a-a069-560c-a975-73ab8d29b195 with identifier: 18720332
2026-03-29 20:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5b8bfc0a-a069-560c-a975-73ab8d29b195 with identifier: 18720332 to the API
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0332/18720332/interior_rear_seats-1774695052276.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '5b8bfc0a-a069-560c-a975-73ab8d29b195',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OJ10 OJJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18720332',
'listing': 'auction',
'location': 'Cheshire East Congleton',
'make': 'Ford',
'model': 'Focus',
'odometer': 45500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2496179,
'Height': 2578,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0332/18720332/18720332-exterior_front_driver-modified-1774696815347.jpeg',
'Width': 3437},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1377779,
'Height': 2324,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0332/18720332/exterior_rear_driver-1774694755811.jpeg',
'Width': 3099},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1597987,
'Height': 2458,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0332/18720332/exterior_front_passenger-1774694740190.jpeg',
'Width': 3277},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1647008,
'Height': 2386,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0332/18720332/exterior_rear_passenger-1774694745394.jpeg',
'Width': 3181},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3666855,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0332/18720332/interior_front_seats-1774695016624.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3859062,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0332/18720332/interior_rear_seats-1774695052276.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2895358,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0332/18720332/18720332-interior_dashboard-modified-1774696787451.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3752563,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0332/18720332/interior_boot-1774695082012.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1407782,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0332/18720332/docs_service_history-1774695937607.jpeg?ixlib=js-3.8.0&auto=format&s=60d1fb723d3974ab0fda1a0fcba0c1ae',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b8bfc0a-a069-560c-a975-73ab8d29b195/5b8bfc0a-a069-560c-a975-73ab8d29b195_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1606913,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0332/18720332/docs_service_history-1774695957370.jpeg?ixlib=js-3.8.0&auto=format&s=6325f51c3bddaa2920cb07fb48380e7b',
'Width': 3024}],
'price': 9902,
'price_includes_vat': False,
'registration_date': '2019-05-16',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus ST-LINE X',
'transmission': 'manual',
'trim': 'ST-LINE X',
'vin': 'WF0NXXGCHNKC25862',
'year': 2019}
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718720332%27 HTTP/1.1" 200 None
2026-03-29 20:11:06 [motorway.uk] INFO: Saving data for 18720332: {'created_time': 1774815066.862014, 'last_price_update_time': 1774815066.862025, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18720332') HTTP/1.1" 204 0
2026-03-29 20:11:07 [scrapy.extensions.logstats] INFO: Crawled 247 pages (at 57 pages/min), scraped 128 items (at 18 items/min)
2026-03-29 20:11:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 302MiB
2026-03-29 20:11:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1167/20481167/interior_front_seats-1774714959130.jpg> (referer: None)
2026-03-29 20:11:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1492/16001492/exterior_rear_passenger-1774616423587.jpg> (referer: None)
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1167/20481167/docs_service_history-1774714209414.jpg?ixlib=js-3.8.0&auto=format&s=b40db0db9349f5e5afc4e5b6c6c28bd8> (referer: None)
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1167/20481167/interior_boot-1774715006843.jpg> (referer: None)
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0b23d0>
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf73df3-b8db-5794-b12d-3169aab22e01/4bf73df3-b8db-5794-b12d-3169aab22e01_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1167%252F20481167%252Finterior_front_seats-1774714959130.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1167/20481167/interior_front_seats-1774714959130.jpg saved to cache
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bf73df3-b8db-5794-b12d-3169aab22e01
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15574359.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d19f390>
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5b7c-0991-541e-8e0f-a466dfa480f2/5bea5b7c-0991-541e-8e0f-a466dfa480f2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1492%252F16001492%252Fexterior_rear_passenger-1774616423587.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1492/16001492/exterior_rear_passenger-1774616423587.jpg saved to cache
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bea5b7c-0991-541e-8e0f-a466dfa480f2
2026-03-29 20:11:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d736250>
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf73df3-b8db-5794-b12d-3169aab22e01/4bf73df3-b8db-5794-b12d-3169aab22e01_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1167%252F20481167%252Fdocs_service_history-1774714209414.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db40db0db9349f5e5afc4e5b6c6c28bd8') HTTP/1.1" 204 0
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1167/20481167/docs_service_history-1774714209414.jpg?ixlib=js-3.8.0&auto=format&s=b40db0db9349f5e5afc4e5b6c6c28bd8 saved to cache
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4bf73df3-b8db-5794-b12d-3169aab22e01
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c646190>
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf73df3-b8db-5794-b12d-3169aab22e01/4bf73df3-b8db-5794-b12d-3169aab22e01_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1167%252F20481167%252Finterior_boot-1774715006843.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1167/20481167/interior_boot-1774715006843.jpg saved to cache
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4bf73df3-b8db-5794-b12d-3169aab22e01
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20420247.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcbd7114-8d3d-5c5f-bac0-115233c0bb9b with identifier: 15574359
2026-03-29 20:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcbd7114-8d3d-5c5f-bac0-115233c0bb9b with scrape type 1
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bcbd7114-8d3d-5c5f-bac0-115233c0bb9b
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F15574359%252Fexterior_front_driver-1774785080805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/15574359/exterior_front_driver-1774785080805.jpg not downloaded yet
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F15574359%252Fexterior_rear_driver-1774786901776.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/15574359/exterior_rear_driver-1774786901776.jpg not downloaded yet
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4359%252F15574359%252Fexterior_front_passenger-1774788801210.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4359/15574359/exterior_front_passenger-1774788801210.jpg not downloaded yet
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F15574359%252Fexterior_rear_passenger-1774785066360.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/15574359/exterior_rear_passenger-1774785066360.jpg not downloaded yet
2026-03-29 20:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8824cbff-dfc7-5fe7-a64f-9c8ccdc07dd6 with identifier: 20420247
2026-03-29 20:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8824cbff-dfc7-5fe7-a64f-9c8ccdc07dd6 with scrape type 1
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8824cbff-dfc7-5fe7-a64f-9c8ccdc07dd6
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0247%252F20420247%252Fexterior_front_driver-1774357592460.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0247/20420247/exterior_front_driver-1774357592460.jpg not downloaded yet
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4359%252F15574359%252Finterior_front_seats-1774787504945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4359/15574359/interior_front_seats-1774787504945.jpg not downloaded yet
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1492/16001492/wheels_front_driver-1774616515148.jpg> (referer: None)
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1492/16001492/docs_service_history-1774637032844.jpg?ixlib=js-3.8.0&auto=format&s=3a9233f8538988ab1a49ac2d2baee3f4> (referer: None)
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0247%252F20420247%252Fexterior_rear_driver-1774362108806.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0247/20420247/exterior_rear_driver-1774362108806.jpg not downloaded yet
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20492267.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4359%252F15574359%252Finterior_rear_seats-1774785939933.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4359/15574359/interior_rear_seats-1774785939933.jpg not downloaded yet
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0247%252F20420247%252Fexterior_front_passenger-1774357594252.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0247/20420247/exterior_front_passenger-1774357594252.jpg not downloaded yet
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F15574359%252Finterior_dashboard-1774787366778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/15574359/interior_dashboard-1774787366778.jpg not downloaded yet
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0247%252F20420247%252Fexterior_rear_passenger-1774362102445.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0247/20420247/exterior_rear_passenger-1774362102445.jpg not downloaded yet
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F15574359%252Finstrument_cluster-1774785841980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/15574359/instrument_cluster-1774785841980.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0247%252F20420247%252Finterior_front_seats-1774362512212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0247/20420247/interior_front_seats-1774362512212.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4359%252F15574359%252Finterior_boot-1774785980356.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4359/15574359/interior_boot-1774785980356.jpg not downloaded yet
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20398790.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0247%252F20420247%252Finterior_rear_seats-1774362515432.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0247/20420247/interior_rear_seats-1774362515432.jpg not downloaded yet
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d47bc90>
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5b7c-0991-541e-8e0f-a466dfa480f2/5bea5b7c-0991-541e-8e0f-a466dfa480f2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1492%252F16001492%252Fwheels_front_driver-1774616515148.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1492/16001492/wheels_front_driver-1774616515148.jpg saved to cache
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5bea5b7c-0991-541e-8e0f-a466dfa480f2
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f673610>
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5b7c-0991-541e-8e0f-a466dfa480f2/5bea5b7c-0991-541e-8e0f-a466dfa480f2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1492%252F16001492%252Fdocs_service_history-1774637032844.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3a9233f8538988ab1a49ac2d2baee3f4') HTTP/1.1" 204 0
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1492/16001492/docs_service_history-1774637032844.jpg?ixlib=js-3.8.0&auto=format&s=3a9233f8538988ab1a49ac2d2baee3f4 saved to cache
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5bea5b7c-0991-541e-8e0f-a466dfa480f2
2026-03-29 20:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff8d7f47-4c34-51af-9334-e5cb1872b8c7 with identifier: 20492267
2026-03-29 20:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff8d7f47-4c34-51af-9334-e5cb1872b8c7 with scrape type 1
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff8d7f47-4c34-51af-9334-e5cb1872b8c7
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2267%252F20492267%252Fexterior_front_driver-1774721406211.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2267/20492267/exterior_front_driver-1774721406211.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4359%252F15574359%252Fdamage_dents-1774785275985.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4359/15574359/damage_dents-1774785275985.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0247%252F20420247%252Finterior_dashboard-1774362543628.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0247/20420247/interior_dashboard-1774362543628.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2267%252F20492267%252Fexterior_rear_driver-1774721422243.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2267/20492267/exterior_rear_driver-1774721422243.jpg not downloaded yet
2026-03-29 20:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4b4e8b1-4d49-5821-a8ae-535e4e04c49b with identifier: 20398790
2026-03-29 20:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b4e8b1-4d49-5821-a8ae-535e4e04c49b with scrape type 1
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4b4e8b1-4d49-5821-a8ae-535e4e04c49b
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8790%252F20398790%252Fexterior_front_driver-1774696759115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8790/20398790/exterior_front_driver-1774696759115.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0247%252F20420247%252Finstrument_cluster-1774362515475.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0247/20420247/instrument_cluster-1774362515475.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2267%252F20492267%252Fexterior_front_passenger-1774721448169.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2267/20492267/exterior_front_passenger-1774721448169.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8790%252F20398790%252Fexterior_rear_driver-1774696795198.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8790/20398790/exterior_rear_driver-1774696795198.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0247%252F20420247%252Finterior_boot-1774362507931.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0247/20420247/interior_boot-1774362507931.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2267%252F20492267%252Fexterior_rear_passenger-1774721469779.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2267/20492267/exterior_rear_passenger-1774721469779.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8790%252F20398790%252Fexterior_front_passenger-1774696835625.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8790/20398790/exterior_front_passenger-1774696835625.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0247%252F20420247%252Fdocs_service_history-1774362699113.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D028d83d02b6a8444a649aa748ac09457%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0247/20420247/docs_service_history-1774362699113.jpg?ixlib=js-3.8.0&auto=format&s=028d83d02b6a8444a649aa748ac09457 not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2267%252F20492267%252Finterior_front_seats-1774722025853.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2267/20492267/interior_front_seats-1774722025853.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8790%252F20398790%252Fexterior_rear_passenger-1774696821317.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8790/20398790/exterior_rear_passenger-1774696821317.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2267%252F20492267%252Finterior_rear_seats-1774722037804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2267/20492267/interior_rear_seats-1774722037804.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8790%252F20398790%252Finterior_front_seats-1774698762835.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8790/20398790/interior_front_seats-1774698762835.jpg not downloaded yet
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1224&page=34&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1167/20481167/instrument_cluster-1774713924366.jpg> (referer: None)
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0247/20420247/exterior_front_driver-1774357592460.jpg> (referer: None)
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2267%252F20492267%252Finterior_dashboard-1774776978511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2267/20492267/interior_dashboard-1774776978511.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8790%252F20398790%252Finterior_rear_seats-1774698850258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8790/20398790/interior_rear_seats-1774698850258.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2267%252F20492267%252Finstrument_cluster-1774722137510.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2267/20492267/instrument_cluster-1774722137510.jpg not downloaded yet
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1167/20481167/interior_dashboard-1774714993368.jpg> (referer: None)
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8790%252F20398790%252Finterior_dashboard-1774698913393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8790/20398790/interior_dashboard-1774698913393.jpg not downloaded yet
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1167/20481167/interior_rear_seats-1774714074431.jpg> (referer: None)
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1167/20481167/exterior_front_passenger-1774713275748.jpg> (referer: None)
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4359/15574359/exterior_rear_passenger-1774785066360.jpg> (referer: None)
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2267%252F20492267%252Finterior_boot-1774722091736.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2267/20492267/interior_boot-1774722091736.jpg not downloaded yet
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1492/16001492/instrument_cluster-1774616772095.jpg> (referer: None)
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1492/16001492/interior_boot-1774616688198.jpg> (referer: None)
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8790%252F20398790%252Finstrument_cluster-1774699167302.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8790/20398790/instrument_cluster-1774699167302.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2267%252F20492267%252Fdocs_service_history-1774722400600.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De3f479ff5da3c467c93035d759ed7684%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2267/20492267/docs_service_history-1774722400600.jpg?ixlib=js-3.8.0&auto=format&s=e3f479ff5da3c467c93035d759ed7684 not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8790%252F20398790%252Finterior_boot-1774698976277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8790/20398790/interior_boot-1774698976277.jpg not downloaded yet
2026-03-29 20:11:08 [motorway.uk] INFO: Found listing with ID: 19861645
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719861645%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [motorway.uk] INFO: Scrape type for 19861645: 1
2026-03-29 20:11:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc61610>
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf73df3-b8db-5794-b12d-3169aab22e01/4bf73df3-b8db-5794-b12d-3169aab22e01_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1167%252F20481167%252Finstrument_cluster-1774713924366.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1167/20481167/instrument_cluster-1774713924366.jpg saved to cache
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4bf73df3-b8db-5794-b12d-3169aab22e01
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c70e890>
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8824cbff-dfc7-5fe7-a64f-9c8ccdc07dd6/8824cbff-dfc7-5fe7-a64f-9c8ccdc07dd6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0247%252F20420247%252Fexterior_front_driver-1774357592460.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0247/20420247/exterior_front_driver-1774357592460.jpg saved to cache
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8824cbff-dfc7-5fe7-a64f-9c8ccdc07dd6
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8790%252F20398790%252Fdocs_service_history-1774699269578.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da2fafd97e080d024de9b2c7d20c6d6bd%27 HTTP/1.1" 200 None
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8790/20398790/docs_service_history-1774699269578.jpg?ixlib=js-3.8.0&auto=format&s=a2fafd97e080d024de9b2c7d20c6d6bd not downloaded yet
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 20152688
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 18699505
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 20455511
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 19242613
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 17909162
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 8203355
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278203355%27 HTTP/1.1" 200 None
2026-03-29 20:11:09 [motorway.uk] INFO: Scrape type for 8203355: 1
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2aa7d0>
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf73df3-b8db-5794-b12d-3169aab22e01/4bf73df3-b8db-5794-b12d-3169aab22e01_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1167%252F20481167%252Finterior_dashboard-1774714993368.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1167/20481167/interior_dashboard-1774714993368.jpg saved to cache
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4bf73df3-b8db-5794-b12d-3169aab22e01
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1492/16001492/exterior_front_passenger-1774616438083.jpg> (referer: None)
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 20378089
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 20299221
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720299221%27 HTTP/1.1" 200 None
2026-03-29 20:11:09 [motorway.uk] INFO: Scrape type for 20299221: 1
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f681a90>
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf73df3-b8db-5794-b12d-3169aab22e01/4bf73df3-b8db-5794-b12d-3169aab22e01_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1167%252F20481167%252Finterior_rear_seats-1774714074431.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1167/20481167/interior_rear_seats-1774714074431.jpg saved to cache
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4bf73df3-b8db-5794-b12d-3169aab22e01
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e03b450>
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf73df3-b8db-5794-b12d-3169aab22e01/4bf73df3-b8db-5794-b12d-3169aab22e01_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1167%252F20481167%252Fexterior_front_passenger-1774713275748.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1167/20481167/exterior_front_passenger-1774713275748.jpg saved to cache
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bf73df3-b8db-5794-b12d-3169aab22e01
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8d0c10>
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcbd7114-8d3d-5c5f-bac0-115233c0bb9b/bcbd7114-8d3d-5c5f-bac0-115233c0bb9b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F15574359%252Fexterior_rear_passenger-1774785066360.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/15574359/exterior_rear_passenger-1774785066360.jpg saved to cache
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bcbd7114-8d3d-5c5f-bac0-115233c0bb9b
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db7c510>
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5b7c-0991-541e-8e0f-a466dfa480f2/5bea5b7c-0991-541e-8e0f-a466dfa480f2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1492%252F16001492%252Finstrument_cluster-1774616772095.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1492/16001492/instrument_cluster-1774616772095.jpg saved to cache
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5bea5b7c-0991-541e-8e0f-a466dfa480f2
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0d1310>
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5b7c-0991-541e-8e0f-a466dfa480f2/5bea5b7c-0991-541e-8e0f-a466dfa480f2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1492%252F16001492%252Finterior_boot-1774616688198.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1492/16001492/interior_boot-1774616688198.jpg saved to cache
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5bea5b7c-0991-541e-8e0f-a466dfa480f2
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 18086482
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718086482%27 HTTP/1.1" 200 None
2026-03-29 20:11:09 [motorway.uk] INFO: Scrape type for 18086482: 1
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c828cd0>
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5b7c-0991-541e-8e0f-a466dfa480f2/5bea5b7c-0991-541e-8e0f-a466dfa480f2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1492%252F16001492%252Fexterior_front_passenger-1774616438083.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1492/16001492/exterior_front_passenger-1774616438083.jpg saved to cache
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bea5b7c-0991-541e-8e0f-a466dfa480f2
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 19449183
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 20485669
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485669%27 HTTP/1.1" 200 None
2026-03-29 20:11:09 [motorway.uk] INFO: Scrape type for 20485669: 1
2026-03-29 20:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 20451319
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 20410678
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720410678%27 HTTP/1.1" 200 None
2026-03-29 20:11:09 [motorway.uk] INFO: Scrape type for 20410678: 1
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 13676396
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 2387574
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%272387574%27 HTTP/1.1" 200 None
2026-03-29 20:11:09 [motorway.uk] INFO: Scrape type for 2387574: 1
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 13149221
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713149221%27 HTTP/1.1" 200 None
2026-03-29 20:11:09 [motorway.uk] INFO: Scrape type for 13149221: 1
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1492/16001492/interior_dashboard-1774616733277.jpg> (referer: None)
2026-03-29 20:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 20498874
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 19958948
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719958948%27 HTTP/1.1" 200 None
2026-03-29 20:11:09 [motorway.uk] INFO: Scrape type for 19958948: 1
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0247/20420247/interior_front_seats-1774362512212.jpg> (referer: None)
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 20435928
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 20487335
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487335%27 HTTP/1.1" 200 None
2026-03-29 20:11:09 [motorway.uk] INFO: Scrape type for 20487335: 1
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 20279875
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 11436867
2026-03-29 20:11:09 [motorway.uk] INFO: Found listing with ID: 20385406
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720385406%27 HTTP/1.1" 200 None
2026-03-29 20:11:10 [motorway.uk] INFO: Scrape type for 20385406: 1
2026-03-29 20:11:10 [motorway.uk] INFO: Found listing with ID: 19712537
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719712537%27 HTTP/1.1" 200 None
2026-03-29 20:11:10 [motorway.uk] INFO: Scrape type for 19712537: 1
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d549590>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5b7c-0991-541e-8e0f-a466dfa480f2/5bea5b7c-0991-541e-8e0f-a466dfa480f2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1492%252F16001492%252Finterior_dashboard-1774616733277.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1492/16001492/interior_dashboard-1774616733277.jpg saved to cache
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bea5b7c-0991-541e-8e0f-a466dfa480f2
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d109710>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8824cbff-dfc7-5fe7-a64f-9c8ccdc07dd6/8824cbff-dfc7-5fe7-a64f-9c8ccdc07dd6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0247%252F20420247%252Finterior_front_seats-1774362512212.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0247/20420247/interior_front_seats-1774362512212.jpg saved to cache
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8824cbff-dfc7-5fe7-a64f-9c8ccdc07dd6
2026-03-29 20:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8790/20398790/exterior_rear_passenger-1774696821317.jpg> (referer: None)
2026-03-29 20:11:10 [motorway.uk] INFO: Found listing with ID: 17056470
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717056470%27 HTTP/1.1" 200 None
2026-03-29 20:11:10 [motorway.uk] INFO: Scrape type for 17056470: 1
2026-03-29 20:11:10 [motorway.uk] INFO: Found listing with ID: 19080843
2026-03-29 20:11:10 [motorway.uk] INFO: Found listing with ID: 20261314
2026-03-29 20:11:10 [motorway.uk] INFO: Found listing with ID: 19037322
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719037322%27 HTTP/1.1" 200 None
2026-03-29 20:11:10 [motorway.uk] INFO: Scrape type for 19037322: 1
2026-03-29 20:11:10 [motorway.uk] INFO: Found listing with ID: 10154809
2026-03-29 20:11:10 [motorway.uk] INFO: Found listing with ID: 17587362
2026-03-29 20:11:10 [motorway.uk] INFO: Found listing with ID: 20488866
2026-03-29 20:11:10 [motorway.uk] INFO: Found listing with ID: 20475825
2026-03-29 20:11:10 [motorway.uk] INFO: Found listing with ID: 20485471
2026-03-29 20:11:10 [motorway.uk] INFO: Found listing with ID: 19631185
2026-03-29 20:11:10 [motorway.uk] INFO: Found listing with ID: 20482587
2026-03-29 20:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4359/15574359/interior_front_seats-1774787504945.jpg> (referer: None)
2026-03-29 20:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2267/20492267/docs_service_history-1774722400600.jpg?ixlib=js-3.8.0&auto=format&s=e3f479ff5da3c467c93035d759ed7684> (referer: None)
2026-03-29 20:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2267/20492267/interior_front_seats-1774722025853.jpg> (referer: None)
2026-03-29 20:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2267/20492267/interior_rear_seats-1774722037804.jpg> (referer: None)
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f63c650>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4b4e8b1-4d49-5821-a8ae-535e4e04c49b/f4b4e8b1-4d49-5821-a8ae-535e4e04c49b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8790%252F20398790%252Fexterior_rear_passenger-1774696821317.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8790/20398790/exterior_rear_passenger-1774696821317.jpg saved to cache
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4b4e8b1-4d49-5821-a8ae-535e4e04c49b
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f306cd0>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcbd7114-8d3d-5c5f-bac0-115233c0bb9b/bcbd7114-8d3d-5c5f-bac0-115233c0bb9b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4359%252F15574359%252Finterior_front_seats-1774787504945.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4359/15574359/interior_front_seats-1774787504945.jpg saved to cache
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bcbd7114-8d3d-5c5f-bac0-115233c0bb9b
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d58cbd0>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8d7f47-4c34-51af-9334-e5cb1872b8c7/ff8d7f47-4c34-51af-9334-e5cb1872b8c7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2267%252F20492267%252Fdocs_service_history-1774722400600.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De3f479ff5da3c467c93035d759ed7684') HTTP/1.1" 204 0
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2267/20492267/docs_service_history-1774722400600.jpg?ixlib=js-3.8.0&auto=format&s=e3f479ff5da3c467c93035d759ed7684 saved to cache
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff8d7f47-4c34-51af-9334-e5cb1872b8c7
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db6bf10>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8d7f47-4c34-51af-9334-e5cb1872b8c7/ff8d7f47-4c34-51af-9334-e5cb1872b8c7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2267%252F20492267%252Finterior_front_seats-1774722025853.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2267/20492267/interior_front_seats-1774722025853.jpg saved to cache
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff8d7f47-4c34-51af-9334-e5cb1872b8c7
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db6b610>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8d7f47-4c34-51af-9334-e5cb1872b8c7/ff8d7f47-4c34-51af-9334-e5cb1872b8c7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2267%252F20492267%252Finterior_rear_seats-1774722037804.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2267/20492267/interior_rear_seats-1774722037804.jpg saved to cache
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff8d7f47-4c34-51af-9334-e5cb1872b8c7
2026-03-29 20:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8790/20398790/interior_boot-1774698976277.jpg> (referer: None)
2026-03-29 20:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20388848.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8790/20398790/docs_service_history-1774699269578.jpg?ixlib=js-3.8.0&auto=format&s=a2fafd97e080d024de9b2c7d20c6d6bd> (referer: None)
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db6a710>
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4b4e8b1-4d49-5821-a8ae-535e4e04c49b/f4b4e8b1-4d49-5821-a8ae-535e4e04c49b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8790%252F20398790%252Finterior_boot-1774698976277.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8790/20398790/interior_boot-1774698976277.jpg saved to cache
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4b4e8b1-4d49-5821-a8ae-535e4e04c49b
2026-03-29 20:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11047706.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 005a35f8-228d-50ae-851f-26cf823f0b2c with identifier: 20388848
2026-03-29 20:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 005a35f8-228d-50ae-851f-26cf823f0b2c with scrape type 1
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 005a35f8-228d-50ae-851f-26cf823f0b2c
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8848%252F20388848%252Fexterior_front_driver-1774706303933.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8848/20388848/exterior_front_driver-1774706303933.jpg not downloaded yet
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1a72d0>
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4b4e8b1-4d49-5821-a8ae-535e4e04c49b/f4b4e8b1-4d49-5821-a8ae-535e4e04c49b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8790%252F20398790%252Fdocs_service_history-1774699269578.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da2fafd97e080d024de9b2c7d20c6d6bd') HTTP/1.1" 204 0
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8790/20398790/docs_service_history-1774699269578.jpg?ixlib=js-3.8.0&auto=format&s=a2fafd97e080d024de9b2c7d20c6d6bd saved to cache
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f4b4e8b1-4d49-5821-a8ae-535e4e04c49b
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8848%252F20388848%252Fexterior_rear_driver-1774706326625.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8848/20388848/exterior_rear_driver-1774706326625.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8848%252F20388848%252Fexterior_front_passenger-1774706365955.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8848/20388848/exterior_front_passenger-1774706365955.jpg not downloaded yet
2026-03-29 20:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce7910ce-247b-5399-83eb-eecf44b3fc65 with identifier: 11047706
2026-03-29 20:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce7910ce-247b-5399-83eb-eecf44b3fc65 with scrape type 1
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce7910ce-247b-5399-83eb-eecf44b3fc65
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7706%252F11047706%252Fexterior_front_driver-1774715672427.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7706/11047706/exterior_front_driver-1774715672427.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8848%252F20388848%252Fexterior_rear_passenger-1774706350097.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8848/20388848/exterior_rear_passenger-1774706350097.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7706%252F11047706%252Fexterior_rear_driver-1774715895095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7706/11047706/exterior_rear_driver-1774715895095.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8848%252F20388848%252Finterior_front_seats-1774707145806.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8848/20388848/interior_front_seats-1774707145806.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7706%252F11047706%252Fexterior_front_passenger-1774715841899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7706/11047706/exterior_front_passenger-1774715841899.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8848%252F20388848%252Finterior_rear_seats-1774707161224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8848/20388848/interior_rear_seats-1774707161224.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7706%252F11047706%252Fexterior_rear_passenger-1774715821116.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7706/11047706/exterior_rear_passenger-1774715821116.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8848%252F20388848%252Finterior_dashboard-1774707193392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8848/20388848/interior_dashboard-1774707193392.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7706%252F11047706%252Finterior_front_seats-1774716766388.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7706/11047706/interior_front_seats-1774716766388.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8848%252F20388848%252Finterior_boot-1774707256715.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8848/20388848/interior_boot-1774707256715.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7706%252F11047706%252Finterior_rear_seats-1774716786914.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7706/11047706/interior_rear_seats-1774716786914.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8848%252F20388848%252Fdocs_service_history-1774707435234.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db6aff0000fe1bcca197bb6186085cfaa%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8848/20388848/docs_service_history-1774707435234.jpg?ixlib=js-3.8.0&auto=format&s=b6aff0000fe1bcca197bb6186085cfaa not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7706%252F11047706%252Finterior_dashboard-1774716820117.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7706/11047706/interior_dashboard-1774716820117.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8848%252F20388848%252Fdocs_service_history-1774707444610.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db69fb87439237f7b7a66e85f6f036151%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8848/20388848/docs_service_history-1774707444610.jpg?ixlib=js-3.8.0&auto=format&s=b69fb87439237f7b7a66e85f6f036151 not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7706%252F11047706%252Finstrument_cluster-1774781215695.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7706/11047706/instrument_cluster-1774781215695.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7706%252F11047706%252Finterior_boot-1774716865140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7706/11047706/interior_boot-1774716865140.jpg not downloaded yet
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7706%252F11047706%252Fdocs_service_history-1774717013235.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D56042f026b03827c17e57c0b22d0e8a7%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7706/11047706/docs_service_history-1774717013235.jpg?ixlib=js-3.8.0&auto=format&s=56042f026b03827c17e57c0b22d0e8a7 not downloaded yet
2026-03-29 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8848/20388848/exterior_front_driver-1774706303933.jpg> (referer: None)
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d736690>
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_005a35f8-228d-50ae-851f-26cf823f0b2c/005a35f8-228d-50ae-851f-26cf823f0b2c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8848%252F20388848%252Fexterior_front_driver-1774706303933.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8848/20388848/exterior_front_driver-1774706303933.jpg saved to cache
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 005a35f8-228d-50ae-851f-26cf823f0b2c
2026-03-29 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7706/11047706/docs_service_history-1774717013235.jpg?ixlib=js-3.8.0&auto=format&s=56042f026b03827c17e57c0b22d0e8a7> (referer: None)
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6d8bd0>
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7910ce-247b-5399-83eb-eecf44b3fc65/ce7910ce-247b-5399-83eb-eecf44b3fc65_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7706%252F11047706%252Fdocs_service_history-1774717013235.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D56042f026b03827c17e57c0b22d0e8a7') HTTP/1.1" 204 0
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7706/11047706/docs_service_history-1774717013235.jpg?ixlib=js-3.8.0&auto=format&s=56042f026b03827c17e57c0b22d0e8a7 saved to cache
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce7910ce-247b-5399-83eb-eecf44b3fc65
2026-03-29 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19861645.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 440536e8-54bc-5f3d-820c-1ad260f8c15e with identifier: 19861645
2026-03-29 20:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 440536e8-54bc-5f3d-820c-1ad260f8c15e with scrape type 1
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 440536e8-54bc-5f3d-820c-1ad260f8c15e
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1645%252F19861645%252Fexterior_front_driver-1774694898387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1645/19861645/exterior_front_driver-1774694898387.jpg not downloaded yet
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1645%252F19861645%252Fexterior_rear_driver-1774694902770.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1645/19861645/exterior_rear_driver-1774694902770.jpg not downloaded yet
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1645%252F19861645%252Fexterior_front_passenger-1774694891617.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1645/19861645/exterior_front_passenger-1774694891617.jpg not downloaded yet
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1645%252F19861645%252Fexterior_rear_passenger-1774697939233.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1645/19861645/exterior_rear_passenger-1774697939233.jpg not downloaded yet
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1645%252F19861645%252Finterior_front_seats-1774695313913.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1645/19861645/interior_front_seats-1774695313913.jpg not downloaded yet
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1645%252F19861645%252Finterior_rear_seats-1774695312226.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1645/19861645/interior_rear_seats-1774695312226.jpg not downloaded yet
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1645%252F19861645%252Finterior_dashboard-1774695317121.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1645/19861645/interior_dashboard-1774695317121.jpg not downloaded yet
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1645%252F19861645%252Finstrument_cluster-1774695340864.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1645/19861645/instrument_cluster-1774695340864.jpg not downloaded yet
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1645%252F19861645%252Finterior_boot-1774697955325.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1645/19861645/interior_boot-1774697955325.jpg not downloaded yet
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1645%252F19861645%252Fwheels_front_driver-1774695000524.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1645/19861645/wheels_front_driver-1774695000524.jpg not downloaded yet
2026-03-29 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7706/11047706/interior_boot-1774716865140.jpg> (referer: None)
2026-03-29 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8203355.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7706/11047706/instrument_cluster-1774781215695.jpg> (referer: None)
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d281390>
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7910ce-247b-5399-83eb-eecf44b3fc65/ce7910ce-247b-5399-83eb-eecf44b3fc65_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7706%252F11047706%252Finterior_boot-1774716865140.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7706/11047706/interior_boot-1774716865140.jpg saved to cache
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce7910ce-247b-5399-83eb-eecf44b3fc65
2026-03-29 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20299221.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa685496-ce0f-5774-a7fa-ccfce240244e with identifier: 8203355
2026-03-29 20:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa685496-ce0f-5774-a7fa-ccfce240244e with scrape type 1
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa685496-ce0f-5774-a7fa-ccfce240244e
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3355%252F8203355%252Fexterior_front_driver-1774711618067.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3355/8203355/exterior_front_driver-1774711618067.jpg not downloaded yet
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc61610>
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7910ce-247b-5399-83eb-eecf44b3fc65/ce7910ce-247b-5399-83eb-eecf44b3fc65_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7706%252F11047706%252Finstrument_cluster-1774781215695.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7706/11047706/instrument_cluster-1774781215695.jpg saved to cache
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce7910ce-247b-5399-83eb-eecf44b3fc65
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3355%252F8203355%252Fexterior_rear_driver-1774711680356.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3355/8203355/exterior_rear_driver-1774711680356.jpg not downloaded yet
2026-03-29 20:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 942b0137-4c91-5212-a508-0187f7ce8de3 with identifier: 20299221
2026-03-29 20:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 942b0137-4c91-5212-a508-0187f7ce8de3 with scrape type 1
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 942b0137-4c91-5212-a508-0187f7ce8de3
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F20299221%252Fexterior_front_driver-1774101993482.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/20299221/exterior_front_driver-1774101993482.jpg not downloaded yet
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3355%252F8203355%252Fexterior_front_passenger-1774711724347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3355/8203355/exterior_front_passenger-1774711724347.jpg not downloaded yet
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F20299221%252Fexterior_rear_driver-1774102013871.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/20299221/exterior_rear_driver-1774102013871.jpg not downloaded yet
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3355%252F8203355%252Fexterior_rear_passenger-1774711693255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3355/8203355/exterior_rear_passenger-1774711693255.jpg not downloaded yet
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F20299221%252Fexterior_front_passenger-1774102053422.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/20299221/exterior_front_passenger-1774102053422.jpg not downloaded yet
2026-03-29 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18086482.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3355%252F8203355%252Finterior_front_seats-1774710620797.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3355/8203355/interior_front_seats-1774710620797.jpg not downloaded yet
2026-03-29 20:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1645/19861645/wheels_front_driver-1774695000524.jpg> (referer: None)
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F20299221%252Fexterior_rear_passenger-1774102031928.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/20299221/exterior_rear_passenger-1774102031928.jpg not downloaded yet
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3355%252F8203355%252Finterior_rear_seats-1774710668185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3355/8203355/interior_rear_seats-1774710668185.jpg not downloaded yet
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9221%252F20299221%252Finterior_front_seats-1774102754486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9221/20299221/interior_front_seats-1774102754486.jpg not downloaded yet
2026-03-29 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1645/19861645/interior_boot-1774697955325.jpg> (referer: None)
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3355%252F8203355%252Finterior_dashboard-1774710661632.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3355/8203355/interior_dashboard-1774710661632.jpg not downloaded yet
2026-03-29 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/2387574.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9221%252F20299221%252Finterior_rear_seats-1774103176348.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9221/20299221/interior_rear_seats-1774103176348.jpg not downloaded yet
2026-03-29 20:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3355%252F8203355%252Finterior_boot-1774710659509.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3355/8203355/interior_boot-1774710659509.jpg not downloaded yet
2026-03-29 20:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a46ed00-c645-5781-8b3c-dba182fa250c with identifier: 18086482
2026-03-29 20:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a46ed00-c645-5781-8b3c-dba182fa250c with scrape type 1
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a46ed00-c645-5781-8b3c-dba182fa250c
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6482%252F18086482%252Fexterior_front_driver-1774529613714.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_front_driver-1774529613714.jpeg not downloaded yet
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9221%252F20299221%252Finterior_dashboard-1774634218899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9221/20299221/interior_dashboard-1774634218899.jpg not downloaded yet
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3355%252F8203355%252Fdocs_service_history-1774711407242.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3d51464ce8ffae89b72e3515ba3b2796%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3355/8203355/docs_service_history-1774711407242.jpg?ixlib=js-3.8.0&auto=format&s=3d51464ce8ffae89b72e3515ba3b2796 not downloaded yet
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6482%252F18086482%252Fexterior_rear_driver-1774529675118.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_rear_driver-1774529675118.jpeg not downloaded yet
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6c0690>
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_440536e8-54bc-5f3d-820c-1ad260f8c15e/440536e8-54bc-5f3d-820c-1ad260f8c15e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1645%252F19861645%252Fwheels_front_driver-1774695000524.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1645/19861645/wheels_front_driver-1774695000524.jpg saved to cache
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 440536e8-54bc-5f3d-820c-1ad260f8c15e
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9221%252F20299221%252Finterior_boot-1774103119981.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9221/20299221/interior_boot-1774103119981.jpg not downloaded yet
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3355%252F8203355%252Fdocs_service_history-1774711410962.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5cdb3fb7a74cc5df1716da33923de0e0%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3355/8203355/docs_service_history-1774711410962.jpg?ixlib=js-3.8.0&auto=format&s=5cdb3fb7a74cc5df1716da33923de0e0 not downloaded yet
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6482%252F18086482%252Fexterior_front_passenger-1774529631130.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_front_passenger-1774529631130.jpeg not downloaded yet
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6ec7d0>
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_440536e8-54bc-5f3d-820c-1ad260f8c15e/440536e8-54bc-5f3d-820c-1ad260f8c15e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1645%252F19861645%252Finterior_boot-1774697955325.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1645/19861645/interior_boot-1774697955325.jpg saved to cache
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 440536e8-54bc-5f3d-820c-1ad260f8c15e
2026-03-29 20:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86b77ad5-ea3b-5379-8233-b1bd60475650 with identifier: 2387574
2026-03-29 20:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86b77ad5-ea3b-5379-8233-b1bd60475650 with scrape type 1
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86b77ad5-ea3b-5379-8233-b1bd60475650
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7574%252F2387574%252Fexterior_front_driver-1774720773499.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_front_driver-1774720773499.jpg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9221%252F20299221%252Fdocs_service_history-1774637501301.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D178cbd0a5f59b3f39cdc5a88227e7fd9%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9221/20299221/docs_service_history-1774637501301.jpg?ixlib=js-3.8.0&auto=format&s=178cbd0a5f59b3f39cdc5a88227e7fd9 not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6482%252F18086482%252Fexterior_rear_passenger-1774529679016.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_rear_passenger-1774529679016.jpeg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7574%252F2387574%252Fexterior_rear_driver-1774720855142.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_rear_driver-1774720855142.jpg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9221%252F20299221%252Fdocs_service_history-1774637501924.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd731a07719f69f1d818224e8a03934ca%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9221/20299221/docs_service_history-1774637501924.jpg?ixlib=js-3.8.0&auto=format&s=d731a07719f69f1d818224e8a03934ca not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6482%252F18086482%252Finterior_front_seats-1774548649613.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6482/18086482/interior_front_seats-1774548649613.jpeg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7574%252F2387574%252Fexterior_front_passenger-1774720939472.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_front_passenger-1774720939472.jpg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6482%252F18086482%252Finterior_rear_seats-1774547992089.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6482/18086482/interior_rear_seats-1774547992089.jpeg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7574%252F2387574%252Fexterior_rear_passenger-1774720900921.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_rear_passenger-1774720900921.jpg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6482%252F18086482%252Finterior_dashboard-1774548017634.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6482/18086482/interior_dashboard-1774548017634.jpeg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7574%252F2387574%252Finterior_front_seats-1774721995839.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7574/2387574/interior_front_seats-1774721995839.jpg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6482%252F18086482%252Finstrument_cluster-1774548060308.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6482/18086482/instrument_cluster-1774548060308.jpeg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7574%252F2387574%252Finterior_rear_seats-1774722032777.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7574/2387574/interior_rear_seats-1774722032777.jpg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6482%252F18086482%252Finterior_boot-1774548416009.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6482/18086482/interior_boot-1774548416009.jpeg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7574%252F2387574%252Finterior_dashboard-1774777108983.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7574/2387574/interior_dashboard-1774777108983.jpg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6482%252F18086482%252Fdocs_service_history-1774528473649.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D167fee3bd9ca14a53a176ae057a26f51%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6482/18086482/docs_service_history-1774528473649.jpeg?ixlib=js-3.8.0&auto=format&s=167fee3bd9ca14a53a176ae057a26f51 not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7574%252F2387574%252Finstrument_cluster-1774721942367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7574/2387574/instrument_cluster-1774721942367.jpg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7574%252F2387574%252Finterior_boot-1774721941358.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7574/2387574/interior_boot-1774721941358.jpg not downloaded yet
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7574%252F2387574%252Fdocs_service_history-1774778768428.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6466645abc8733a8840783f002818d25%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7574/2387574/docs_service_history-1774778768428.jpg?ixlib=js-3.8.0&auto=format&s=6466645abc8733a8840783f002818d25 not downloaded yet
2026-03-29 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9221/20299221/exterior_front_passenger-1774102053422.jpg> (referer: None)
2026-03-29 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3355/8203355/exterior_rear_passenger-1774711693255.jpg> (referer: None)
2026-03-29 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19712537.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1645/19861645/instrument_cluster-1774695340864.jpg> (referer: None)
2026-03-29 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3355/8203355/interior_rear_seats-1774710668185.jpg> (referer: None)
2026-03-29 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9221/20299221/interior_front_seats-1774102754486.jpg> (referer: None)
2026-03-29 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1645/19861645/interior_dashboard-1774695317121.jpg> (referer: None)
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dcddc50>
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942b0137-4c91-5212-a508-0187f7ce8de3/942b0137-4c91-5212-a508-0187f7ce8de3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F20299221%252Fexterior_front_passenger-1774102053422.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/20299221/exterior_front_passenger-1774102053422.jpg saved to cache
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 942b0137-4c91-5212-a508-0187f7ce8de3
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d744c90>
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa685496-ce0f-5774-a7fa-ccfce240244e/fa685496-ce0f-5774-a7fa-ccfce240244e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3355%252F8203355%252Fexterior_rear_passenger-1774711693255.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3355/8203355/exterior_rear_passenger-1774711693255.jpg saved to cache
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa685496-ce0f-5774-a7fa-ccfce240244e
2026-03-29 20:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350 with identifier: 19712537
2026-03-29 20:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350 with scrape type 1
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2537%252F19712537%252Fexterior_front_driver-1774635743389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_front_driver-1774635743389.jpg not downloaded yet
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xc0'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'2201117TY\x00'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x90'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 172 - value: b'Xiaomi\x00'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xc7'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 179 - value: b'2026:03:28 10:53:26\x00'
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5ee510>
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_440536e8-54bc-5f3d-820c-1ad260f8c15e/440536e8-54bc-5f3d-820c-1ad260f8c15e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1645%252F19861645%252Finstrument_cluster-1774695340864.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1645/19861645/instrument_cluster-1774695340864.jpg saved to cache
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 440536e8-54bc-5f3d-820c-1ad260f8c15e
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e190c90>
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa685496-ce0f-5774-a7fa-ccfce240244e/fa685496-ce0f-5774-a7fa-ccfce240244e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3355%252F8203355%252Finterior_rear_seats-1774710668185.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3355/8203355/interior_rear_seats-1774710668185.jpg saved to cache
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa685496-ce0f-5774-a7fa-ccfce240244e
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2817d0>
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942b0137-4c91-5212-a508-0187f7ce8de3/942b0137-4c91-5212-a508-0187f7ce8de3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9221%252F20299221%252Finterior_front_seats-1774102754486.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9221/20299221/interior_front_seats-1774102754486.jpg saved to cache
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 942b0137-4c91-5212-a508-0187f7ce8de3
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xc0'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'2201117TY\x00'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x90'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 172 - value: b'Xiaomi\x00'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xc7'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 179 - value: b'2026:03:28 10:54:47\x00'
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f35fdd0>
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_440536e8-54bc-5f3d-820c-1ad260f8c15e/440536e8-54bc-5f3d-820c-1ad260f8c15e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1645%252F19861645%252Finterior_dashboard-1774695317121.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1645/19861645/interior_dashboard-1774695317121.jpg saved to cache
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 440536e8-54bc-5f3d-820c-1ad260f8c15e
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7574/2387574/docs_service_history-1774778768428.jpg?ixlib=js-3.8.0&auto=format&s=6466645abc8733a8840783f002818d25> (referer: None)
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2537%252F19712537%252Fexterior_rear_driver-1774635760685.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_rear_driver-1774635760685.jpg not downloaded yet
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2537%252F19712537%252Fexterior_front_passenger-1774635787558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_front_passenger-1774635787558.jpg not downloaded yet
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2537%252F19712537%252Fexterior_rear_passenger-1774635773978.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_rear_passenger-1774635773978.jpg not downloaded yet
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2537%252F19712537%252Finterior_front_seats-1774636388170.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2537/19712537/interior_front_seats-1774636388170.jpg not downloaded yet
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2537%252F19712537%252Finterior_rear_seats-1774636414577.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2537/19712537/interior_rear_seats-1774636414577.jpg not downloaded yet
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c818a10>
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7574%252F2387574%252Fdocs_service_history-1774778768428.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6466645abc8733a8840783f002818d25') HTTP/1.1" 204 0
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7574/2387574/docs_service_history-1774778768428.jpg?ixlib=js-3.8.0&auto=format&s=6466645abc8733a8840783f002818d25 saved to cache
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86b77ad5-ea3b-5379-8233-b1bd60475650
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2537%252F19712537%252Finterior_dashboard-1774636287999.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2537/19712537/interior_dashboard-1774636287999.jpg not downloaded yet
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17056470.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2537%252F19712537%252Finstrument_cluster-1774636158659.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2537/19712537/instrument_cluster-1774636158659.jpg not downloaded yet
2026-03-29 20:11:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2537%252F19712537%252Finterior_boot-1774636162819.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2537/19712537/interior_boot-1774636162819.jpg not downloaded yet
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19037322.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2537%252F19712537%252Fdocs_service_history-1774636592496.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dde0274bd5e98c7473ff96b66f3a0243c%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2537/19712537/docs_service_history-1774636592496.jpg?ixlib=js-3.8.0&auto=format&s=de0274bd5e98c7473ff96b66f3a0243c not downloaded yet
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7574/2387574/interior_boot-1774721941358.jpg> (referer: None)
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7574/2387574/instrument_cluster-1774721942367.jpg> (referer: None)
2026-03-29 20:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8362c7f9-62dd-5694-8a67-24b5b163ea52 with identifier: 17056470
2026-03-29 20:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8362c7f9-62dd-5694-8a67-24b5b163ea52 with scrape type 1
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8362c7f9-62dd-5694-8a67-24b5b163ea52
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6470%252F17056470%252Fexterior_front_driver-1774621223557.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_front_driver-1774621223557.jpg not downloaded yet
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6470%252F17056470%252Fexterior_rear_driver-1774621229213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_rear_driver-1774621229213.jpg not downloaded yet
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6470%252F17056470%252Fexterior_front_passenger-1774621529832.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_front_passenger-1774621529832.jpg not downloaded yet
2026-03-29 20:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e266f3ce-ab13-5f2e-8ed9-7d29617b66ba with identifier: 19037322
2026-03-29 20:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba with scrape type 1
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7322%252F19037322%252Fexterior_front_driver-1771166515858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7322/19037322/exterior_front_driver-1771166515858.jpg not downloaded yet
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6470%252F17056470%252Fexterior_rear_passenger-1774621228283.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_rear_passenger-1774621228283.jpg not downloaded yet
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7322%252F19037322%252Fexterior_rear_driver-1771161903892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7322/19037322/exterior_rear_driver-1771161903892.jpg not downloaded yet
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6470%252F17056470%252Finterior_front_seats-1774622091760.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6470/17056470/interior_front_seats-1774622091760.jpg not downloaded yet
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7322%252F19037322%252Fexterior_front_passenger-1771161928697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7322/19037322/exterior_front_passenger-1771161928697.jpg not downloaded yet
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35735cd0>
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7574%252F2387574%252Finterior_boot-1774721941358.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7574/2387574/interior_boot-1774721941358.jpg saved to cache
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86b77ad5-ea3b-5379-8233-b1bd60475650
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddbfd50>
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7574%252F2387574%252Finstrument_cluster-1774721942367.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7574/2387574/instrument_cluster-1774721942367.jpg saved to cache
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86b77ad5-ea3b-5379-8233-b1bd60475650
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6470%252F17056470%252Finterior_rear_seats-1774690238371.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6470/17056470/interior_rear_seats-1774690238371.jpg not downloaded yet
2026-03-29 20:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20385406.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7322%252F19037322%252Fexterior_rear_passenger-1771161918503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7322/19037322/exterior_rear_passenger-1771161918503.jpg not downloaded yet
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6470%252F17056470%252Finterior_dashboard-1774622182896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6470/17056470/interior_dashboard-1774622182896.jpg not downloaded yet
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7322%252F19037322%252Finterior_front_seats-1771162437922.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7322/19037322/interior_front_seats-1771162437922.jpg not downloaded yet
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6470%252F17056470%252Finstrument_cluster-1774622032588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6470/17056470/instrument_cluster-1774622032588.jpg not downloaded yet
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7322%252F19037322%252Finterior_rear_seats-1771162481742.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7322/19037322/interior_rear_seats-1771162481742.jpg not downloaded yet
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6470%252F17056470%252Finterior_boot-1774622087592.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6470/17056470/interior_boot-1774622087592.jpg not downloaded yet
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7322%252F19037322%252Finterior_dashboard-1771167192727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7322/19037322/interior_dashboard-1771167192727.jpg not downloaded yet
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6470%252F17056470%252Fdocs_service_history-1774622523664.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D57acacda30c5a47430821f3c44b8ef6b%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6470/17056470/docs_service_history-1774622523664.jpg?ixlib=js-3.8.0&auto=format&s=57acacda30c5a47430821f3c44b8ef6b not downloaded yet
2026-03-29 20:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2b529d9-2b05-5f20-9b42-1eb51eec967d with identifier: 20385406
2026-03-29 20:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2b529d9-2b05-5f20-9b42-1eb51eec967d with scrape type 1
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2b529d9-2b05-5f20-9b42-1eb51eec967d
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5406%252F20385406%252Fexterior_front_driver-1774167672295.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_front_driver-1774167672295.jpg not downloaded yet
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7322%252F19037322%252Finstrument_cluster-1771162405659.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7322/19037322/instrument_cluster-1771162405659.jpg not downloaded yet
2026-03-29 20:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_front_driver-1774635743389.jpg> (referer: None)
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5406%252F20385406%252Fexterior_rear_driver-1774167696251.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_rear_driver-1774167696251.jpg not downloaded yet
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7322%252F19037322%252Finterior_boot-1771162515801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7322/19037322/interior_boot-1771162515801.jpg not downloaded yet
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5406%252F20385406%252Fexterior_front_passenger-1774167749653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_front_passenger-1774167749653.jpg not downloaded yet
2026-03-29 20:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_rear_driver-1774635760685.jpg> (referer: None)
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F7322%252F19037322%252Fdocs_service_history-1771163066154.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df817c5dd82f45b2bef7ad4bbbad372c0%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/7322/19037322/docs_service_history-1771163066154.jpg?ixlib=js-3.8.0&auto=format&s=f817c5dd82f45b2bef7ad4bbbad372c0 not downloaded yet
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5406%252F20385406%252Fexterior_rear_passenger-1774167781309.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_rear_passenger-1774167781309.jpg not downloaded yet
2026-03-29 20:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7574/2387574/interior_dashboard-1774777108983.jpg> (referer: None)
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5406%252F20385406%252Finterior_front_seats-1774775918110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5406/20385406/interior_front_seats-1774775918110.jpg not downloaded yet
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc6ebd0>
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2537%252F19712537%252Fexterior_front_driver-1774635743389.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_front_driver-1774635743389.jpg saved to cache
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350
2026-03-29 20:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2537/19712537/interior_dashboard-1774636287999.jpg> (referer: None)
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5406%252F20385406%252Finterior_rear_seats-1774168040097.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5406/20385406/interior_rear_seats-1774168040097.jpg not downloaded yet
2026-03-29 20:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19958948.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5406%252F20385406%252Finterior_dashboard-1774168833400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5406/20385406/interior_dashboard-1774168833400.jpg not downloaded yet
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4b8610>
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2537%252F19712537%252Fexterior_rear_driver-1774635760685.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_rear_driver-1774635760685.jpg saved to cache
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d255910>
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7574%252F2387574%252Finterior_dashboard-1774777108983.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7574/2387574/interior_dashboard-1774777108983.jpg saved to cache
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86b77ad5-ea3b-5379-8233-b1bd60475650
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5406%252F20385406%252F20385406-instrument_cluster-modified-1774777120511.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5406/20385406/20385406-instrument_cluster-modified-1774777120511.jpeg not downloaded yet
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5406%252F20385406%252Finterior_boot-1774168076244.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5406/20385406/interior_boot-1774168076244.jpg not downloaded yet
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1e1310>
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2537%252F19712537%252Finterior_dashboard-1774636287999.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2537/19712537/interior_dashboard-1774636287999.jpg saved to cache
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350
2026-03-29 20:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1df9c72-299c-5dd5-bd21-e30a2cd980bc with identifier: 19958948
2026-03-29 20:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc with scrape type 1
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8948%252F19958948%252Fexterior_front_driver-1774712675997.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8948/19958948/exterior_front_driver-1774712675997.jpg not downloaded yet
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5406%252F20385406%252Fwheels_front_driver-1774167802312.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5406/20385406/wheels_front_driver-1774167802312.jpg not downloaded yet
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8948%252F19958948%252Fexterior_rear_driver-1774712677320.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8948/19958948/exterior_rear_driver-1774712677320.jpg not downloaded yet
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8948%252F19958948%252Fexterior_front_passenger-1774715184800.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8948/19958948/exterior_front_passenger-1774715184800.jpg not downloaded yet
2026-03-29 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2537/19712537/docs_service_history-1774636592496.jpg?ixlib=js-3.8.0&auto=format&s=de0274bd5e98c7473ff96b66f3a0243c> (referer: None)
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8948%252F19958948%252Fexterior_rear_passenger-1774715043607.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8948/19958948/exterior_rear_passenger-1774715043607.jpg not downloaded yet
2026-03-29 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2537/19712537/instrument_cluster-1774636158659.jpg> (referer: None)
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8948%252F19958948%252Finterior_front_seats-1774713692718.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8948/19958948/interior_front_seats-1774713692718.jpg not downloaded yet
2026-03-29 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2537/19712537/interior_boot-1774636162819.jpg> (referer: None)
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8948%252F19958948%252Finterior_rear_seats-1774713690086.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8948/19958948/interior_rear_seats-1774713690086.jpg not downloaded yet
2026-03-29 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6482/18086482/interior_boot-1774548416009.jpeg> (referer: None)
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8948%252F19958948%252Finterior_dashboard-1774713703434.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8948/19958948/interior_dashboard-1774713703434.jpg not downloaded yet
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8948%252F19958948%252Finstrument_cluster-1774713662873.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8948/19958948/instrument_cluster-1774713662873.jpg not downloaded yet
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c68de50>
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2537%252F19712537%252Fdocs_service_history-1774636592496.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dde0274bd5e98c7473ff96b66f3a0243c') HTTP/1.1" 204 0
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2537/19712537/docs_service_history-1774636592496.jpg?ixlib=js-3.8.0&auto=format&s=de0274bd5e98c7473ff96b66f3a0243c saved to cache
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8948%252F19958948%252Finterior_boot-1774713691891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8948/19958948/interior_boot-1774713691891.jpg not downloaded yet
2026-03-29 20:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6482/18086482/docs_service_history-1774528473649.jpeg?ixlib=js-3.8.0&auto=format&s=167fee3bd9ca14a53a176ae057a26f51> (referer: None)
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5abb10>
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2537%252F19712537%252Finstrument_cluster-1774636158659.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2537/19712537/instrument_cluster-1774636158659.jpg saved to cache
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350
2026-03-29 20:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_front_driver-1774167672295.jpg> (referer: None)
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8948%252F19958948%252Fdocs_service_history-1774713892675.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcd08e0e1691f5511be7ace91ba344348%27 HTTP/1.1" 200 None
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8948/19958948/docs_service_history-1774713892675.jpg?ixlib=js-3.8.0&auto=format&s=cd08e0e1691f5511be7ace91ba344348 not downloaded yet
2026-03-29 20:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7322/19037322/exterior_front_passenger-1771161928697.jpg> (referer: None)
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da86d50>
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2537%252F19712537%252Finterior_boot-1774636162819.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2537/19712537/interior_boot-1774636162819.jpg saved to cache
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00)\xbc\x96\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xe4\x04\x00)\xb2\x92\x00\x00\x00\x00'
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db48d50>
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6482%252F18086482%252Finterior_boot-1774548416009.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6482/18086482/interior_boot-1774548416009.jpeg saved to cache
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a46ed00-c645-5781-8b3c-dba182fa250c
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db491d0>
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6482%252F18086482%252Fdocs_service_history-1774528473649.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D167fee3bd9ca14a53a176ae057a26f51') HTTP/1.1" 204 0
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6482/18086482/docs_service_history-1774528473649.jpeg?ixlib=js-3.8.0&auto=format&s=167fee3bd9ca14a53a176ae057a26f51 saved to cache
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a46ed00-c645-5781-8b3c-dba182fa250c
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8e7390>
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5406%252F20385406%252Fexterior_front_driver-1774167672295.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_front_driver-1774167672295.jpg saved to cache
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2b529d9-2b05-5f20-9b42-1eb51eec967d
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9604d0>
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7322%252F19037322%252Fexterior_front_passenger-1771161928697.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7322/19037322/exterior_front_passenger-1771161928697.jpg saved to cache
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba
2026-03-29 20:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13149221.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_rear_passenger-1774167781309.jpg> (referer: None)
2026-03-29 20:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5406/20385406/interior_dashboard-1774168833400.jpg> (referer: None)
2026-03-29 20:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8948/19958948/exterior_rear_driver-1774712677320.jpg> (referer: None)
2026-03-29 20:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8948/19958948/exterior_front_passenger-1774715184800.jpg> (referer: None)
2026-03-29 20:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5406/20385406/interior_rear_seats-1774168040097.jpg> (referer: None)
2026-03-29 20:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5406/20385406/interior_front_seats-1774775918110.jpg> (referer: None)
2026-03-29 20:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34dfd78f-ff08-5e82-8fe7-e1eb41058507 with identifier: 13149221
2026-03-29 20:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507 with scrape type 1
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F13149221%252Fexterior_front_driver-1774697994511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_front_driver-1774697994511.jpg not downloaded yet
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F13149221%252Fexterior_rear_driver-1774698012286.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_rear_driver-1774698012286.jpg not downloaded yet
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487335.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F13149221%252Fexterior_front_passenger-1774698039788.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_front_passenger-1774698039788.jpg not downloaded yet
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da850d0>
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5406%252F20385406%252Fexterior_rear_passenger-1774167781309.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_rear_passenger-1774167781309.jpg saved to cache
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2b529d9-2b05-5f20-9b42-1eb51eec967d
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5ed810>
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5406%252F20385406%252Finterior_dashboard-1774168833400.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5406/20385406/interior_dashboard-1774168833400.jpg saved to cache
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2b529d9-2b05-5f20-9b42-1eb51eec967d
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d177890>
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8948%252F19958948%252Fexterior_rear_driver-1774712677320.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8948/19958948/exterior_rear_driver-1774712677320.jpg saved to cache
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dde6750>
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8948%252F19958948%252Fexterior_front_passenger-1774715184800.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8948/19958948/exterior_front_passenger-1774715184800.jpg saved to cache
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc
2026-03-29 20:11:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cec6e50>
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5406%252F20385406%252Finterior_rear_seats-1774168040097.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5406/20385406/interior_rear_seats-1774168040097.jpg saved to cache
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2b529d9-2b05-5f20-9b42-1eb51eec967d
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3e2f90>
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5406%252F20385406%252Finterior_front_seats-1774775918110.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5406/20385406/interior_front_seats-1774775918110.jpg saved to cache
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2b529d9-2b05-5f20-9b42-1eb51eec967d
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F13149221%252Fexterior_rear_passenger-1774698029899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_rear_passenger-1774698029899.jpg not downloaded yet
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9221%252F13149221%252Finterior_front_seats-1774698598401.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9221/13149221/interior_front_seats-1774698598401.jpg not downloaded yet
2026-03-29 20:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7b6166-a3ba-5087-ae78-c996958a17f7 with identifier: 20487335
2026-03-29 20:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7b6166-a3ba-5087-ae78-c996958a17f7 with scrape type 1
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f7b6166-a3ba-5087-ae78-c996958a17f7
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7335%252F20487335%252Fexterior_front_driver-1774708703977.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_front_driver-1774708703977.jpg not downloaded yet
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9221%252F13149221%252Finterior_rear_seats-1774698665675.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9221/13149221/interior_rear_seats-1774698665675.jpg not downloaded yet
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7335%252F20487335%252Fexterior_rear_driver-1774708733341.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_rear_driver-1774708733341.jpg not downloaded yet
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F13149221%252Finterior_dashboard-1774698639852.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/13149221/interior_dashboard-1774698639852.jpg not downloaded yet
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7335%252F20487335%252Fexterior_front_passenger-1774708777803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_front_passenger-1774708777803.jpg not downloaded yet
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F13149221%252Finstrument_cluster-1774698778399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/13149221/instrument_cluster-1774698778399.jpg not downloaded yet
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7335%252F20487335%252Fexterior_rear_passenger-1774708759953.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_rear_passenger-1774708759953.jpg not downloaded yet
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9221%252F13149221%252Finterior_boot-1774698643378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9221/13149221/interior_boot-1774698643378.jpg not downloaded yet
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7335%252F20487335%252Finterior_front_seats-1774709336207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7335/20487335/interior_front_seats-1774709336207.jpg not downloaded yet
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9221%252F13149221%252Fdocs_service_history-1774700525529.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6df5225175d05cee73ad934fd6d95711%27 HTTP/1.1" 200 None
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9221/13149221/docs_service_history-1774700525529.jpg?ixlib=js-3.8.0&auto=format&s=6df5225175d05cee73ad934fd6d95711 not downloaded yet
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7335%252F20487335%252Finterior_rear_seats-1774709315748.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7335/20487335/interior_rear_seats-1774709315748.jpg not downloaded yet
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7335%252F20487335%252Finterior_dashboard-1774709309617.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7335/20487335/interior_dashboard-1774709309617.jpg not downloaded yet
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7335%252F20487335%252Finterior_boot-1774709281583.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7335/20487335/interior_boot-1774709281583.jpg not downloaded yet
2026-03-29 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8948/19958948/interior_front_seats-1774713692718.jpg> (referer: None)
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7335%252F20487335%252Fdocs_service_history-1774709512066.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ed6df222dbdabeb34fad39ec2e43a7b%27 HTTP/1.1" 200 None
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7335/20487335/docs_service_history-1774709512066.jpg?ixlib=js-3.8.0&auto=format&s=3ed6df222dbdabeb34fad39ec2e43a7b not downloaded yet
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7335%252F20487335%252Fdocs_service_history-1774709527721.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd810083de0f4bc378fe66e62c5ddffda%27 HTTP/1.1" 200 None
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7335/20487335/docs_service_history-1774709527721.jpg?ixlib=js-3.8.0&auto=format&s=d810083de0f4bc378fe66e62c5ddffda not downloaded yet
2026-03-29 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8948/19958948/exterior_rear_passenger-1774715043607.jpg> (referer: None)
2026-03-29 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8948/19958948/exterior_front_driver-1774712675997.jpg> (referer: None)
2026-03-29 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8948/19958948/interior_rear_seats-1774713690086.jpg> (referer: None)
2026-03-29 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8948/19958948/instrument_cluster-1774713662873.jpg> (referer: None)
2026-03-29 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8948/19958948/docs_service_history-1774713892675.jpg?ixlib=js-3.8.0&auto=format&s=cd08e0e1691f5511be7ace91ba344348> (referer: None)
2026-03-29 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5406/20385406/wheels_front_driver-1774167802312.jpg> (referer: None)
2026-03-29 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_front_passenger-1774698039788.jpg> (referer: None)
2026-03-29 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_rear_driver-1774698012286.jpg> (referer: None)
2026-03-29 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8948/19958948/interior_boot-1774713691891.jpg> (referer: None)
2026-03-29 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8948/19958948/interior_dashboard-1774713703434.jpg> (referer: None)
2026-03-29 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5406/20385406/interior_boot-1774168076244.jpg> (referer: None)
2026-03-29 20:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_front_driver-1774697994511.jpg> (referer: None)
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xc0'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'SM-A057G\x00'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x90'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 171 - value: b'samsung\x00'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xc7'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 179 - value: b'2026:03:28 16:00:29\x00'
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dee7290>
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8948%252F19958948%252Finterior_front_seats-1774713692718.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8948/19958948/interior_front_seats-1774713692718.jpg saved to cache
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7f4450>
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8948%252F19958948%252Fexterior_rear_passenger-1774715043607.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8948/19958948/exterior_rear_passenger-1774715043607.jpg saved to cache
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d09b2d0>
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8948%252F19958948%252Fexterior_front_driver-1774712675997.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8948/19958948/exterior_front_driver-1774712675997.jpg saved to cache
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xc0'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'SM-A057G\x00'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x90'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 171 - value: b'samsung\x00'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xc7'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 179 - value: b'2026:03:28 16:00:50\x00'
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca65e50>
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8948%252F19958948%252Finterior_rear_seats-1774713690086.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8948/19958948/interior_rear_seats-1774713690086.jpg saved to cache
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xc0'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'SM-A057G\x00'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x90'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 171 - value: b'samsung\x00'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xc7'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 179 - value: b'2026:03:28 15:58:48\x00'
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dabd2d0>
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8948%252F19958948%252Finstrument_cluster-1774713662873.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8948/19958948/instrument_cluster-1774713662873.jpg saved to cache
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xc0'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'SM-A057G\x00'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x90'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 171 - value: b'samsung\x00'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xc7'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 179 - value: b'2026:03:28 16:04:47\x00'
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d09be50>
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8948%252F19958948%252Fdocs_service_history-1774713892675.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcd08e0e1691f5511be7ace91ba344348') HTTP/1.1" 204 0
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8948/19958948/docs_service_history-1774713892675.jpg?ixlib=js-3.8.0&auto=format&s=cd08e0e1691f5511be7ace91ba344348 saved to cache
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca66f90>
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5406%252F20385406%252Fwheels_front_driver-1774167802312.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5406/20385406/wheels_front_driver-1774167802312.jpg saved to cache
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2b529d9-2b05-5f20-9b42-1eb51eec967d
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dabdd90>
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F13149221%252Fexterior_front_passenger-1774698039788.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_front_passenger-1774698039788.jpg saved to cache
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d94aa90>
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F13149221%252Fexterior_rear_driver-1774698012286.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_rear_driver-1774698012286.jpg saved to cache
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xc0'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'SM-A057G\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x90'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 171 - value: b'samsung\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xc7'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 179 - value: b'2026:03:28 16:01:24\x00'
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dabfe10>
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8948%252F19958948%252Finterior_boot-1774713691891.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8948/19958948/interior_boot-1774713691891.jpg saved to cache
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xc0'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'SM-A057G\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x90'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 171 - value: b'samsung\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xc7'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 179 - value: b'2026:03:28 16:01:05\x00'
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a9810>
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8948%252F19958948%252Finterior_dashboard-1774713703434.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8948/19958948/interior_dashboard-1774713703434.jpg saved to cache
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc
2026-03-29 20:11:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1df9c72-299c-5dd5-bd21-e30a2cd980bc, skipping ID generation
2026-03-29 20:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc with scrape type 1
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1df9c72-299c-5dd5-bd21-e30a2cd980bc sending to next pipeline
2026-03-29 20:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b1df9c72-299c-5dd5-bd21-e30a2cd980bc, identifier: 19958948
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0d0550>
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5406%252F20385406%252Finterior_boot-1774168076244.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5406/20385406/interior_boot-1774168076244.jpg saved to cache
2026-03-29 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2b529d9-2b05-5f20-9b42-1eb51eec967d
2026-03-29 20:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddb16d0>
2026-03-29 20:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F13149221%252Fexterior_front_driver-1774697994511.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_front_driver-1774697994511.jpg saved to cache
2026-03-29 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507
2026-03-29 20:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b1df9c72-299c-5dd5-bd21-e30a2cd980bc with identifier: 19958948
2026-03-29 20:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b1df9c72-299c-5dd5-bd21-e30a2cd980bc with identifier: 19958948
2026-03-29 20:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b1df9c72-299c-5dd5-bd21-e30a2cd980bc with identifier: 19958948 to the API
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8948/19958948/interior_dashboard-1774713703434.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'b1df9c72-299c-5dd5-bd21-e30a2cd980bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY15 ZCN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19958948',
'listing': 'auction',
'location': 'West Midlands Halesowen',
'make': 'Volvo',
'model': 'V40',
'odometer': 62027,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 827571,
'Height': 2180,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8948/19958948/exterior_front_driver-1774712675997.jpg',
'Width': 2906},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1083863,
'Height': 2236,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8948/19958948/exterior_rear_driver-1774712677320.jpg',
'Width': 2981},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1616084,
'Height': 2339,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8948/19958948/exterior_front_passenger-1774715184800.jpg',
'Width': 3119},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1701108,
'Height': 2448,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8948/19958948/exterior_rear_passenger-1774715043607.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2379531,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/8948/19958948/interior_front_seats-1774713692718.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1963027,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/8948/19958948/interior_rear_seats-1774713690086.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2867440,
'Height': 2448,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8948/19958948/interior_dashboard-1774713703434.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1918153,
'Height': 2448,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8948/19958948/instrument_cluster-1774713662873.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2779772,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/8948/19958948/interior_boot-1774713691891.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1df9c72-299c-5dd5-bd21-e30a2cd980bc/b1df9c72-299c-5dd5-bd21-e30a2cd980bc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1718942,
'Height': 2448,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8948/19958948/docs_service_history-1774713892675.jpg?ixlib=js-3.8.0&auto=format&s=cd08e0e1691f5511be7ace91ba344348',
'Width': 3264}],
'price': 6685,
'price_includes_vat': False,
'registration_date': '2015-03-03',
'seats_number': None,
'seller_name': None,
'title': 'Volvo V40 R-DESIGN LUX NAV D4',
'transmission': 'manual',
'trim': 'R-DESIGN LUX NAV D4',
'vin': 'YV1MVA8L1F2230691',
'year': 2015}
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719958948%27 HTTP/1.1" 200 None
2026-03-29 20:11:22 [motorway.uk] INFO: Saving data for 19958948: {'created_time': 1774815082.499519, 'last_price_update_time': 1774815082.499531, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19958948') HTTP/1.1" 204 0
2026-03-29 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7335/20487335/interior_boot-1774709281583.jpg> (referer: None)
2026-03-29 20:11:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1bf390>
2026-03-29 20:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7335%252F20487335%252Finterior_boot-1774709281583.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7335/20487335/interior_boot-1774709281583.jpg saved to cache
2026-03-29 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f7b6166-a3ba-5087-ae78-c996958a17f7
2026-03-29 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7335/20487335/docs_service_history-1774709512066.jpg?ixlib=js-3.8.0&auto=format&s=3ed6df222dbdabeb34fad39ec2e43a7b> (referer: None)
2026-03-29 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_rear_driver-1774708733341.jpg> (referer: None)
2026-03-29 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9221/13149221/interior_dashboard-1774698639852.jpg> (referer: None)
2026-03-29 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9221/13149221/docs_service_history-1774700525529.jpg?ixlib=js-3.8.0&auto=format&s=6df5225175d05cee73ad934fd6d95711> (referer: None)
2026-03-29 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_front_passenger-1774708777803.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7335/20487335/docs_service_history-1774709527721.jpg?ixlib=js-3.8.0&auto=format&s=d810083de0f4bc378fe66e62c5ddffda> (referer: None)
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2f6810>
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7335%252F20487335%252Fdocs_service_history-1774709512066.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ed6df222dbdabeb34fad39ec2e43a7b') HTTP/1.1" 204 0
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7335/20487335/docs_service_history-1774709512066.jpg?ixlib=js-3.8.0&auto=format&s=3ed6df222dbdabeb34fad39ec2e43a7b saved to cache
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f7b6166-a3ba-5087-ae78-c996958a17f7
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d75ded0>
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7335%252F20487335%252Fexterior_rear_driver-1774708733341.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_rear_driver-1774708733341.jpg saved to cache
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f7b6166-a3ba-5087-ae78-c996958a17f7
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce233d0>
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F13149221%252Finterior_dashboard-1774698639852.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/13149221/interior_dashboard-1774698639852.jpg saved to cache
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb8eb10>
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9221%252F13149221%252Fdocs_service_history-1774700525529.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6df5225175d05cee73ad934fd6d95711') HTTP/1.1" 204 0
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9221/13149221/docs_service_history-1774700525529.jpg?ixlib=js-3.8.0&auto=format&s=6df5225175d05cee73ad934fd6d95711 saved to cache
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daa0490>
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7335%252F20487335%252Fexterior_front_passenger-1774708777803.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_front_passenger-1774708777803.jpg saved to cache
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f7b6166-a3ba-5087-ae78-c996958a17f7
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb8dc50>
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7335%252F20487335%252Fdocs_service_history-1774709527721.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd810083de0f4bc378fe66e62c5ddffda') HTTP/1.1" 204 0
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7335/20487335/docs_service_history-1774709527721.jpg?ixlib=js-3.8.0&auto=format&s=d810083de0f4bc378fe66e62c5ddffda saved to cache
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f7b6166-a3ba-5087-ae78-c996958a17f7
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_rear_passenger-1774708759953.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7335/20487335/interior_front_seats-1774709336207.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9221/13149221/interior_rear_seats-1774698665675.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9221/13149221/instrument_cluster-1774698778399.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9221/13149221/interior_boot-1774698643378.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_front_driver-1774708703977.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7335/20487335/interior_dashboard-1774709309617.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_rear_passenger-1774698029899.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9221/13149221/interior_front_seats-1774698598401.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7335/20487335/interior_rear_seats-1774709315748.jpg> (referer: None)
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0ce810>
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7335%252F20487335%252Fexterior_rear_passenger-1774708759953.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_rear_passenger-1774708759953.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f7b6166-a3ba-5087-ae78-c996958a17f7
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0ccc90>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7335%252F20487335%252Finterior_front_seats-1774709336207.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7335/20487335/interior_front_seats-1774709336207.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f7b6166-a3ba-5087-ae78-c996958a17f7
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7f6150>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9221%252F13149221%252Finterior_rear_seats-1774698665675.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9221/13149221/interior_rear_seats-1774698665675.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d09b410>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F13149221%252Finstrument_cluster-1774698778399.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/13149221/instrument_cluster-1774698778399.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d998250>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9221%252F13149221%252Finterior_boot-1774698643378.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9221/13149221/interior_boot-1774698643378.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc54450>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7335%252F20487335%252Fexterior_front_driver-1774708703977.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_front_driver-1774708703977.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f7b6166-a3ba-5087-ae78-c996958a17f7
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc56910>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7335%252F20487335%252Finterior_dashboard-1774709309617.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7335/20487335/interior_dashboard-1774709309617.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f7b6166-a3ba-5087-ae78-c996958a17f7
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7f7a50>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9221%252F13149221%252Fexterior_rear_passenger-1774698029899.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_rear_passenger-1774698029899.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35735a10>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9221%252F13149221%252Finterior_front_seats-1774698598401.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9221/13149221/interior_front_seats-1774698598401.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507
2026-03-29 20:11:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34dfd78f-ff08-5e82-8fe7-e1eb41058507, skipping ID generation
2026-03-29 20:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507 with scrape type 1
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34dfd78f-ff08-5e82-8fe7-e1eb41058507 sending to next pipeline
2026-03-29 20:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 34dfd78f-ff08-5e82-8fe7-e1eb41058507, identifier: 13149221
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d160c90>
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7335%252F20487335%252Finterior_rear_seats-1774709315748.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7335/20487335/interior_rear_seats-1774709315748.jpg saved to cache
2026-03-29 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f7b6166-a3ba-5087-ae78-c996958a17f7
2026-03-29 20:11:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f7b6166-a3ba-5087-ae78-c996958a17f7, skipping ID generation
2026-03-29 20:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7b6166-a3ba-5087-ae78-c996958a17f7 with scrape type 1
2026-03-29 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f7b6166-a3ba-5087-ae78-c996958a17f7 sending to next pipeline
2026-03-29 20:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6f7b6166-a3ba-5087-ae78-c996958a17f7, identifier: 20487335
2026-03-29 20:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 34dfd78f-ff08-5e82-8fe7-e1eb41058507 with identifier: 13149221
2026-03-29 20:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 34dfd78f-ff08-5e82-8fe7-e1eb41058507 with identifier: 13149221
2026-03-29 20:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 34dfd78f-ff08-5e82-8fe7-e1eb41058507 with identifier: 13149221 to the API
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9221/13149221/interior_front_seats-1774698598401.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '34dfd78f-ff08-5e82-8fe7-e1eb41058507',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'L555 LSW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13149221',
'listing': 'auction',
'location': 'Stoke-on-Trent Stoke-on-Trent',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 88300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1215582,
'Height': 2141,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_front_driver-1774697994511.jpg',
'Width': 2854},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1326196,
'Height': 2213,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_rear_driver-1774698012286.jpg',
'Width': 2950},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1150574,
'Height': 2068,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_front_passenger-1774698039788.jpg',
'Width': 2757},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1855430,
'Height': 2636,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9221/13149221/exterior_rear_passenger-1774698029899.jpg',
'Width': 3514},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3410974,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9221/13149221/interior_front_seats-1774698598401.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2200537,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9221/13149221/interior_rear_seats-1774698665675.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1820690,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9221/13149221/interior_dashboard-1774698639852.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2320518,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9221/13149221/instrument_cluster-1774698778399.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3164373,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9221/13149221/interior_boot-1774698643378.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34dfd78f-ff08-5e82-8fe7-e1eb41058507/34dfd78f-ff08-5e82-8fe7-e1eb41058507_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2301242,
'Height': 2442,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9221/13149221/docs_service_history-1774700525529.jpg?ixlib=js-3.8.0&auto=format&s=6df5225175d05cee73ad934fd6d95711',
'Width': 1687}],
'price': 9011,
'price_includes_vat': False,
'registration_date': '2017-03-06',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 180 D AMG Line Premium + A',
'transmission': 'automatic',
'trim': 'A 180 D AMG Line Premium + A',
'vin': 'WDD1760122J587864',
'year': 2017}
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713149221%27 HTTP/1.1" 200 None
2026-03-29 20:11:25 [motorway.uk] INFO: Saving data for 13149221: {'created_time': 1774815085.727316, 'last_price_update_time': 1774815085.727326, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13149221') HTTP/1.1" 204 0
2026-03-29 20:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6f7b6166-a3ba-5087-ae78-c996958a17f7 with identifier: 20487335
2026-03-29 20:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6f7b6166-a3ba-5087-ae78-c996958a17f7 with identifier: 20487335
2026-03-29 20:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6f7b6166-a3ba-5087-ae78-c996958a17f7 with identifier: 20487335 to the API
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7335/20487335/interior_rear_seats-1774709315748.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6f7b6166-a3ba-5087-ae78-c996958a17f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK18 TVC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487335',
'listing': 'auction',
'location': 'Warrington Warrington',
'make': 'Fiat',
'model': '500',
'odometer': 50133,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1342176,
'Height': 2585,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_front_driver-1774708703977.jpg',
'Width': 3447},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1742519,
'Height': 2587,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_rear_driver-1774708733341.jpg',
'Width': 3449},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2484915,
'Height': 2995,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_front_passenger-1774708777803.jpg',
'Width': 3993},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1619290,
'Height': 2517,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7335/20487335/exterior_rear_passenger-1774708759953.jpg',
'Width': 3356},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3403702,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7335/20487335/interior_front_seats-1774709336207.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4466466,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7335/20487335/interior_rear_seats-1774709315748.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2499923,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7335/20487335/interior_dashboard-1774709309617.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3093964,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7335/20487335/interior_boot-1774709281583.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563654,
'Height': 873,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7335/20487335/docs_service_history-1774709512066.jpg?ixlib=js-3.8.0&auto=format&s=3ed6df222dbdabeb34fad39ec2e43a7b',
'Width': 2574},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7b6166-a3ba-5087-ae78-c996958a17f7/6f7b6166-a3ba-5087-ae78-c996958a17f7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1165883,
'Height': 1801,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7335/20487335/docs_service_history-1774709527721.jpg?ixlib=js-3.8.0&auto=format&s=d810083de0f4bc378fe66e62c5ddffda',
'Width': 2515}],
'price': 4820,
'price_includes_vat': False,
'registration_date': '2018-03-30',
'seats_number': None,
'seller_name': None,
'title': 'Fiat 500 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'vin': 'ZFA3120000J943008',
'year': 2018}
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487335%27 HTTP/1.1" 200 None
2026-03-29 20:11:26 [motorway.uk] INFO: Saving data for 20487335: {'created_time': 1774815086.146258, 'last_price_update_time': 1774815086.146268, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487335') HTTP/1.1" 204 0
2026-03-29 20:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_front_passenger-1774167749653.jpg> (referer: None)
2026-03-29 20:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5406/20385406/20385406-instrument_cluster-modified-1774777120511.jpeg> (referer: None)
2026-03-29 20:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7322/19037322/interior_boot-1771162515801.jpg> (referer: None)
2026-03-29 20:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/7322/19037322/docs_service_history-1771163066154.jpg?ixlib=js-3.8.0&auto=format&s=f817c5dd82f45b2bef7ad4bbbad372c0> (referer: None)
2026-03-29 20:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_rear_driver-1774167696251.jpg> (referer: None)
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da4f990>
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5406%252F20385406%252Fexterior_front_passenger-1774167749653.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_front_passenger-1774167749653.jpg saved to cache
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2b529d9-2b05-5f20-9b42-1eb51eec967d
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da4fc10>
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5406%252F20385406%252F20385406-instrument_cluster-modified-1774777120511.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5406/20385406/20385406-instrument_cluster-modified-1774777120511.jpeg saved to cache
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2b529d9-2b05-5f20-9b42-1eb51eec967d
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1c5dd0>
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7322%252F19037322%252Finterior_boot-1771162515801.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7322/19037322/interior_boot-1771162515801.jpg saved to cache
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c764210>
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F7322%252F19037322%252Fdocs_service_history-1771163066154.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df817c5dd82f45b2bef7ad4bbbad372c0') HTTP/1.1" 204 0
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/7322/19037322/docs_service_history-1771163066154.jpg?ixlib=js-3.8.0&auto=format&s=f817c5dd82f45b2bef7ad4bbbad372c0 saved to cache
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c693550>
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5406%252F20385406%252Fexterior_rear_driver-1774167696251.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_rear_driver-1774167696251.jpg saved to cache
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2b529d9-2b05-5f20-9b42-1eb51eec967d
2026-03-29 20:11:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2b529d9-2b05-5f20-9b42-1eb51eec967d, skipping ID generation
2026-03-29 20:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2b529d9-2b05-5f20-9b42-1eb51eec967d with scrape type 1
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2b529d9-2b05-5f20-9b42-1eb51eec967d sending to next pipeline
2026-03-29 20:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c2b529d9-2b05-5f20-9b42-1eb51eec967d, identifier: 20385406
2026-03-29 20:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c2b529d9-2b05-5f20-9b42-1eb51eec967d with identifier: 20385406
2026-03-29 20:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c2b529d9-2b05-5f20-9b42-1eb51eec967d with identifier: 20385406
2026-03-29 20:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c2b529d9-2b05-5f20-9b42-1eb51eec967d with identifier: 20385406 to the API
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_rear_driver-1774167696251.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c2b529d9-2b05-5f20-9b42-1eb51eec967d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MK23 UBB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20385406',
'listing': 'auction',
'location': 'West Yorkshire Cleckheaton',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 37366,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1680190,
'Height': 2519,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_front_driver-1774167672295.jpg',
'Width': 3358},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1310313,
'Height': 2317,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_rear_driver-1774167696251.jpg',
'Width': 3089},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1741504,
'Height': 2681,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_front_passenger-1774167749653.jpg',
'Width': 3575},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1675923,
'Height': 2758,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5406/20385406/exterior_rear_passenger-1774167781309.jpg',
'Width': 3677},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5211188,
'Height': 5712,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5406/20385406/interior_front_seats-1774775918110.jpg',
'Width': 7616},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3596819,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5406/20385406/interior_rear_seats-1774168040097.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1932074,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5406/20385406/interior_dashboard-1774168833400.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 921445,
'Height': 2091,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5406/20385406/20385406-instrument_cluster-modified-1774777120511.jpeg',
'Width': 2788},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3995062,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5406/20385406/interior_boot-1774168076244.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2b529d9-2b05-5f20-9b42-1eb51eec967d/c2b529d9-2b05-5f20-9b42-1eb51eec967d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1260932,
'Height': 2388,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5406/20385406/wheels_front_driver-1774167802312.jpg',
'Width': 3184}],
'price': 24953,
'price_includes_vat': False,
'registration_date': '2023-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Tiguan R-LINE TSI 4MOTION S-A',
'transmission': 'automatic',
'trim': 'R-LINE TSI 4MOTION S-A',
'vin': 'WVGZZZ5N6PW029673',
'year': 2023}
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720385406%27 HTTP/1.1" 200 None
2026-03-29 20:11:27 [motorway.uk] INFO: Saving data for 20385406: {'created_time': 1774815087.500841, 'last_price_update_time': 1774815087.500855, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20385406') HTTP/1.1" 204 0
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6470/17056470/interior_dashboard-1774622182896.jpg> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6470/17056470/instrument_cluster-1774622032588.jpg> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6470/17056470/interior_boot-1774622087592.jpg> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6470/17056470/interior_rear_seats-1774690238371.jpg> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6470/17056470/docs_service_history-1774622523664.jpg?ixlib=js-3.8.0&auto=format&s=57acacda30c5a47430821f3c44b8ef6b> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7322/19037322/exterior_rear_passenger-1771161918503.jpg> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7322/19037322/interior_dashboard-1771167192727.jpg> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7322/19037322/instrument_cluster-1771162405659.jpg> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7322/19037322/interior_rear_seats-1771162481742.jpg> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7322/19037322/interior_front_seats-1771162437922.jpg> (referer: None)
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c829590>
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6470%252F17056470%252Finterior_dashboard-1774622182896.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6470/17056470/interior_dashboard-1774622182896.jpg saved to cache
2026-03-29 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8362c7f9-62dd-5694-8a67-24b5b163ea52
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddbe0d0>
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6470%252F17056470%252Finstrument_cluster-1774622032588.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6470/17056470/instrument_cluster-1774622032588.jpg saved to cache
2026-03-29 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8362c7f9-62dd-5694-8a67-24b5b163ea52
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20410678.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f30fc90>
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6470%252F17056470%252Finterior_boot-1774622087592.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6470/17056470/interior_boot-1774622087592.jpg saved to cache
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8362c7f9-62dd-5694-8a67-24b5b163ea52
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d718b10>
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6470%252F17056470%252Finterior_rear_seats-1774690238371.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6470/17056470/interior_rear_seats-1774690238371.jpg saved to cache
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8362c7f9-62dd-5694-8a67-24b5b163ea52
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4e8d90>
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6470%252F17056470%252Fdocs_service_history-1774622523664.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D57acacda30c5a47430821f3c44b8ef6b') HTTP/1.1" 204 0
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6470/17056470/docs_service_history-1774622523664.jpg?ixlib=js-3.8.0&auto=format&s=57acacda30c5a47430821f3c44b8ef6b saved to cache
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8362c7f9-62dd-5694-8a67-24b5b163ea52
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc2d890>
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7322%252F19037322%252Fexterior_rear_passenger-1771161918503.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7322/19037322/exterior_rear_passenger-1771161918503.jpg saved to cache
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f62bf10>
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7322%252F19037322%252Finterior_dashboard-1771167192727.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7322/19037322/interior_dashboard-1771167192727.jpg saved to cache
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d71a050>
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7322%252F19037322%252Finstrument_cluster-1771162405659.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7322/19037322/instrument_cluster-1771162405659.jpg saved to cache
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4e9750>
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7322%252F19037322%252Finterior_rear_seats-1771162481742.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7322/19037322/interior_rear_seats-1771162481742.jpg saved to cache
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8faad0>
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7322%252F19037322%252Finterior_front_seats-1771162437922.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7322/19037322/interior_front_seats-1771162437922.jpg saved to cache
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba
2026-03-29 20:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e0f4a9-2d73-523e-91f5-e69b5660f913 with identifier: 20410678
2026-03-29 20:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e0f4a9-2d73-523e-91f5-e69b5660f913 with scrape type 1
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80e0f4a9-2d73-523e-91f5-e69b5660f913
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F20410678%252Fexterior_front_driver-1774722257733.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_front_driver-1774722257733.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F20410678%252Fexterior_rear_driver-1774722193057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_rear_driver-1774722193057.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F20410678%252Fexterior_front_passenger-1774722198077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_front_passenger-1774722198077.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F20410678%252Fexterior_rear_passenger-1774722193789.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_rear_passenger-1774722193789.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0678%252F20410678%252Finterior_front_seats-1774723009508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0678/20410678/interior_front_seats-1774723009508.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0678%252F20410678%252Finterior_rear_seats-1774723007740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0678/20410678/interior_rear_seats-1774723007740.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0678%252F20410678%252Finterior_dashboard-1774776655999.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0678/20410678/interior_dashboard-1774776655999.jpg not downloaded yet
2026-03-29 20:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_rear_passenger-1774621228283.jpg> (referer: None)
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F20410678%252Finstrument_cluster-1774722942969.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/20410678/instrument_cluster-1774722942969.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0678%252F20410678%252Finterior_boot-1774723007011.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0678/20410678/interior_boot-1774723007011.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F20410678%252Fwheels_front_driver-1774722346037.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/20410678/wheels_front_driver-1774722346037.jpg not downloaded yet
2026-03-29 20:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_front_passenger-1774621529832.jpg> (referer: None)
2026-03-29 20:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7322/19037322/exterior_front_driver-1771166515858.jpg> (referer: None)
2026-03-29 20:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1260&page=35&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7322/19037322/exterior_rear_driver-1771161903892.jpg> (referer: None)
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6e9a50>
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6470%252F17056470%252Fexterior_rear_passenger-1774621228283.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_rear_passenger-1774621228283.jpg saved to cache
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8362c7f9-62dd-5694-8a67-24b5b163ea52
2026-03-29 20:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6470/17056470/interior_front_seats-1774622091760.jpg> (referer: None)
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dabccd0>
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6470%252F17056470%252Fexterior_front_passenger-1774621529832.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_front_passenger-1774621529832.jpg saved to cache
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8362c7f9-62dd-5694-8a67-24b5b163ea52
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f29d790>
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7322%252F19037322%252Fexterior_front_driver-1771166515858.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7322/19037322/exterior_front_driver-1771166515858.jpg saved to cache
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba
2026-03-29 20:11:29 [motorway.uk] INFO: Found listing with ID: 20375931
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720375931%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [motorway.uk] INFO: Scrape type for 20375931: 1
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d690690>
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7322%252F19037322%252Fexterior_rear_driver-1771161903892.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7322/19037322/exterior_rear_driver-1771161903892.jpg saved to cache
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba
2026-03-29 20:11:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e266f3ce-ab13-5f2e-8ed9-7d29617b66ba, skipping ID generation
2026-03-29 20:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba with scrape type 1
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e266f3ce-ab13-5f2e-8ed9-7d29617b66ba sending to next pipeline
2026-03-29 20:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e266f3ce-ab13-5f2e-8ed9-7d29617b66ba, identifier: 19037322
2026-03-29 20:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_front_driver-1774621223557.jpg> (referer: None)
2026-03-29 20:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e266f3ce-ab13-5f2e-8ed9-7d29617b66ba with identifier: 19037322
2026-03-29 20:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e266f3ce-ab13-5f2e-8ed9-7d29617b66ba with identifier: 19037322
2026-03-29 20:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e266f3ce-ab13-5f2e-8ed9-7d29617b66ba with identifier: 19037322 to the API
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7322/19037322/exterior_rear_driver-1771161903892.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e266f3ce-ab13-5f2e-8ed9-7d29617b66ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA21 KTJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19037322',
'listing': 'auction',
'location': 'Leicestershire Leicester',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 33000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2156811,
'Height': 2570,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7322/19037322/exterior_front_driver-1771166515858.jpg',
'Width': 3427},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1877139,
'Height': 2651,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7322/19037322/exterior_rear_driver-1771161903892.jpg',
'Width': 3534},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2014049,
'Height': 2803,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7322/19037322/exterior_front_passenger-1771161928697.jpg',
'Width': 3737},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1943160,
'Height': 2657,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7322/19037322/exterior_rear_passenger-1771161918503.jpg',
'Width': 3542},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4004443,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7322/19037322/interior_front_seats-1771162437922.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3877355,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7322/19037322/interior_rear_seats-1771162481742.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2355561,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7322/19037322/interior_dashboard-1771167192727.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2821035,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7322/19037322/instrument_cluster-1771162405659.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3574464,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7322/19037322/interior_boot-1771162515801.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e266f3ce-ab13-5f2e-8ed9-7d29617b66ba/e266f3ce-ab13-5f2e-8ed9-7d29617b66ba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5212784,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/7322/19037322/docs_service_history-1771163066154.jpg?ixlib=js-3.8.0&auto=format&s=f817c5dd82f45b2bef7ad4bbbad372c0',
'Width': 4032}],
'price': 10099,
'price_includes_vat': False,
'registration_date': '2021-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta ST-LINE Edition T MHEV',
'transmission': 'manual',
'trim': 'ST-LINE Edition T MHEV',
'vin': 'WF0JXXGAHJLT02171',
'year': 2021}
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719037322%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [motorway.uk] INFO: Saving data for 19037322: {'created_time': 1774815090.344145, 'last_price_update_time': 1774815090.344156, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19037322') HTTP/1.1" 204 0
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20325750
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720325750%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [motorway.uk] INFO: Scrape type for 20325750: 1
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 16691958
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20470450
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20395403
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20474722
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20492344
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20114932
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20501015
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720501015%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [motorway.uk] INFO: Scrape type for 20501015: 1
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cac8550>
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6470%252F17056470%252Finterior_front_seats-1774622091760.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6470/17056470/interior_front_seats-1774622091760.jpg saved to cache
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8362c7f9-62dd-5694-8a67-24b5b163ea52
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1f0e90>
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6470%252F17056470%252Fexterior_front_driver-1774621223557.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_front_driver-1774621223557.jpg saved to cache
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8362c7f9-62dd-5694-8a67-24b5b163ea52
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20491170
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20436771
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720436771%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [motorway.uk] INFO: Scrape type for 20436771: 1
2026-03-29 20:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 19695598
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719695598%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [motorway.uk] INFO: Scrape type for 19695598: 1
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 16059595
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716059595%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [motorway.uk] INFO: Scrape type for 16059595: 1
2026-03-29 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0678/20410678/interior_rear_seats-1774723007740.jpg> (referer: None)
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 13977118
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20488360
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 19261388
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20480811
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20315252
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20021276
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720021276%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [motorway.uk] INFO: Scrape type for 20021276: 1
2026-03-29 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0678/20410678/interior_boot-1774723007011.jpg> (referer: None)
2026-03-29 20:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 19370870
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20363809
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 19748283
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20492678
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20327541
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 17627913
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717627913%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [motorway.uk] INFO: Scrape type for 17627913: 1
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20405306
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20485412
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 14166490
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20405002
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 17362621
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 19486204
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 18339762
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718339762%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [motorway.uk] INFO: Scrape type for 18339762: 1
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20441350
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 11446328
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 19699748
2026-03-29 20:11:30 [motorway.uk] INFO: Found listing with ID: 20357195
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720357195%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [motorway.uk] INFO: Scrape type for 20357195: 1
2026-03-29 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7574/2387574/interior_rear_seats-1774722032777.jpg> (referer: None)
2026-03-29 20:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_front_passenger-1774635787558.jpg> (referer: None)
2026-03-29 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_rear_driver-1774621229213.jpg> (referer: None)
2026-03-29 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7574/2387574/interior_front_seats-1774721995839.jpg> (referer: None)
2026-03-29 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_rear_passenger-1774635773978.jpg> (referer: None)
2026-03-29 20:11:30 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:11:30 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:11:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:11:30 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 18:34:54\x00'
2026-03-29 20:11:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:11:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:11:30 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:11:30 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:11:30 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:11:30 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:11:30 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:11:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:11:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca7d290>
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0678%252F20410678%252Finterior_rear_seats-1774723007740.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0678/20410678/interior_rear_seats-1774723007740.jpg saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80e0f4a9-2d73-523e-91f5-e69b5660f913
2026-03-29 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0678/20410678/wheels_front_driver-1774722346037.jpg> (referer: None)
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 18:36:42\x00'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5dd9d0>
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0678%252F20410678%252Finterior_boot-1774723007011.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0678/20410678/interior_boot-1774723007011.jpg saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80e0f4a9-2d73-523e-91f5-e69b5660f913
2026-03-29 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6482/18086482/instrument_cluster-1774548060308.jpeg> (referer: None)
2026-03-29 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2537/19712537/interior_rear_seats-1774636414577.jpg> (referer: None)
2026-03-29 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0678/20410678/instrument_cluster-1774722942969.jpg> (referer: None)
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f65cc90>
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7574%252F2387574%252Finterior_rear_seats-1774722032777.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7574/2387574/interior_rear_seats-1774722032777.jpg saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86b77ad5-ea3b-5379-8233-b1bd60475650
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db69d10>
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2537%252F19712537%252Fexterior_front_passenger-1774635787558.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_front_passenger-1774635787558.jpg saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1ccc50>
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6470%252F17056470%252Fexterior_rear_driver-1774621229213.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_rear_driver-1774621229213.jpg saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8362c7f9-62dd-5694-8a67-24b5b163ea52
2026-03-29 20:11:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8362c7f9-62dd-5694-8a67-24b5b163ea52, skipping ID generation
2026-03-29 20:11:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8362c7f9-62dd-5694-8a67-24b5b163ea52 with scrape type 1
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8362c7f9-62dd-5694-8a67-24b5b163ea52 sending to next pipeline
2026-03-29 20:11:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8362c7f9-62dd-5694-8a67-24b5b163ea52, identifier: 17056470
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5c8b50>
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7574%252F2387574%252Finterior_front_seats-1774721995839.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7574/2387574/interior_front_seats-1774721995839.jpg saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86b77ad5-ea3b-5379-8233-b1bd60475650
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9ac810>
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2537%252F19712537%252Fexterior_rear_passenger-1774635773978.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_rear_passenger-1774635773978.jpg saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f29e110>
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F20410678%252Fwheels_front_driver-1774722346037.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/20410678/wheels_front_driver-1774722346037.jpg saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80e0f4a9-2d73-523e-91f5-e69b5660f913
2026-03-29 20:11:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8362c7f9-62dd-5694-8a67-24b5b163ea52 with identifier: 17056470
2026-03-29 20:11:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8362c7f9-62dd-5694-8a67-24b5b163ea52 with identifier: 17056470
2026-03-29 20:11:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8362c7f9-62dd-5694-8a67-24b5b163ea52 with identifier: 17056470 to the API
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_rear_driver-1774621229213.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8362c7f9-62dd-5694-8a67-24b5b163ea52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AU17 VYB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17056470',
'listing': 'auction',
'location': 'Plymouth Plymouth',
'make': 'Renault',
'model': 'Clio',
'odometer': 43544,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1355975,
'Height': 2479,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_front_driver-1774621223557.jpg',
'Width': 3305},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1512558,
'Height': 2855,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_rear_driver-1774621229213.jpg',
'Width': 3806},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1581869,
'Height': 2720,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_front_passenger-1774621529832.jpg',
'Width': 3627},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1243316,
'Height': 2570,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6470/17056470/exterior_rear_passenger-1774621228283.jpg',
'Width': 3427},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2229570,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6470/17056470/interior_front_seats-1774622091760.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1664927,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6470/17056470/interior_rear_seats-1774690238371.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1415301,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6470/17056470/interior_dashboard-1774622182896.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1338036,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6470/17056470/instrument_cluster-1774622032588.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1621490,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6470/17056470/interior_boot-1774622087592.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8362c7f9-62dd-5694-8a67-24b5b163ea52/8362c7f9-62dd-5694-8a67-24b5b163ea52_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1881267,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6470/17056470/docs_service_history-1774622523664.jpg?ixlib=js-3.8.0&auto=format&s=57acacda30c5a47430821f3c44b8ef6b',
'Width': 3840}],
'price': 6224,
'price_includes_vat': False,
'registration_date': '2017-03-03',
'seats_number': None,
'seller_name': None,
'title': 'Renault Clio Dynamique S NAV DCI',
'transmission': 'manual',
'trim': 'Dynamique S NAV DCI',
'vin': 'VF15RKJ0A57147624',
'year': 2017}
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717056470%27 HTTP/1.1" 200 None
2026-03-29 20:11:32 [motorway.uk] INFO: Saving data for 17056470: {'created_time': 1774815092.203101, 'last_price_update_time': 1774815092.203114, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17056470') HTTP/1.1" 204 0
2026-03-29 20:11:32 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:32 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:32 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00"`\xdd\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01eY\x00"V\xd9\x00\x00\x00\x00'
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de794d0>
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6482%252F18086482%252Finstrument_cluster-1774548060308.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6482/18086482/instrument_cluster-1774548060308.jpeg saved to cache
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a46ed00-c645-5781-8b3c-dba182fa250c
2026-03-29 20:11:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cac8190>
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2537%252F19712537%252Finterior_rear_seats-1774636414577.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2537/19712537/interior_rear_seats-1774636414577.jpg saved to cache
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cec5650>
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F20410678%252Finstrument_cluster-1774722942969.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/20410678/instrument_cluster-1774722942969.jpg saved to cache
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80e0f4a9-2d73-523e-91f5-e69b5660f913
2026-03-29 20:11:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2537/19712537/interior_front_seats-1774636388170.jpg> (referer: None)
2026-03-29 20:11:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6add90>
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2537%252F19712537%252Finterior_front_seats-1774636388170.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2537/19712537/interior_front_seats-1774636388170.jpg saved to cache
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350
2026-03-29 20:11:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350, skipping ID generation
2026-03-29 20:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350 with scrape type 1
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350 sending to next pipeline
2026-03-29 20:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350, identifier: 19712537
2026-03-29 20:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350 with identifier: 19712537
2026-03-29 20:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350 with identifier: 19712537
2026-03-29 20:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350 with identifier: 19712537 to the API
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2537/19712537/interior_front_seats-1774636388170.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RV70 MFJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19712537',
'listing': 'auction',
'location': 'South Lanarkshire Lanark',
'make': 'Kia',
'model': 'Sportage',
'odometer': 60500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2180517,
'Height': 2942,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_front_driver-1774635743389.jpg',
'Width': 3922},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1809538,
'Height': 2862,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_rear_driver-1774635760685.jpg',
'Width': 3816},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1727226,
'Height': 2620,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_front_passenger-1774635787558.jpg',
'Width': 3493},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2063658,
'Height': 2945,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2537/19712537/exterior_rear_passenger-1774635773978.jpg',
'Width': 3926},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3164018,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2537/19712537/interior_front_seats-1774636388170.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2463575,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2537/19712537/interior_rear_seats-1774636414577.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1381531,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2537/19712537/interior_dashboard-1774636287999.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1988171,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2537/19712537/instrument_cluster-1774636158659.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2143501,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2537/19712537/interior_boot-1774636162819.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350/43eb8fad-5e9e-5b6c-bbf6-ca5c1e1bf350_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1956910,
'Height': 3350,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2537/19712537/docs_service_history-1774636592496.jpg?ixlib=js-3.8.0&auto=format&s=de0274bd5e98c7473ff96b66f3a0243c',
'Width': 1763}],
'price': 10538,
'price_includes_vat': False,
'registration_date': '2020-09-17',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage 2 CRDI ISG MHEV',
'transmission': 'automatic',
'trim': '2 CRDI ISG MHEV',
'vin': 'U5YPH812VLL906971',
'year': 2020}
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719712537%27 HTTP/1.1" 200 None
2026-03-29 20:11:33 [motorway.uk] INFO: Saving data for 19712537: {'created_time': 1774815093.35711, 'last_price_update_time': 1774815093.357123, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19712537') HTTP/1.1" 204 0
2026-03-29 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_front_passenger-1774722198077.jpg> (referer: None)
2026-03-29 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0678/20410678/interior_dashboard-1774776655999.jpg> (referer: None)
2026-03-29 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_rear_passenger-1774722193789.jpg> (referer: None)
2026-03-29 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0678/20410678/interior_front_seats-1774723009508.jpg> (referer: None)
2026-03-29 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_front_driver-1774722257733.jpg> (referer: None)
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5f5890>
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F20410678%252Fexterior_front_passenger-1774722198077.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_front_passenger-1774722198077.jpg saved to cache
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80e0f4a9-2d73-523e-91f5-e69b5660f913
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d75cc50>
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0678%252F20410678%252Finterior_dashboard-1774776655999.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0678/20410678/interior_dashboard-1774776655999.jpg saved to cache
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80e0f4a9-2d73-523e-91f5-e69b5660f913
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d591750>
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F20410678%252Fexterior_rear_passenger-1774722193789.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_rear_passenger-1774722193789.jpg saved to cache
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80e0f4a9-2d73-523e-91f5-e69b5660f913
2026-03-29 20:11:33 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:11:33 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:11:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:11:33 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 18:34:27\x00'
2026-03-29 20:11:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:11:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:11:33 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:11:33 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:11:33 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:11:33 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:11:33 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:11:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:11:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6a0910>
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0678%252F20410678%252Finterior_front_seats-1774723009508.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0678/20410678/interior_front_seats-1774723009508.jpg saved to cache
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80e0f4a9-2d73-523e-91f5-e69b5660f913
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c5d90>
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F20410678%252Fexterior_front_driver-1774722257733.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_front_driver-1774722257733.jpg saved to cache
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80e0f4a9-2d73-523e-91f5-e69b5660f913
2026-03-29 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_rear_driver-1774722193057.jpg> (referer: None)
2026-03-29 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6482/18086482/interior_rear_seats-1774547992089.jpeg> (referer: None)
2026-03-29 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_rear_passenger-1774720900921.jpg> (referer: None)
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6a1910>
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0678%252F20410678%252Fexterior_rear_driver-1774722193057.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_rear_driver-1774722193057.jpg saved to cache
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80e0f4a9-2d73-523e-91f5-e69b5660f913
2026-03-29 20:11:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80e0f4a9-2d73-523e-91f5-e69b5660f913, skipping ID generation
2026-03-29 20:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e0f4a9-2d73-523e-91f5-e69b5660f913 with scrape type 1
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80e0f4a9-2d73-523e-91f5-e69b5660f913 sending to next pipeline
2026-03-29 20:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 80e0f4a9-2d73-523e-91f5-e69b5660f913, identifier: 20410678
2026-03-29 20:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 80e0f4a9-2d73-523e-91f5-e69b5660f913 with identifier: 20410678
2026-03-29 20:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 80e0f4a9-2d73-523e-91f5-e69b5660f913 with identifier: 20410678
2026-03-29 20:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 80e0f4a9-2d73-523e-91f5-e69b5660f913 with identifier: 20410678 to the API
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_rear_driver-1774722193057.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '80e0f4a9-2d73-523e-91f5-e69b5660f913',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AL13 LYG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20410678',
'listing': 'auction',
'location': 'East Dunbartonshire Council Glasgow',
'make': 'Jaguar',
'model': 'XF Series',
'odometer': 32477,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204634,
'Height': 909,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_front_driver-1774722257733.jpg',
'Width': 1212},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119406,
'Height': 678,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_rear_driver-1774722193057.jpg',
'Width': 904},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182029,
'Height': 894,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_front_passenger-1774722198077.jpg',
'Width': 1192},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206281,
'Height': 924,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0678/20410678/exterior_rear_passenger-1774722193789.jpg',
'Width': 1232},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 749940,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/0678/20410678/interior_front_seats-1774723009508.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 718709,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/0678/20410678/interior_rear_seats-1774723007740.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245856,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0678/20410678/interior_dashboard-1774776655999.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147604,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0678/20410678/instrument_cluster-1774722942969.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735737,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/0678/20410678/interior_boot-1774723007011.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e0f4a9-2d73-523e-91f5-e69b5660f913/80e0f4a9-2d73-523e-91f5-e69b5660f913_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45588,
'Height': 552,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0678/20410678/wheels_front_driver-1774722346037.jpg',
'Width': 736}],
'price': 13098,
'price_includes_vat': False,
'registration_date': '2017-10-31',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar XF Portfolio I Auto',
'transmission': 'automatic',
'trim': 'XF Portfolio I Auto',
'vin': 'SAJBB2AX8JCY63527',
'year': 2017}
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720410678%27 HTTP/1.1" 200 None
2026-03-29 20:11:34 [motorway.uk] INFO: Saving data for 20410678: {'created_time': 1774815094.45718, 'last_price_update_time': 1774815094.457191, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20410678') HTTP/1.1" 204 0
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00#\x8cj\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x8eG\x00#\x82f\x00\x00\x00\x00'
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d256890>
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6482%252F18086482%252Finterior_rear_seats-1774547992089.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6482/18086482/interior_rear_seats-1774547992089.jpeg saved to cache
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a46ed00-c645-5781-8b3c-dba182fa250c
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ceccbd0>
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7574%252F2387574%252Fexterior_rear_passenger-1774720900921.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_rear_passenger-1774720900921.jpg saved to cache
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86b77ad5-ea3b-5379-8233-b1bd60475650
2026-03-29 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9221/20299221/docs_service_history-1774637501924.jpg?ixlib=js-3.8.0&auto=format&s=d731a07719f69f1d818224e8a03934ca> (referer: None)
2026-03-29 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_front_passenger-1774720939472.jpg> (referer: None)
2026-03-29 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6482/18086482/interior_dashboard-1774548017634.jpeg> (referer: None)
2026-03-29 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6482/18086482/interior_front_seats-1774548649613.jpeg> (referer: None)
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1b8a90>
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942b0137-4c91-5212-a508-0187f7ce8de3/942b0137-4c91-5212-a508-0187f7ce8de3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9221%252F20299221%252Fdocs_service_history-1774637501924.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd731a07719f69f1d818224e8a03934ca') HTTP/1.1" 204 0
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9221/20299221/docs_service_history-1774637501924.jpg?ixlib=js-3.8.0&auto=format&s=d731a07719f69f1d818224e8a03934ca saved to cache
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 942b0137-4c91-5212-a508-0187f7ce8de3
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c7cd0>
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7574%252F2387574%252Fexterior_front_passenger-1774720939472.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_front_passenger-1774720939472.jpg saved to cache
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86b77ad5-ea3b-5379-8233-b1bd60475650
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00-lF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xaa\x83\x00-bB\x00\x00\x00\x00'
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cac8690>
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6482%252F18086482%252Finterior_dashboard-1774548017634.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6482/18086482/interior_dashboard-1774548017634.jpeg saved to cache
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a46ed00-c645-5781-8b3c-dba182fa250c
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00&\x10\xb1\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x80=\x00&\x06\xad\x00\x00\x00\x00'
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db78290>
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6482%252F18086482%252Finterior_front_seats-1774548649613.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6482/18086482/interior_front_seats-1774548649613.jpeg saved to cache
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a46ed00-c645-5781-8b3c-dba182fa250c
2026-03-29 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_rear_driver-1774720855142.jpg> (referer: None)
2026-03-29 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_rear_passenger-1774529679016.jpeg> (referer: None)
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d161a50>
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7574%252F2387574%252Fexterior_rear_driver-1774720855142.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_rear_driver-1774720855142.jpg saved to cache
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86b77ad5-ea3b-5379-8233-b1bd60475650
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0af650>
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6482%252F18086482%252Fexterior_rear_passenger-1774529679016.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_rear_passenger-1774529679016.jpeg saved to cache
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a46ed00-c645-5781-8b3c-dba182fa250c
2026-03-29 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9221/20299221/docs_service_history-1774637501301.jpg?ixlib=js-3.8.0&auto=format&s=178cbd0a5f59b3f39cdc5a88227e7fd9> (referer: None)
2026-03-29 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_front_driver-1774720773499.jpg> (referer: None)
2026-03-29 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19695598.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3355/8203355/docs_service_history-1774711410962.jpg?ixlib=js-3.8.0&auto=format&s=5cdb3fb7a74cc5df1716da33923de0e0> (referer: None)
2026-03-29 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_front_passenger-1774529631130.jpeg> (referer: None)
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f449f50>
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942b0137-4c91-5212-a508-0187f7ce8de3/942b0137-4c91-5212-a508-0187f7ce8de3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9221%252F20299221%252Fdocs_service_history-1774637501301.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D178cbd0a5f59b3f39cdc5a88227e7fd9') HTTP/1.1" 204 0
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9221/20299221/docs_service_history-1774637501301.jpg?ixlib=js-3.8.0&auto=format&s=178cbd0a5f59b3f39cdc5a88227e7fd9 saved to cache
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 942b0137-4c91-5212-a508-0187f7ce8de3
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cec7490>
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7574%252F2387574%252Fexterior_front_driver-1774720773499.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_front_driver-1774720773499.jpg saved to cache
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86b77ad5-ea3b-5379-8233-b1bd60475650
2026-03-29 20:11:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86b77ad5-ea3b-5379-8233-b1bd60475650, skipping ID generation
2026-03-29 20:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86b77ad5-ea3b-5379-8233-b1bd60475650 with scrape type 1
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86b77ad5-ea3b-5379-8233-b1bd60475650 sending to next pipeline
2026-03-29 20:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 86b77ad5-ea3b-5379-8233-b1bd60475650, identifier: 2387574
2026-03-29 20:11:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b801ebf-bfb8-5650-8c22-790b3f5856b7 with identifier: 19695598
2026-03-29 20:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b801ebf-bfb8-5650-8c22-790b3f5856b7 with scrape type 1
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b801ebf-bfb8-5650-8c22-790b3f5856b7
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5598%252F19695598%252Fexterior_front_driver-1774457801529.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5598/19695598/exterior_front_driver-1774457801529.jpg not downloaded yet
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x08'
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d093c90>
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa685496-ce0f-5774-a7fa-ccfce240244e/fa685496-ce0f-5774-a7fa-ccfce240244e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3355%252F8203355%252Fdocs_service_history-1774711410962.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5cdb3fb7a74cc5df1716da33923de0e0') HTTP/1.1" 204 0
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3355/8203355/docs_service_history-1774711410962.jpg?ixlib=js-3.8.0&auto=format&s=5cdb3fb7a74cc5df1716da33923de0e0 saved to cache
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa685496-ce0f-5774-a7fa-ccfce240244e
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc83610>
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6482%252F18086482%252Fexterior_front_passenger-1774529631130.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_front_passenger-1774529631130.jpeg saved to cache
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a46ed00-c645-5781-8b3c-dba182fa250c
2026-03-29 20:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 86b77ad5-ea3b-5379-8233-b1bd60475650 with identifier: 2387574
2026-03-29 20:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 86b77ad5-ea3b-5379-8233-b1bd60475650 with identifier: 2387574
2026-03-29 20:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 86b77ad5-ea3b-5379-8233-b1bd60475650 with identifier: 2387574 to the API
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_front_driver-1774720773499.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '86b77ad5-ea3b-5379-8233-b1bd60475650',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'OU13 GCF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/2387574',
'listing': 'auction',
'location': 'Buckinghamshire Rickmansworth',
'make': 'BMW',
'model': 'X3',
'odometer': 53742,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1076312,
'Height': 2180,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_front_driver-1774720773499.jpg',
'Width': 2906},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1853630,
'Height': 2734,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_rear_driver-1774720855142.jpg',
'Width': 3645},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1475314,
'Height': 2543,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_front_passenger-1774720939472.jpg',
'Width': 3390},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1641064,
'Height': 2525,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7574/2387574/exterior_rear_passenger-1774720900921.jpg',
'Width': 3367},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1750229,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7574/2387574/interior_front_seats-1774721995839.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1504402,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7574/2387574/interior_rear_seats-1774722032777.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1882157,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7574/2387574/interior_dashboard-1774777108983.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1518252,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7574/2387574/instrument_cluster-1774721942367.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1494551,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7574/2387574/interior_boot-1774721941358.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b77ad5-ea3b-5379-8233-b1bd60475650/86b77ad5-ea3b-5379-8233-b1bd60475650_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1249737,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7574/2387574/docs_service_history-1774778768428.jpg?ixlib=js-3.8.0&auto=format&s=6466645abc8733a8840783f002818d25',
'Width': 3840}],
'price': 9075,
'price_includes_vat': False,
'registration_date': '2013-03-04',
'seats_number': None,
'seller_name': None,
'title': 'BMW X3 xDrive 30d SE Auto',
'transmission': 'automatic',
'trim': 'xDrive 30d SE Auto',
'vin': 'WBAWY520700B53388',
'year': 2013}
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%272387574%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [motorway.uk] INFO: Saving data for 2387574: {'created_time': 1774815096.800283, 'last_price_update_time': 1774815096.800291, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='2387574') HTTP/1.1" 204 0
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5598%252F19695598%252Fexterior_rear_driver-1774457813246.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5598/19695598/exterior_rear_driver-1774457813246.jpg not downloaded yet
2026-03-29 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16059595.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1296&page=36&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5598%252F19695598%252Fexterior_front_passenger-1774457837578.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5598/19695598/exterior_front_passenger-1774457837578.jpg not downloaded yet
2026-03-29 20:11:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5598%252F19695598%252Fexterior_rear_passenger-1774457824172.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5598/19695598/exterior_rear_passenger-1774457824172.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5598%252F19695598%252Finterior_front_seats-1774458003510.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5598/19695598/interior_front_seats-1774458003510.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5598%252F19695598%252Finterior_rear_seats-1774458044808.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5598/19695598/interior_rear_seats-1774458044808.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5598%252F19695598%252Finterior_dashboard-1774700624214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5598/19695598/interior_dashboard-1774700624214.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5598%252F19695598%252Finstrument_cluster-1774458116819.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5598/19695598/instrument_cluster-1774458116819.jpg not downloaded yet
2026-03-29 20:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eac07d2-9bd6-585c-beba-ccb9522acd50 with identifier: 16059595
2026-03-29 20:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eac07d2-9bd6-585c-beba-ccb9522acd50 with scrape type 1
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3eac07d2-9bd6-585c-beba-ccb9522acd50
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9595%252F16059595%252Fexterior_front_driver-1774619810107.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9595/16059595/exterior_front_driver-1774619810107.jpg not downloaded yet
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20488003
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488003%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [motorway.uk] INFO: Scrape type for 20488003: 1
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5598%252F19695598%252Finterior_boot-1774458112925.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5598/19695598/interior_boot-1774458112925.jpg not downloaded yet
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9595%252F16059595%252Fexterior_rear_driver-1774619827281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9595/16059595/exterior_rear_driver-1774619827281.jpg not downloaded yet
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 17841081
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 19220462
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 17874420
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717874420%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [motorway.uk] INFO: Scrape type for 17874420: 1
2026-03-29 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20375931.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20357195.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5598%252F19695598%252Fdocs_service_history-1774458534475.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3408c610c27f8aee571e2104edeed473%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5598/19695598/docs_service_history-1774458534475.jpg?ixlib=js-3.8.0&auto=format&s=3408c610c27f8aee571e2104edeed473 not downloaded yet
2026-03-29 20:11:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9595%252F16059595%252Fexterior_front_passenger-1774619814923.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9595/16059595/exterior_front_passenger-1774619814923.jpg not downloaded yet
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 12473126
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20404112
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20463012
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20141197
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20384563
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720384563%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [motorway.uk] INFO: Scrape type for 20384563: 1
2026-03-29 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20325750.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9595%252F16059595%252Fexterior_rear_passenger-1774619822808.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9595/16059595/exterior_rear_passenger-1774619822808.jpg not downloaded yet
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20411686
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720411686%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [motorway.uk] INFO: Scrape type for 20411686: 1
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9595%252F16059595%252Finterior_front_seats-1774619825525.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9595/16059595/interior_front_seats-1774619825525.jpg not downloaded yet
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20130547
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20484943
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 19189698
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20485884
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 7586308
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277586308%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [motorway.uk] INFO: Scrape type for 7586308: 2
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9595%252F16059595%252Finterior_rear_seats-1774619836062.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9595/16059595/interior_rear_seats-1774619836062.jpg not downloaded yet
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 19750029
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20454873
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720454873%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [motorway.uk] INFO: Scrape type for 20454873: 0
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 19243367
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 13628545
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 17857909
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 19991969
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719991969%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [motorway.uk] INFO: Scrape type for 19991969: 1
2026-03-29 20:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1870d742-7455-5161-b302-f42681e39a0b with identifier: 20375931
2026-03-29 20:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1870d742-7455-5161-b302-f42681e39a0b with scrape type 1
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1870d742-7455-5161-b302-f42681e39a0b
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5931%252F20375931%252Fexterior_front_driver-1774106671604.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5931/20375931/exterior_front_driver-1774106671604.jpg not downloaded yet
2026-03-29 20:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f2eb7d1-8998-5957-bb96-f8e2c49616c2 with identifier: 20357195
2026-03-29 20:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f2eb7d1-8998-5957-bb96-f8e2c49616c2 with scrape type 1
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f2eb7d1-8998-5957-bb96-f8e2c49616c2
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7195%252F20357195%252Fexterior_front_driver-1774632287206.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7195/20357195/exterior_front_driver-1774632287206.jpeg not downloaded yet
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9595%252F16059595%252Finterior_dashboard-1774619841780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9595/16059595/interior_dashboard-1774619841780.jpg not downloaded yet
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20483258
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 7888251
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20436941
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720436941%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [motorway.uk] INFO: Scrape type for 20436941: 1
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5931%252F20375931%252Fexterior_rear_driver-1774106674513.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5931/20375931/exterior_rear_driver-1774106674513.jpg not downloaded yet
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7195%252F20357195%252Fexterior_rear_driver-1774632341586.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7195/20357195/exterior_rear_driver-1774632341586.jpeg not downloaded yet
2026-03-29 20:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 147f1fb4-587b-5dcf-abab-0d8c8591dcdc with identifier: 20325750
2026-03-29 20:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc with scrape type 1
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5750%252F20325750%252Fexterior_front_driver-1774699354874.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_front_driver-1774699354874.jpg not downloaded yet
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9595%252F16059595%252Finstrument_cluster-1774619922378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9595/16059595/instrument_cluster-1774619922378.jpg not downloaded yet
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20471387
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471387%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [motorway.uk] INFO: Scrape type for 20471387: 1
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5931%252F20375931%252Fexterior_front_passenger-1774106679579.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5931/20375931/exterior_front_passenger-1774106679579.jpg not downloaded yet
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7195%252F20357195%252Fexterior_front_passenger-1774632300520.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7195/20357195/exterior_front_passenger-1774632300520.jpeg not downloaded yet
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5750%252F20325750%252Fexterior_rear_driver-1774699604907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_rear_driver-1774699604907.jpg not downloaded yet
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9595%252F16059595%252Finterior_boot-1774619841073.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9595/16059595/interior_boot-1774619841073.jpg not downloaded yet
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 16024734
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20492752
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720492752%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [motorway.uk] INFO: Scrape type for 20492752: 1
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5931%252F20375931%252Fexterior_rear_passenger-1774106681379.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5931/20375931/exterior_rear_passenger-1774106681379.jpg not downloaded yet
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7195%252F20357195%252Fexterior_rear_passenger-1774632326973.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7195/20357195/exterior_rear_passenger-1774632326973.jpeg not downloaded yet
2026-03-29 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3355/8203355/docs_service_history-1774711407242.jpg?ixlib=js-3.8.0&auto=format&s=3d51464ce8ffae89b72e3515ba3b2796> (referer: None)
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5750%252F20325750%252Fexterior_front_passenger-1774699476491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_front_passenger-1774699476491.jpg not downloaded yet
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F9595%252F16059595%252Fdocs_service_history-1771080834600.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ace4de72b40ac606377676768b60b58%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/9595/16059595/docs_service_history-1771080834600.jpg?ixlib=js-3.8.0&auto=format&s=3ace4de72b40ac606377676768b60b58 already downloaded
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20492217
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20435214
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 20461651
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720461651%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [motorway.uk] INFO: Scrape type for 20461651: 1
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5931%252F20375931%252Finterior_front_seats-1774107695350.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5931/20375931/interior_front_seats-1774107695350.jpg not downloaded yet
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7195%252F20357195%252Finterior_front_seats-1774634969273.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7195/20357195/interior_front_seats-1774634969273.jpeg not downloaded yet
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5750%252F20325750%252Fexterior_rear_passenger-1774699539539.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_rear_passenger-1774699539539.jpg not downloaded yet
2026-03-29 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9221/20299221/interior_dashboard-1774634218899.jpg> (referer: None)
2026-03-29 20:11:37 [motorway.uk] INFO: Found listing with ID: 3723283
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273723283%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [motorway.uk] INFO: Scrape type for 3723283: 1
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5931%252F20375931%252Finterior_rear_seats-1774107591976.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5931/20375931/interior_rear_seats-1774107591976.jpg not downloaded yet
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7195%252F20357195%252Finterior_rear_seats-1774635008128.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7195/20357195/interior_rear_seats-1774635008128.jpeg not downloaded yet
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5750%252F20325750%252Finterior_front_seats-1774700114495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5750/20325750/interior_front_seats-1774700114495.jpg not downloaded yet
2026-03-29 20:11:38 [motorway.uk] INFO: Found listing with ID: 19401615
2026-03-29 20:11:38 [motorway.uk] INFO: Found listing with ID: 15388383
2026-03-29 20:11:38 [motorway.uk] INFO: Found listing with ID: 19433460
2026-03-29 20:11:38 [motorway.uk] INFO: Found listing with ID: 19935539
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719935539%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [motorway.uk] INFO: Scrape type for 19935539: 1
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5931%252F20375931%252Finterior_dashboard-1774107631717.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5931/20375931/interior_dashboard-1774107631717.jpg not downloaded yet
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7195%252F20357195%252F20357195-interior_dashboard-modified-1774693475014.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7195/20357195/20357195-interior_dashboard-modified-1774693475014.jpeg not downloaded yet
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5750%252F20325750%252Finterior_rear_seats-1774700129969.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5750/20325750/interior_rear_seats-1774700129969.jpg not downloaded yet
2026-03-29 20:11:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x08'
2026-03-29 20:11:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d3f1590>
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa685496-ce0f-5774-a7fa-ccfce240244e/fa685496-ce0f-5774-a7fa-ccfce240244e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3355%252F8203355%252Fdocs_service_history-1774711407242.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3d51464ce8ffae89b72e3515ba3b2796') HTTP/1.1" 204 0
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3355/8203355/docs_service_history-1774711407242.jpg?ixlib=js-3.8.0&auto=format&s=3d51464ce8ffae89b72e3515ba3b2796 saved to cache
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa685496-ce0f-5774-a7fa-ccfce240244e
2026-03-29 20:11:38 [motorway.uk] INFO: Found listing with ID: 20490910
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5931%252F20375931%252Finstrument_cluster-1774107594493.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5931/20375931/instrument_cluster-1774107594493.jpg not downloaded yet
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7195%252F20357195%252Finstrument_cluster-1774632113721.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7195/20357195/instrument_cluster-1774632113721.jpeg not downloaded yet
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5750%252F20325750%252Finterior_dashboard-1774700163879.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5750/20325750/interior_dashboard-1774700163879.jpg not downloaded yet
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5edc50>
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942b0137-4c91-5212-a508-0187f7ce8de3/942b0137-4c91-5212-a508-0187f7ce8de3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9221%252F20299221%252Finterior_dashboard-1774634218899.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9221/20299221/interior_dashboard-1774634218899.jpg saved to cache
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 942b0137-4c91-5212-a508-0187f7ce8de3
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5931%252F20375931%252Finterior_boot-1774107619943.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5931/20375931/interior_boot-1774107619943.jpg not downloaded yet
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7195%252F20357195%252Finterior_boot-1774635148857.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7195/20357195/interior_boot-1774635148857.jpeg not downloaded yet
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5598/19695598/exterior_rear_driver-1774457813246.jpg> (referer: None)
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5750%252F20325750%252Finstrument_cluster-1774700207336.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5750/20325750/instrument_cluster-1774700207336.jpg not downloaded yet
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5598/19695598/docs_service_history-1774458534475.jpg?ixlib=js-3.8.0&auto=format&s=3408c610c27f8aee571e2104edeed473> (referer: None)
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5931%252F20375931%252Fdocs_service_history-1774107928603.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7590579fa31b80c8a2b0d2b792e643fc%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5931/20375931/docs_service_history-1774107928603.jpg?ixlib=js-3.8.0&auto=format&s=7590579fa31b80c8a2b0d2b792e643fc not downloaded yet
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7195%252F20357195%252Fdocs_service_history-1774678353709.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3c9949942bb80d56841548b2b6754d3a%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7195/20357195/docs_service_history-1774678353709.jpeg?ixlib=js-3.8.0&auto=format&s=3c9949942bb80d56841548b2b6754d3a not downloaded yet
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20473409.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5598/19695598/exterior_front_driver-1774457801529.jpg> (referer: None)
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5750%252F20325750%252Finterior_boot-1774700180813.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5750/20325750/interior_boot-1774700180813.jpg not downloaded yet
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_rear_driver-1774529675118.jpeg> (referer: None)
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5750%252F20325750%252Fdocs_service_history-1774711510720.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D10070c546dc8e70031783c7e9d0b1ac5%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5750/20325750/docs_service_history-1774711510720.jpg?ixlib=js-3.8.0&auto=format&s=10070c546dc8e70031783c7e9d0b1ac5 not downloaded yet
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9595/16059595/exterior_rear_driver-1774619827281.jpg> (referer: None)
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c739e90>
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b801ebf-bfb8-5650-8c22-790b3f5856b7/1b801ebf-bfb8-5650-8c22-790b3f5856b7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5598%252F19695598%252Fexterior_rear_driver-1774457813246.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5598/19695598/exterior_rear_driver-1774457813246.jpg saved to cache
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b801ebf-bfb8-5650-8c22-790b3f5856b7
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1a92d0>
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b801ebf-bfb8-5650-8c22-790b3f5856b7/1b801ebf-bfb8-5650-8c22-790b3f5856b7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5598%252F19695598%252Fdocs_service_history-1774458534475.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3408c610c27f8aee571e2104edeed473') HTTP/1.1" 204 0
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5598/19695598/docs_service_history-1774458534475.jpg?ixlib=js-3.8.0&auto=format&s=3408c610c27f8aee571e2104edeed473 saved to cache
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b801ebf-bfb8-5650-8c22-790b3f5856b7
2026-03-29 20:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 601e9911-0f23-5436-8b9f-5d54ac827e82 with identifier: 20473409
2026-03-29 20:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601e9911-0f23-5436-8b9f-5d54ac827e82 with scrape type 1
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 601e9911-0f23-5436-8b9f-5d54ac827e82
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20473409%252Fexterior_front_driver-1774629333900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_front_driver-1774629333900.jpg not downloaded yet
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3cb390>
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b801ebf-bfb8-5650-8c22-790b3f5856b7/1b801ebf-bfb8-5650-8c22-790b3f5856b7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5598%252F19695598%252Fexterior_front_driver-1774457801529.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5598/19695598/exterior_front_driver-1774457801529.jpg saved to cache
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b801ebf-bfb8-5650-8c22-790b3f5856b7
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d095c50>
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6482%252F18086482%252Fexterior_rear_driver-1774529675118.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_rear_driver-1774529675118.jpeg saved to cache
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a46ed00-c645-5781-8b3c-dba182fa250c
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20473409%252Fexterior_rear_driver-1774636643887.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_rear_driver-1774636643887.jpg not downloaded yet
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db77f10>
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eac07d2-9bd6-585c-beba-ccb9522acd50/3eac07d2-9bd6-585c-beba-ccb9522acd50_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9595%252F16059595%252Fexterior_rear_driver-1774619827281.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9595/16059595/exterior_rear_driver-1774619827281.jpg saved to cache
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3eac07d2-9bd6-585c-beba-ccb9522acd50
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20473409%252Fexterior_front_passenger-1774629337129.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_front_passenger-1774629337129.jpg not downloaded yet
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20473409%252Fexterior_rear_passenger-1774629339114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_rear_passenger-1774629339114.jpg not downloaded yet
2026-03-29 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_front_driver-1774529613714.jpeg> (referer: None)
2026-03-29 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9221/20299221/interior_boot-1774103119981.jpg> (referer: None)
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3409%252F20473409%252Finterior_front_seats-1774636878549.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3409/20473409/interior_front_seats-1774636878549.jpg not downloaded yet
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3409%252F20473409%252Finterior_rear_seats-1774636843296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3409/20473409/interior_rear_seats-1774636843296.jpg not downloaded yet
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3409%252F20473409%252Finterior_dashboard-1774688264106.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3409/20473409/interior_dashboard-1774688264106.jpg not downloaded yet
2026-03-29 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_rear_driver-1774699604907.jpg> (referer: None)
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20473409%252Finstrument_cluster-1774632190364.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20473409/instrument_cluster-1774632190364.jpg not downloaded yet
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3409%252F20473409%252Finterior_boot-1774632167357.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3409/20473409/interior_boot-1774632167357.jpg not downloaded yet
2026-03-29 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5931/20375931/interior_boot-1774107619943.jpg> (referer: None)
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3409%252F20473409%252Fdocs_service_history-1774639962898.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De2671758c24a3dc939d85c09095ca2da%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3409/20473409/docs_service_history-1774639962898.jpg?ixlib=js-3.8.0&auto=format&s=e2671758c24a3dc939d85c09095ca2da not downloaded yet
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2df590>
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6482%252F18086482%252Fexterior_front_driver-1774529613714.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_front_driver-1774529613714.jpeg saved to cache
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a46ed00-c645-5781-8b3c-dba182fa250c
2026-03-29 20:11:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a46ed00-c645-5781-8b3c-dba182fa250c, skipping ID generation
2026-03-29 20:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a46ed00-c645-5781-8b3c-dba182fa250c with scrape type 1
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a46ed00-c645-5781-8b3c-dba182fa250c sending to next pipeline
2026-03-29 20:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5a46ed00-c645-5781-8b3c-dba182fa250c, identifier: 18086482
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5e6350>
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942b0137-4c91-5212-a508-0187f7ce8de3/942b0137-4c91-5212-a508-0187f7ce8de3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9221%252F20299221%252Finterior_boot-1774103119981.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9221/20299221/interior_boot-1774103119981.jpg saved to cache
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 942b0137-4c91-5212-a508-0187f7ce8de3
2026-03-29 20:11:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5a46ed00-c645-5781-8b3c-dba182fa250c with identifier: 18086482
2026-03-29 20:11:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5a46ed00-c645-5781-8b3c-dba182fa250c with identifier: 18086482
2026-03-29 20:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5a46ed00-c645-5781-8b3c-dba182fa250c with identifier: 18086482 to the API
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_front_driver-1774529613714.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '5a46ed00-c645-5781-8b3c-dba182fa250c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YK16 FLW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18086482',
'listing': 'auction',
'location': 'South Yorkshire Sheffield',
'make': 'BMW',
'model': '3 Series',
'odometer': 48306,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2836747,
'Height': 2730,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_front_driver-1774529613714.jpeg',
'Width': 3640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2812977,
'Height': 2835,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_rear_driver-1774529675118.jpeg',
'Width': 3780},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3272152,
'Height': 2803,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_front_passenger-1774529631130.jpeg',
'Width': 3737},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3008291,
'Height': 2912,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6482/18086482/exterior_rear_passenger-1774529679016.jpeg',
'Width': 3882},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2593006,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6482/18086482/interior_front_seats-1774548649613.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2431665,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6482/18086482/interior_rear_seats-1774547992089.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3151561,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6482/18086482/interior_dashboard-1774548017634.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2344502,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6482/18086482/instrument_cluster-1774548060308.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2859162,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6482/18086482/interior_boot-1774548416009.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a46ed00-c645-5781-8b3c-dba182fa250c/5a46ed00-c645-5781-8b3c-dba182fa250c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3473283,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6482/18086482/docs_service_history-1774528473649.jpeg?ixlib=js-3.8.0&auto=format&s=167fee3bd9ca14a53a176ae057a26f51',
'Width': 4032}],
'price': 16117,
'price_includes_vat': False,
'registration_date': '2016-03-15',
'seats_number': None,
'seller_name': None,
'title': 'BMW 335D xDrive M Sport Auto',
'transmission': 'automatic',
'trim': '335D xDrive M Sport Auto',
'vin': 'WBA8F72080K720817',
'year': 2016}
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718086482%27 HTTP/1.1" 200 None
2026-03-29 20:11:40 [motorway.uk] INFO: Saving data for 18086482: {'created_time': 1774815100.408979, 'last_price_update_time': 1774815100.408991, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18086482') HTTP/1.1" 204 0
2026-03-29 20:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0e58d0>
2026-03-29 20:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5750%252F20325750%252Fexterior_rear_driver-1774699604907.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_rear_driver-1774699604907.jpg saved to cache
2026-03-29 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc
2026-03-29 20:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2df25550>
2026-03-29 20:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1870d742-7455-5161-b302-f42681e39a0b/1870d742-7455-5161-b302-f42681e39a0b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5931%252F20375931%252Finterior_boot-1774107619943.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5931/20375931/interior_boot-1774107619943.jpg saved to cache
2026-03-29 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1870d742-7455-5161-b302-f42681e39a0b
2026-03-29 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20436771.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20021276.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17874420.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20501015.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18339762.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_front_driver-1774629333900.jpg> (referer: None)
2026-03-29 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_rear_driver-1774636643887.jpg> (referer: None)
2026-03-29 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7195/20357195/interior_boot-1774635148857.jpeg> (referer: None)
2026-03-29 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7195/20357195/instrument_cluster-1774632113721.jpeg> (referer: None)
2026-03-29 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5750/20325750/docs_service_history-1774711510720.jpg?ixlib=js-3.8.0&auto=format&s=10070c546dc8e70031783c7e9d0b1ac5> (referer: None)
2026-03-29 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5750/20325750/interior_boot-1774700180813.jpg> (referer: None)
2026-03-29 20:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13c36ae8-de95-55eb-ac4b-3574f12051ec with identifier: 20436771
2026-03-29 20:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13c36ae8-de95-55eb-ac4b-3574f12051ec with scrape type 1
2026-03-29 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13c36ae8-de95-55eb-ac4b-3574f12051ec
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6771%252F20436771%252Fexterior_front_driver-1774637154102.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6771/20436771/exterior_front_driver-1774637154102.jpeg not downloaded yet
2026-03-29 20:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 030ae5c0-863d-5f0d-b083-e66f10b4538c with identifier: 20021276
2026-03-29 20:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 030ae5c0-863d-5f0d-b083-e66f10b4538c with scrape type 1
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 030ae5c0-863d-5f0d-b083-e66f10b4538c
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1276%252F20021276%252Fexterior_front_driver-1774711875159.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1276/20021276/exterior_front_driver-1774711875159.jpg not downloaded yet
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6771%252F20436771%252Fexterior_rear_driver-1774637200207.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6771/20436771/exterior_rear_driver-1774637200207.jpeg not downloaded yet
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1276%252F20021276%252Fexterior_rear_driver-1774710231784.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1276/20021276/exterior_rear_driver-1774710231784.jpg not downloaded yet
2026-03-29 20:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0 with identifier: 17874420
2026-03-29 20:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0 with scrape type 1
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4420%252F17874420%252Fexterior_front_driver-1774006559717.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_front_driver-1774006559717.jpeg not downloaded yet
2026-03-29 20:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8 with identifier: 20501015
2026-03-29 20:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8 with scrape type 1
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20501015%252Fexterior_front_driver-1774781741531.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_front_driver-1774781741531.jpg not downloaded yet
2026-03-29 20:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 051c027e-3060-5584-9c36-d2bf1a6b7faa with identifier: 18339762
2026-03-29 20:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 051c027e-3060-5584-9c36-d2bf1a6b7faa with scrape type 1
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 051c027e-3060-5584-9c36-d2bf1a6b7faa
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9762%252F18339762%252Fexterior_front_driver-1774692709272.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_front_driver-1774692709272.jpeg not downloaded yet
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6771%252F20436771%252Fexterior_front_passenger-1774637178208.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6771/20436771/exterior_front_passenger-1774637178208.jpeg not downloaded yet
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1276%252F20021276%252Fexterior_front_passenger-1774710233766.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1276/20021276/exterior_front_passenger-1774710233766.jpg not downloaded yet
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4420%252F17874420%252Fexterior_rear_driver-1774006561865.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_rear_driver-1774006561865.jpeg not downloaded yet
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20501015%252Fexterior_rear_driver-1774781766759.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_rear_driver-1774781766759.jpg not downloaded yet
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9762%252F18339762%252Fexterior_rear_driver-1774692767713.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_rear_driver-1774692767713.jpeg not downloaded yet
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dda6850>
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20473409%252Fexterior_front_driver-1774629333900.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_front_driver-1774629333900.jpg saved to cache
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 601e9911-0f23-5436-8b9f-5d54ac827e82
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8c5f50>
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20473409%252Fexterior_rear_driver-1774636643887.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_rear_driver-1774636643887.jpg saved to cache
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 601e9911-0f23-5436-8b9f-5d54ac827e82
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00.r\xbc\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xc2\xa9\x00.h\xc2\x00\x00\x00\x00'
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8bf210>
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2eb7d1-8998-5957-bb96-f8e2c49616c2/5f2eb7d1-8998-5957-bb96-f8e2c49616c2_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7195%252F20357195%252Finterior_boot-1774635148857.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7195/20357195/interior_boot-1774635148857.jpeg saved to cache
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f2eb7d1-8998-5957-bb96-f8e2c49616c2
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00.\xbf\xa6\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02q\x9d\x00.\xb5\xa2\x00\x00\x00\x00'
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8c2c10>
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2eb7d1-8998-5957-bb96-f8e2c49616c2/5f2eb7d1-8998-5957-bb96-f8e2c49616c2_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7195%252F20357195%252Finstrument_cluster-1774632113721.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7195/20357195/instrument_cluster-1774632113721.jpeg saved to cache
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f2eb7d1-8998-5957-bb96-f8e2c49616c2
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003\xa0\xdf\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02X\x80\x003\x8b4\x00\x00\x00\x00'
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8a9bd0>
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5750%252F20325750%252Fdocs_service_history-1774711510720.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D10070c546dc8e70031783c7e9d0b1ac5') HTTP/1.1" 204 0
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5750/20325750/docs_service_history-1774711510720.jpg?ixlib=js-3.8.0&auto=format&s=10070c546dc8e70031783c7e9d0b1ac5 saved to cache
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d828690>
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5750%252F20325750%252Finterior_boot-1774700180813.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5750/20325750/interior_boot-1774700180813.jpg saved to cache
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6771%252F20436771%252F20436771-exterior_rear_passenger-modified-1774689920393.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6771/20436771/20436771-exterior_rear_passenger-modified-1774689920393.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1276%252F20021276%252Fexterior_rear_passenger-1774710229850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1276/20021276/exterior_rear_passenger-1774710229850.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4420%252F17874420%252Fexterior_front_passenger-1774006558258.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_front_passenger-1774006558258.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20501015%252Fexterior_front_passenger-1774781791212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_front_passenger-1774781791212.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9762%252F18339762%252Fexterior_front_passenger-1774692725268.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_front_passenger-1774692725268.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6771%252F20436771%252Finterior_front_seats-1774637353744.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6771/20436771/interior_front_seats-1774637353744.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1276%252F20021276%252Finterior_front_seats-1774710651696.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1276/20021276/interior_front_seats-1774710651696.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4420%252F17874420%252Fexterior_rear_passenger-1774006558386.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_rear_passenger-1774006558386.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20501015%252Fexterior_rear_passenger-1774781783888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_rear_passenger-1774781783888.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9762%252F18339762%252Fexterior_rear_passenger-1774692750022.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_rear_passenger-1774692750022.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6771%252F20436771%252Finterior_rear_seats-1774637290768.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6771/20436771/interior_rear_seats-1774637290768.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1276%252F20021276%252Finterior_rear_seats-1774710654183.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1276/20021276/interior_rear_seats-1774710654183.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4420%252F17874420%252Finterior_front_seats-1774006378205.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4420/17874420/interior_front_seats-1774006378205.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1015%252F20501015%252Finterior_front_seats-1774782098756.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1015/20501015/interior_front_seats-1774782098756.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9762%252F18339762%252Finterior_front_seats-1774692794120.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9762/18339762/interior_front_seats-1774692794120.jpeg not downloaded yet
2026-03-29 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3409/20473409/interior_dashboard-1774688264106.jpg> (referer: None)
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6771%252F20436771%252Finterior_dashboard-1774637319999.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6771/20436771/interior_dashboard-1774637319999.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1276%252F20021276%252Finterior_dashboard-1774710665941.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1276/20021276/interior_dashboard-1774710665941.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4420%252F17874420%252Finterior_rear_seats-1774006564018.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4420/17874420/interior_rear_seats-1774006564018.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1015%252F20501015%252Finterior_rear_seats-1774782143205.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1015/20501015/interior_rear_seats-1774782143205.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9762%252F18339762%252Finterior_rear_seats-1774692856525.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9762/18339762/interior_rear_seats-1774692856525.jpeg not downloaded yet
2026-03-29 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3409/20473409/interior_boot-1774632167357.jpg> (referer: None)
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6771%252F20436771%252Finstrument_cluster-1774637395176.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6771/20436771/instrument_cluster-1774637395176.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1276%252F20021276%252Finstrument_cluster-1774710699568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1276/20021276/instrument_cluster-1774710699568.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4420%252F17874420%252Finterior_dashboard-1774006578129.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4420/17874420/interior_dashboard-1774006578129.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20501015%252Finterior_dashboard-1774782308141.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20501015/interior_dashboard-1774782308141.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9762%252F18339762%252Finterior_dashboard-1774692883083.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9762/18339762/interior_dashboard-1774692883083.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6771%252F20436771%252Finterior_boot-1774637323640.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6771/20436771/interior_boot-1774637323640.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1276%252F20021276%252Finterior_boot-1774710650062.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1276/20021276/interior_boot-1774710650062.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4420%252F17874420%252Finstrument_cluster-1774006487938.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4420/17874420/instrument_cluster-1774006487938.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20501015%252Finstrument_cluster-1774782167789.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20501015/instrument_cluster-1774782167789.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9762%252F18339762%252Finterior_boot-1774692891948.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9762/18339762/interior_boot-1774692891948.jpeg not downloaded yet
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d7a8f10>
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3409%252F20473409%252Finterior_dashboard-1774688264106.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3409/20473409/interior_dashboard-1774688264106.jpg saved to cache
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 601e9911-0f23-5436-8b9f-5d54ac827e82
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d848a50>
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3409%252F20473409%252Finterior_boot-1774632167357.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3409/20473409/interior_boot-1774632167357.jpg saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 601e9911-0f23-5436-8b9f-5d54ac827e82
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6771%252F20436771%252Fdocs_service_history-1774638072383.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8dd0e53e0f83fc0d18c7a5897a992660%27 HTTP/1.1" 200 None
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6771/20436771/docs_service_history-1774638072383.jpeg?ixlib=js-3.8.0&auto=format&s=8dd0e53e0f83fc0d18c7a5897a992660 not downloaded yet
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1276%252F20021276%252Fdocs_service_history-1774711342611.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dedd6e57b8e527643f3241f60a2ff9040%27 HTTP/1.1" 200 None
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1276/20021276/docs_service_history-1774711342611.jpg?ixlib=js-3.8.0&auto=format&s=edd6e57b8e527643f3241f60a2ff9040 not downloaded yet
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4420%252F17874420%252Finterior_boot-1774006566166.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4420/17874420/interior_boot-1774006566166.jpeg not downloaded yet
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1015%252F20501015%252Finterior_boot-1774782253507.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1015/20501015/interior_boot-1774782253507.jpg not downloaded yet
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9762%252F18339762%252Fdocs_service_history-1774693247788.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D402163614be6ea26eb4b222913d1e9f6%27 HTTP/1.1" 200 None
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9762/18339762/docs_service_history-1774693247788.jpeg?ixlib=js-3.8.0&auto=format&s=402163614be6ea26eb4b222913d1e9f6 not downloaded yet
2026-03-29 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3409/20473409/interior_rear_seats-1774636843296.jpg> (referer: None)
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4420%252F17874420%252Fdocs_service_history-1774006902091.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D49bdb5aa97f887720032f1cfaa877a19%27 HTTP/1.1" 200 None
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4420/17874420/docs_service_history-1774006902091.jpeg?ixlib=js-3.8.0&auto=format&s=49bdb5aa97f887720032f1cfaa877a19 not downloaded yet
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1015%252F20501015%252Fdocs_service_history-1774794244694.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db6c1f8b6e699e65c803a6660f10201c6%27 HTTP/1.1" 200 None
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1015/20501015/docs_service_history-1774794244694.jpg?ixlib=js-3.8.0&auto=format&s=b6c1f8b6e699e65c803a6660f10201c6 not downloaded yet
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9762%252F18339762%252Fdocs_service_history-1774693257926.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcfae5691f271b41fc348e99d7ed8fe0e%27 HTTP/1.1" 200 None
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9762/18339762/docs_service_history-1774693257926.jpeg?ixlib=js-3.8.0&auto=format&s=cfae5691f271b41fc348e99d7ed8fe0e not downloaded yet
2026-03-29 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7195/20357195/docs_service_history-1774678353709.jpeg?ixlib=js-3.8.0&auto=format&s=3c9949942bb80d56841548b2b6754d3a> (referer: None)
2026-03-29 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5931/20375931/docs_service_history-1774107928603.jpg?ixlib=js-3.8.0&auto=format&s=7590579fa31b80c8a2b0d2b792e643fc> (referer: None)
2026-03-29 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3409/20473409/interior_front_seats-1774636878549.jpg> (referer: None)
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d926cd0>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3409%252F20473409%252Finterior_rear_seats-1774636843296.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3409/20473409/interior_rear_seats-1774636843296.jpg saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 601e9911-0f23-5436-8b9f-5d54ac827e82
2026-03-29 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_rear_passenger-1774629339114.jpg> (referer: None)
2026-03-29 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3409/20473409/docs_service_history-1774639962898.jpg?ixlib=js-3.8.0&auto=format&s=e2671758c24a3dc939d85c09095ca2da> (referer: None)
2026-03-29 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3409/20473409/instrument_cluster-1774632190364.jpg> (referer: None)
2026-03-29 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1276/20021276/exterior_rear_passenger-1774710229850.jpg> (referer: None)
2026-03-29 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_front_passenger-1774629337129.jpg> (referer: None)
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1f9910>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2eb7d1-8998-5957-bb96-f8e2c49616c2/5f2eb7d1-8998-5957-bb96-f8e2c49616c2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7195%252F20357195%252Fdocs_service_history-1774678353709.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3c9949942bb80d56841548b2b6754d3a') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7195/20357195/docs_service_history-1774678353709.jpeg?ixlib=js-3.8.0&auto=format&s=3c9949942bb80d56841548b2b6754d3a saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f2eb7d1-8998-5957-bb96-f8e2c49616c2
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d06d950>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1870d742-7455-5161-b302-f42681e39a0b/1870d742-7455-5161-b302-f42681e39a0b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5931%252F20375931%252Fdocs_service_history-1774107928603.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7590579fa31b80c8a2b0d2b792e643fc') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5931/20375931/docs_service_history-1774107928603.jpg?ixlib=js-3.8.0&auto=format&s=7590579fa31b80c8a2b0d2b792e643fc saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1870d742-7455-5161-b302-f42681e39a0b
2026-03-29 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_front_passenger-1774781791212.jpg> (referer: None)
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d700190>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3409%252F20473409%252Finterior_front_seats-1774636878549.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3409/20473409/interior_front_seats-1774636878549.jpg saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 601e9911-0f23-5436-8b9f-5d54ac827e82
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da4f1d0>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20473409%252Fexterior_rear_passenger-1774629339114.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_rear_passenger-1774629339114.jpg saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 601e9911-0f23-5436-8b9f-5d54ac827e82
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d06cfd0>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3409%252F20473409%252Fdocs_service_history-1774639962898.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De2671758c24a3dc939d85c09095ca2da') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3409/20473409/docs_service_history-1774639962898.jpg?ixlib=js-3.8.0&auto=format&s=e2671758c24a3dc939d85c09095ca2da saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 601e9911-0f23-5436-8b9f-5d54ac827e82
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c4510>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20473409%252Finstrument_cluster-1774632190364.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20473409/instrument_cluster-1774632190364.jpg saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 601e9911-0f23-5436-8b9f-5d54ac827e82
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f68d890>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1276%252F20021276%252Fexterior_rear_passenger-1774710229850.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1276/20021276/exterior_rear_passenger-1774710229850.jpg saved to cache
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 030ae5c0-863d-5f0d-b083-e66f10b4538c
2026-03-29 20:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddab850>
2026-03-29 20:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20473409%252Fexterior_front_passenger-1774629337129.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_front_passenger-1774629337129.jpg saved to cache
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 601e9911-0f23-5436-8b9f-5d54ac827e82
2026-03-29 20:11:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 601e9911-0f23-5436-8b9f-5d54ac827e82, skipping ID generation
2026-03-29 20:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601e9911-0f23-5436-8b9f-5d54ac827e82 with scrape type 1
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 601e9911-0f23-5436-8b9f-5d54ac827e82 sending to next pipeline
2026-03-29 20:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 601e9911-0f23-5436-8b9f-5d54ac827e82, identifier: 20473409
2026-03-29 20:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 601e9911-0f23-5436-8b9f-5d54ac827e82 with identifier: 20473409
2026-03-29 20:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 601e9911-0f23-5436-8b9f-5d54ac827e82 with identifier: 20473409
2026-03-29 20:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 601e9911-0f23-5436-8b9f-5d54ac827e82 with identifier: 20473409 to the API
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_front_passenger-1774629337129.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '601e9911-0f23-5436-8b9f-5d54ac827e82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB69 EOW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20473409',
'listing': 'auction',
'location': 'None None',
'make': 'Nissan',
'model': 'Juke',
'odometer': 48845,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1248511,
'Height': 2568,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_front_driver-1774629333900.jpg',
'Width': 3424},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1051294,
'Height': 2407,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_rear_driver-1774636643887.jpg',
'Width': 3209},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1632797,
'Height': 2757,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_front_passenger-1774629337129.jpg',
'Width': 3676},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1394034,
'Height': 2547,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3409/20473409/exterior_rear_passenger-1774629339114.jpg',
'Width': 3396},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2250618,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3409/20473409/interior_front_seats-1774636878549.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1759507,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3409/20473409/interior_rear_seats-1774636843296.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1202011,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3409/20473409/interior_dashboard-1774688264106.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1225324,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3409/20473409/instrument_cluster-1774632190364.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1673675,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3409/20473409/interior_boot-1774632167357.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601e9911-0f23-5436-8b9f-5d54ac827e82/601e9911-0f23-5436-8b9f-5d54ac827e82_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1412571,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3409/20473409/docs_service_history-1774639962898.jpg?ixlib=js-3.8.0&auto=format&s=e2671758c24a3dc939d85c09095ca2da',
'Width': 3840}],
'price': 9131,
'price_includes_vat': False,
'registration_date': '2019-12-16',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke Tekna DiG-T',
'transmission': 'manual',
'trim': 'Tekna DiG-T',
'vin': 'SJNFAAF16U1010665',
'year': 2019}
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473409%27 HTTP/1.1" 200 None
2026-03-29 20:11:44 [motorway.uk] INFO: Saving data for 20473409: {'created_time': 1774815104.902826, 'last_price_update_time': 1774815104.902836, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20473409') HTTP/1.1" 204 0
2026-03-29 20:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f43474d50>
2026-03-29 20:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20501015%252Fexterior_front_passenger-1774781791212.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_front_passenger-1774781791212.jpg saved to cache
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8
2026-03-29 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_front_passenger-1774692725268.jpeg> (referer: None)
2026-03-29 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_front_passenger-1774006558258.jpeg> (referer: None)
2026-03-29 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9762/18339762/docs_service_history-1774693247788.jpeg?ixlib=js-3.8.0&auto=format&s=402163614be6ea26eb4b222913d1e9f6> (referer: None)
2026-03-29 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5750/20325750/instrument_cluster-1774700207336.jpg> (referer: None)
2026-03-29 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_rear_passenger-1774692750022.jpeg> (referer: None)
2026-03-29 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1015/20501015/interior_boot-1774782253507.jpg> (referer: None)
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daaee50>
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9762%252F18339762%252Fexterior_front_passenger-1774692725268.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_front_passenger-1774692725268.jpeg saved to cache
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 051c027e-3060-5584-9c36-d2bf1a6b7faa
2026-03-29 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1015/20501015/docs_service_history-1774794244694.jpg?ixlib=js-3.8.0&auto=format&s=b6c1f8b6e699e65c803a6660f10201c6> (referer: None)
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db0e3d0>
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4420%252F17874420%252Fexterior_front_passenger-1774006558258.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_front_passenger-1774006558258.jpeg saved to cache
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d733950>
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9762%252F18339762%252Fdocs_service_history-1774693247788.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D402163614be6ea26eb4b222913d1e9f6') HTTP/1.1" 204 0
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9762/18339762/docs_service_history-1774693247788.jpeg?ixlib=js-3.8.0&auto=format&s=402163614be6ea26eb4b222913d1e9f6 saved to cache
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 051c027e-3060-5584-9c36-d2bf1a6b7faa
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1bf990>
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5750%252F20325750%252Finstrument_cluster-1774700207336.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5750/20325750/instrument_cluster-1774700207336.jpg saved to cache
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e158650>
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9762%252F18339762%252Fexterior_rear_passenger-1774692750022.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_rear_passenger-1774692750022.jpeg saved to cache
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 051c027e-3060-5584-9c36-d2bf1a6b7faa
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d7f2190>
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1015%252F20501015%252Finterior_boot-1774782253507.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1015/20501015/interior_boot-1774782253507.jpg saved to cache
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f44b710>
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1015%252F20501015%252Fdocs_service_history-1774794244694.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db6c1f8b6e699e65c803a6660f10201c6') HTTP/1.1" 204 0
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1015/20501015/docs_service_history-1774794244694.jpg?ixlib=js-3.8.0&auto=format&s=b6c1f8b6e699e65c803a6660f10201c6 saved to cache
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8
2026-03-29 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4420/17874420/docs_service_history-1774006902091.jpeg?ixlib=js-3.8.0&auto=format&s=49bdb5aa97f887720032f1cfaa877a19> (referer: None)
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9762/18339762/docs_service_history-1774693257926.jpeg?ixlib=js-3.8.0&auto=format&s=cfae5691f271b41fc348e99d7ed8fe0e> (referer: None)
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1276/20021276/docs_service_history-1774711342611.jpg?ixlib=js-3.8.0&auto=format&s=edd6e57b8e527643f3241f60a2ff9040> (referer: None)
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4420/17874420/instrument_cluster-1774006487938.jpeg> (referer: None)
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1276/20021276/interior_boot-1774710650062.jpg> (referer: None)
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6771/20436771/docs_service_history-1774638072383.jpeg?ixlib=js-3.8.0&auto=format&s=8dd0e53e0f83fc0d18c7a5897a992660> (referer: None)
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1015/20501015/instrument_cluster-1774782167789.jpg> (referer: None)
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6771/20436771/interior_boot-1774637323640.jpeg> (referer: None)
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4420/17874420/interior_boot-1774006566166.jpeg> (referer: None)
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9762/18339762/interior_boot-1774692891948.jpeg> (referer: None)
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f44a410>
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4420%252F17874420%252Fdocs_service_history-1774006902091.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D49bdb5aa97f887720032f1cfaa877a19') HTTP/1.1" 204 0
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4420/17874420/docs_service_history-1774006902091.jpeg?ixlib=js-3.8.0&auto=format&s=49bdb5aa97f887720032f1cfaa877a19 saved to cache
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6ad5d0>
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9762%252F18339762%252Fdocs_service_history-1774693257926.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcfae5691f271b41fc348e99d7ed8fe0e') HTTP/1.1" 204 0
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9762/18339762/docs_service_history-1774693257926.jpeg?ixlib=js-3.8.0&auto=format&s=cfae5691f271b41fc348e99d7ed8fe0e saved to cache
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 051c027e-3060-5584-9c36-d2bf1a6b7faa
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3f3990>
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1276%252F20021276%252Fdocs_service_history-1774711342611.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dedd6e57b8e527643f3241f60a2ff9040') HTTP/1.1" 204 0
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1276/20021276/docs_service_history-1774711342611.jpg?ixlib=js-3.8.0&auto=format&s=edd6e57b8e527643f3241f60a2ff9040 saved to cache
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 030ae5c0-863d-5f0d-b083-e66f10b4538c
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00)\x1e\xad\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x1f\r\x00)\x14\xa7\x00\x00\x00\x00'
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d668ed0>
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4420%252F17874420%252Finstrument_cluster-1774006487938.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4420/17874420/instrument_cluster-1774006487938.jpeg saved to cache
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4c3bd0>
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1276%252F20021276%252Finterior_boot-1774710650062.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1276/20021276/interior_boot-1774710650062.jpg saved to cache
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 030ae5c0-863d-5f0d-b083-e66f10b4538c
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f503c90>
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6771%252F20436771%252Fdocs_service_history-1774638072383.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8dd0e53e0f83fc0d18c7a5897a992660') HTTP/1.1" 204 0
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6771/20436771/docs_service_history-1774638072383.jpeg?ixlib=js-3.8.0&auto=format&s=8dd0e53e0f83fc0d18c7a5897a992660 saved to cache
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13c36ae8-de95-55eb-ac4b-3574f12051ec
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2e7a50>
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20501015%252Finstrument_cluster-1774782167789.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20501015/instrument_cluster-1774782167789.jpg saved to cache
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00+\x8d>\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xf0\xbd\x00+\x82\xa0\x00\x00\x00\x00'
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c702b90>
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6771%252F20436771%252Finterior_boot-1774637323640.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6771/20436771/interior_boot-1774637323640.jpeg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13c36ae8-de95-55eb-ac4b-3574f12051ec
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00@S6\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\x15\xe0\x00@I0\x00\x00\x00\x00'
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d668910>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4420%252F17874420%252Finterior_boot-1774006566166.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4420/17874420/interior_boot-1774006566166.jpeg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00E\xed0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02_u\x00E\xe36\x00\x00\x00\x00'
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2e68d0>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9762%252F18339762%252Finterior_boot-1774692891948.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9762/18339762/interior_boot-1774692891948.jpeg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 051c027e-3060-5584-9c36-d2bf1a6b7faa
2026-03-29 20:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1276/20021276/instrument_cluster-1774710699568.jpg> (referer: None)
2026-03-29 20:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6771/20436771/instrument_cluster-1774637395176.jpeg> (referer: None)
2026-03-29 20:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1015/20501015/interior_dashboard-1774782308141.jpg> (referer: None)
2026-03-29 20:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4420/17874420/interior_dashboard-1774006578129.jpeg> (referer: None)
2026-03-29 20:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4420/17874420/interior_rear_seats-1774006564018.jpeg> (referer: None)
2026-03-29 20:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9762/18339762/interior_dashboard-1774692883083.jpeg> (referer: None)
2026-03-29 20:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1015/20501015/interior_rear_seats-1774782143205.jpg> (referer: None)
2026-03-29 20:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9762/18339762/interior_rear_seats-1774692856525.jpeg> (referer: None)
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2e4e50>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1276%252F20021276%252Finstrument_cluster-1774710699568.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1276/20021276/instrument_cluster-1774710699568.jpg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 030ae5c0-863d-5f0d-b083-e66f10b4538c
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1a\xf6\x9a\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x03\x1a\x00\x1a\xeb\xfc\x00\x00\x00\x00'
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0a7410>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6771%252F20436771%252Finstrument_cluster-1774637395176.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6771/20436771/instrument_cluster-1774637395176.jpeg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13c36ae8-de95-55eb-ac4b-3574f12051ec
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1a5c50>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20501015%252Finterior_dashboard-1774782308141.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20501015/interior_dashboard-1774782308141.jpg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x006\xbbX\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03Z\x87\x006\xb1R\x00\x00\x00\x00'
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d7bbc10>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4420%252F17874420%252Finterior_dashboard-1774006578129.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4420/17874420/interior_dashboard-1774006578129.jpeg saved to cache
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00/\x96\xaf\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02Xo\x00/\x8c\xa9\x00\x00\x00\x00'
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5f5310>
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4420%252F17874420%252Finterior_rear_seats-1774006564018.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4420/17874420/interior_rear_seats-1774006564018.jpeg saved to cache
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003:\xba\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xb0\x12\x0030\xc0\x00\x00\x00\x00'
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc81590>
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9762%252F18339762%252Finterior_dashboard-1774692883083.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9762/18339762/interior_dashboard-1774692883083.jpeg saved to cache
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 051c027e-3060-5584-9c36-d2bf1a6b7faa
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cabcad0>
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1015%252F20501015%252Finterior_rear_seats-1774782143205.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1015/20501015/interior_rear_seats-1774782143205.jpg saved to cache
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00@\x1cD\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02D\xda\x00@\x12J\x00\x00\x00\x00'
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d7bb410>
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9762%252F18339762%252Finterior_rear_seats-1774692856525.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9762/18339762/interior_rear_seats-1774692856525.jpeg saved to cache
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 051c027e-3060-5584-9c36-d2bf1a6b7faa
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_rear_passenger-1774006558386.jpeg> (referer: None)
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_rear_passenger-1774781783888.jpg> (referer: None)
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6771/20436771/interior_dashboard-1774637319999.jpeg> (referer: None)
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4420/17874420/interior_front_seats-1774006378205.jpeg> (referer: None)
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1276/20021276/interior_dashboard-1774710665941.jpg> (referer: None)
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6771/20436771/interior_rear_seats-1774637290768.jpeg> (referer: None)
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1276/20021276/interior_rear_seats-1774710654183.jpg> (referer: None)
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1015/20501015/interior_front_seats-1774782098756.jpg> (referer: None)
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9762/18339762/interior_front_seats-1774692794120.jpeg> (referer: None)
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_rear_driver-1774006561865.jpeg> (referer: None)
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca08f10>
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4420%252F17874420%252Fexterior_rear_passenger-1774006558386.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_rear_passenger-1774006558386.jpeg saved to cache
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da02f50>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20501015%252Fexterior_rear_passenger-1774781783888.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_rear_passenger-1774781783888.jpg saved to cache
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5b7510>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6771%252F20436771%252Finterior_dashboard-1774637319999.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6771/20436771/interior_dashboard-1774637319999.jpeg saved to cache
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13c36ae8-de95-55eb-ac4b-3574f12051ec
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003\xd5\xf2\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xd1Q\x003\xcb\xec\x00\x00\x00\x00'
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d04d2d0>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4420%252F17874420%252Finterior_front_seats-1774006378205.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4420/17874420/interior_front_seats-1774006378205.jpeg saved to cache
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2f7810>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1276%252F20021276%252Finterior_dashboard-1774710665941.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1276/20021276/interior_dashboard-1774710665941.jpg saved to cache
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 030ae5c0-863d-5f0d-b083-e66f10b4538c
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00#oN\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xec\xc9\x00#d\xba\x00\x00\x00\x00'
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce21410>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6771%252F20436771%252Finterior_rear_seats-1774637290768.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6771/20436771/interior_rear_seats-1774637290768.jpeg saved to cache
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13c36ae8-de95-55eb-ac4b-3574f12051ec
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5b7410>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1276%252F20021276%252Finterior_rear_seats-1774710654183.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1276/20021276/interior_rear_seats-1774710654183.jpg saved to cache
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 030ae5c0-863d-5f0d-b083-e66f10b4538c
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0aebd0>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1015%252F20501015%252Finterior_front_seats-1774782098756.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1015/20501015/interior_front_seats-1774782098756.jpg saved to cache
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00G\x89\xef\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x8f\xf7\x00G\x7f\xf5\x00\x00\x00\x00'
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f30ce10>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9762%252F18339762%252Finterior_front_seats-1774692794120.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9762/18339762/interior_front_seats-1774692794120.jpeg saved to cache
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 051c027e-3060-5584-9c36-d2bf1a6b7faa
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce23390>
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4420%252F17874420%252Fexterior_rear_driver-1774006561865.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_rear_driver-1774006561865.jpeg saved to cache
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1276/20021276/exterior_front_passenger-1774710233766.jpg> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_rear_driver-1774692767713.jpeg> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_front_driver-1774692709272.jpeg> (referer: None)
2026-03-29 20:11:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6771/20436771/exterior_front_passenger-1774637178208.jpeg> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6771/20436771/20436771-exterior_rear_passenger-modified-1774689920393.jpeg> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_rear_driver-1774781766759.jpg> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1276/20021276/interior_front_seats-1774710651696.jpg> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6771/20436771/interior_front_seats-1774637353744.jpeg> (referer: None)
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d710550>
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1276%252F20021276%252Fexterior_front_passenger-1774710233766.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1276/20021276/exterior_front_passenger-1774710233766.jpg saved to cache
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 030ae5c0-863d-5f0d-b083-e66f10b4538c
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17627913.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd67490>
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9762%252F18339762%252Fexterior_rear_driver-1774692767713.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_rear_driver-1774692767713.jpeg saved to cache
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 051c027e-3060-5584-9c36-d2bf1a6b7faa
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d7f33d0>
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9762%252F18339762%252Fexterior_front_driver-1774692709272.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_front_driver-1774692709272.jpeg saved to cache
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 051c027e-3060-5584-9c36-d2bf1a6b7faa
2026-03-29 20:11:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 051c027e-3060-5584-9c36-d2bf1a6b7faa, skipping ID generation
2026-03-29 20:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 051c027e-3060-5584-9c36-d2bf1a6b7faa with scrape type 1
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 051c027e-3060-5584-9c36-d2bf1a6b7faa sending to next pipeline
2026-03-29 20:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 051c027e-3060-5584-9c36-d2bf1a6b7faa, identifier: 18339762
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2e9190>
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6771%252F20436771%252Fexterior_front_passenger-1774637178208.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6771/20436771/exterior_front_passenger-1774637178208.jpeg saved to cache
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13c36ae8-de95-55eb-ac4b-3574f12051ec
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4497d0>
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6771%252F20436771%252F20436771-exterior_rear_passenger-modified-1774689920393.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6771/20436771/20436771-exterior_rear_passenger-modified-1774689920393.jpeg saved to cache
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13c36ae8-de95-55eb-ac4b-3574f12051ec
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d12dad0>
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20501015%252Fexterior_rear_driver-1774781766759.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_rear_driver-1774781766759.jpg saved to cache
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0a9290>
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1276%252F20021276%252Finterior_front_seats-1774710651696.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1276/20021276/interior_front_seats-1774710651696.jpg saved to cache
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 030ae5c0-863d-5f0d-b083-e66f10b4538c
2026-03-29 20:11:51 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:51 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:51 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00"\x08O\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xd1E\x00!\xfd\xb1\x00\x00\x00\x00'
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d586350>
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6771%252F20436771%252Finterior_front_seats-1774637353744.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6771/20436771/interior_front_seats-1774637353744.jpeg saved to cache
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13c36ae8-de95-55eb-ac4b-3574f12051ec
2026-03-29 20:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 051c027e-3060-5584-9c36-d2bf1a6b7faa with identifier: 18339762
2026-03-29 20:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 051c027e-3060-5584-9c36-d2bf1a6b7faa with identifier: 18339762
2026-03-29 20:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 051c027e-3060-5584-9c36-d2bf1a6b7faa with identifier: 18339762 to the API
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_front_driver-1774692709272.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '051c027e-3060-5584-9c36-d2bf1a6b7faa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'W99 ASL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18339762',
'listing': 'auction',
'location': 'Greater London Bexleyheath',
'make': 'Ford',
'model': 'Focus',
'odometer': 77626,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1569879,
'Height': 2531,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_front_driver-1774692709272.jpeg',
'Width': 3374},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1585211,
'Height': 2580,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_rear_driver-1774692767713.jpeg',
'Width': 3440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1567599,
'Height': 2458,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_front_passenger-1774692725268.jpeg',
'Width': 3277},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1625144,
'Height': 2629,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9762/18339762/exterior_rear_passenger-1774692750022.jpeg',
'Width': 3505},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4856294,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9762/18339762/interior_front_seats-1774692794120.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4350238,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9762/18339762/interior_rear_seats-1774692856525.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3533516,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9762/18339762/interior_dashboard-1774692883083.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4738213,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9762/18339762/interior_boot-1774692891948.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1795307,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9762/18339762/docs_service_history-1774693247788.jpeg?ixlib=js-3.8.0&auto=format&s=402163614be6ea26eb4b222913d1e9f6',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051c027e-3060-5584-9c36-d2bf1a6b7faa/051c027e-3060-5584-9c36-d2bf1a6b7faa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1663959,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9762/18339762/docs_service_history-1774693257926.jpeg?ixlib=js-3.8.0&auto=format&s=cfae5691f271b41fc348e99d7ed8fe0e',
'Width': 3024}],
'price': 7064,
'price_includes_vat': False,
'registration_date': '2012-07-26',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus Zetec Turbo',
'transmission': 'manual',
'trim': 'Zetec Turbo',
'vin': 'WF0KXXGCBKCK40889',
'year': 2012}
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718339762%27 HTTP/1.1" 200 None
2026-03-29 20:11:52 [motorway.uk] INFO: Saving data for 18339762: {'created_time': 1774815112.084502, 'last_price_update_time': 1774815112.084516, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18339762') HTTP/1.1" 204 0
2026-03-29 20:11:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c3da72a-0193-5260-9644-126663bad2d3 with identifier: 17627913
2026-03-29 20:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c3da72a-0193-5260-9644-126663bad2d3 with scrape type 1
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c3da72a-0193-5260-9644-126663bad2d3
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7913%252F17627913%252Fexterior_front_driver-1774629665957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_front_driver-1774629665957.jpg not downloaded yet
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1276/20021276/exterior_front_driver-1774711875159.jpg> (referer: None)
2026-03-29 20:11:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7913%252F17627913%252Fexterior_rear_driver-1774629677330.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_rear_driver-1774629677330.jpg not downloaded yet
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_front_driver-1774781741531.jpg> (referer: None)
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7913%252F17627913%252Fexterior_front_passenger-1774629662693.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_front_passenger-1774629662693.jpg not downloaded yet
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7913%252F17627913%252Fexterior_rear_passenger-1774629674594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_rear_passenger-1774629674594.jpg not downloaded yet
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7913%252F17627913%252Finterior_front_seats-1774630291827.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7913/17627913/interior_front_seats-1774630291827.jpg not downloaded yet
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5931/20375931/instrument_cluster-1774107594493.jpg> (referer: None)
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7913%252F17627913%252Finterior_rear_seats-1774630293535.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7913/17627913/interior_rear_seats-1774630293535.jpg not downloaded yet
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0aaf10>
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1276%252F20021276%252Fexterior_front_driver-1774711875159.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1276/20021276/exterior_front_driver-1774711875159.jpg saved to cache
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 030ae5c0-863d-5f0d-b083-e66f10b4538c
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1276/20021276/exterior_rear_driver-1774710231784.jpg> (referer: None)
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7913%252F17627913%252Finterior_dashboard-1774630321287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7913/17627913/interior_dashboard-1774630321287.jpg not downloaded yet
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7913%252F17627913%252Finterior_boot-1774630299509.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7913/17627913/interior_boot-1774630299509.jpg not downloaded yet
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de35810>
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20501015%252Fexterior_front_driver-1774781741531.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_front_driver-1774781741531.jpg saved to cache
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8
2026-03-29 20:11:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8, skipping ID generation
2026-03-29 20:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8 with scrape type 1
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8 sending to next pipeline
2026-03-29 20:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8, identifier: 20501015
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f26f3d0>
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1870d742-7455-5161-b302-f42681e39a0b/1870d742-7455-5161-b302-f42681e39a0b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5931%252F20375931%252Finstrument_cluster-1774107594493.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5931/20375931/instrument_cluster-1774107594493.jpg saved to cache
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1870d742-7455-5161-b302-f42681e39a0b
2026-03-29 20:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8 with identifier: 20501015
2026-03-29 20:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8 with identifier: 20501015
2026-03-29 20:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8 with identifier: 20501015 to the API
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_front_driver-1774781741531.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DF62 NNC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20501015',
'listing': 'auction',
'location': 'Bristol Bristol',
'make': 'Audi',
'model': 'A3',
'odometer': 6936,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1895037,
'Height': 2645,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_front_driver-1774781741531.jpg',
'Width': 3527},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2037275,
'Height': 2780,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_rear_driver-1774781766759.jpg',
'Width': 3707},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1228841,
'Height': 2288,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_front_passenger-1774781791212.jpg',
'Width': 3051},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1305275,
'Height': 2255,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1015/20501015/exterior_rear_passenger-1774781783888.jpg',
'Width': 3006},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3818947,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1015/20501015/interior_front_seats-1774782098756.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4195304,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1015/20501015/interior_rear_seats-1774782143205.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2032471,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1015/20501015/interior_dashboard-1774782308141.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2533038,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1015/20501015/instrument_cluster-1774782167789.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3018195,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1015/20501015/interior_boot-1774782253507.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8/34775ab8-ed2b-5e1b-bd05-c2ba3b7c80d8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476537,
'Height': 3028,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1015/20501015/docs_service_history-1774794244694.jpg?ixlib=js-3.8.0&auto=format&s=b6c1f8b6e699e65c803a6660f10201c6',
'Width': 2271}],
'price': 3698,
'price_includes_vat': False,
'registration_date': '2013-02-25',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 Sport Final Edition TDI',
'transmission': 'manual',
'trim': 'Sport Final Edition TDI',
'vin': 'TRUZZZ8P8D1003656',
'year': 2013}
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720501015%27 HTTP/1.1" 200 None
2026-03-29 20:11:54 [motorway.uk] INFO: Saving data for 20501015: {'created_time': 1774815114.126292, 'last_price_update_time': 1774815114.126304, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20501015') HTTP/1.1" 204 0
2026-03-29 20:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6771/20436771/exterior_front_driver-1774637154102.jpeg> (referer: None)
2026-03-29 20:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_front_driver-1774629665957.jpg> (referer: None)
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7913%252F17627913%252Fdocs_service_history-1774689900589.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcd6c22cbfce267eb2808739f5377390e%27 HTTP/1.1" 200 None
2026-03-29 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7913/17627913/docs_service_history-1774689900589.jpg?ixlib=js-3.8.0&auto=format&s=cd6c22cbfce267eb2808739f5377390e not downloaded yet
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5b4190>
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1276%252F20021276%252Fexterior_rear_driver-1774710231784.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1276/20021276/exterior_rear_driver-1774710231784.jpg saved to cache
2026-03-29 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 030ae5c0-863d-5f0d-b083-e66f10b4538c
2026-03-29 20:11:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 030ae5c0-863d-5f0d-b083-e66f10b4538c, skipping ID generation
2026-03-29 20:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 030ae5c0-863d-5f0d-b083-e66f10b4538c with scrape type 1
2026-03-29 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 030ae5c0-863d-5f0d-b083-e66f10b4538c sending to next pipeline
2026-03-29 20:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 030ae5c0-863d-5f0d-b083-e66f10b4538c, identifier: 20021276
2026-03-29 20:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_front_driver-1774006559717.jpeg> (referer: None)
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7913%252F17627913%252Fdocs_service_history-1774630493179.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df331f380ac5b32e565b6a3bd8c86b4db%27 HTTP/1.1" 200 None
2026-03-29 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7913/17627913/docs_service_history-1774630493179.jpg?ixlib=js-3.8.0&auto=format&s=f331f380ac5b32e565b6a3bd8c86b4db not downloaded yet
2026-03-29 20:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 030ae5c0-863d-5f0d-b083-e66f10b4538c with identifier: 20021276
2026-03-29 20:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 030ae5c0-863d-5f0d-b083-e66f10b4538c with identifier: 20021276
2026-03-29 20:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 030ae5c0-863d-5f0d-b083-e66f10b4538c with identifier: 20021276 to the API
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1276/20021276/exterior_rear_driver-1774710231784.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '030ae5c0-863d-5f0d-b083-e66f10b4538c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FP73 XSV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20021276',
'listing': 'auction',
'location': 'Derbyshire Derby',
'make': 'MG',
'model': '3',
'odometer': 45700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1314155,
'Height': 2215,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1276/20021276/exterior_front_driver-1774711875159.jpg',
'Width': 2954},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1043526,
'Height': 2354,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1276/20021276/exterior_rear_driver-1774710231784.jpg',
'Width': 3139},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 643011,
'Height': 1940,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1276/20021276/exterior_front_passenger-1774710233766.jpg',
'Width': 2587},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 740467,
'Height': 2044,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1276/20021276/exterior_rear_passenger-1774710229850.jpg',
'Width': 2725},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2242272,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1276/20021276/interior_front_seats-1774710651696.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2625247,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1276/20021276/interior_rear_seats-1774710654183.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2189531,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1276/20021276/interior_dashboard-1774710665941.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1147468,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1276/20021276/instrument_cluster-1774710699568.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1706275,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1276/20021276/interior_boot-1774710650062.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030ae5c0-863d-5f0d-b083-e66f10b4538c/030ae5c0-863d-5f0d-b083-e66f10b4538c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1503346,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1276/20021276/docs_service_history-1774711342611.jpg?ixlib=js-3.8.0&auto=format&s=edd6e57b8e527643f3241f60a2ff9040',
'Width': 2880}],
'price': 6911,
'price_includes_vat': False,
'registration_date': '2024-01-05',
'seats_number': None,
'seller_name': None,
'title': 'MG 3 Exclusive NAV VTI-TECH',
'transmission': 'manual',
'trim': 'Exclusive NAV VTI-TECH',
'vin': 'LSJZ14U95PS073625',
'year': 2024}
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720021276%27 HTTP/1.1" 200 None
2026-03-29 20:11:54 [motorway.uk] INFO: Saving data for 20021276: {'created_time': 1774815114.787321, 'last_price_update_time': 1774815114.787335, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20021276') HTTP/1.1" 204 0
2026-03-29 20:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6771/20436771/exterior_rear_driver-1774637200207.jpeg> (referer: None)
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddbab10>
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6771%252F20436771%252Fexterior_front_driver-1774637154102.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6771/20436771/exterior_front_driver-1774637154102.jpeg saved to cache
2026-03-29 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13c36ae8-de95-55eb-ac4b-3574f12051ec
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c665dd0>
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7913%252F17627913%252Fexterior_front_driver-1774629665957.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_front_driver-1774629665957.jpg saved to cache
2026-03-29 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c3da72a-0193-5260-9644-126663bad2d3
2026-03-29 20:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c664290>
2026-03-29 20:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4420%252F17874420%252Fexterior_front_driver-1774006559717.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_front_driver-1774006559717.jpeg saved to cache
2026-03-29 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0
2026-03-29 20:11:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0, skipping ID generation
2026-03-29 20:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0 with scrape type 1
2026-03-29 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0 sending to next pipeline
2026-03-29 20:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0, identifier: 17874420
2026-03-29 20:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0 with identifier: 17874420
2026-03-29 20:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0 with identifier: 17874420
2026-03-29 20:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 759d4d15-abf3-5269-a6ea-b4dc00b5d9a0 with identifier: 17874420 to the API
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_front_driver-1774006559717.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '759d4d15-abf3-5269-a6ea-b4dc00b5d9a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'XX11 RHF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17874420',
'listing': 'auction',
'location': 'Lancashire Lancaster',
'make': 'Porsche',
'model': 'Macan',
'odometer': 90000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2130223,
'Height': 2572,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_front_driver-1774006559717.jpeg',
'Width': 3429},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1202241,
'Height': 2061,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_rear_driver-1774006561865.jpeg',
'Width': 2748},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1843210,
'Height': 2744,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_front_passenger-1774006558258.jpeg',
'Width': 3659},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1557241,
'Height': 2204,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4420/17874420/exterior_rear_passenger-1774006558386.jpeg',
'Width': 2939},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3581763,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4420/17874420/interior_front_seats-1774006378205.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3272478,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4420/17874420/interior_rear_seats-1774006564018.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3806687,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4420/17874420/interior_dashboard-1774006578129.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2833850,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4420/17874420/instrument_cluster-1774006487938.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4417814,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4420/17874420/interior_boot-1774006566166.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759d4d15-abf3-5269-a6ea-b4dc00b5d9a0/759d4d15-abf3-5269-a6ea-b4dc00b5d9a0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1128045,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4420/17874420/docs_service_history-1774006902091.jpeg?ixlib=js-3.8.0&auto=format&s=49bdb5aa97f887720032f1cfaa877a19',
'Width': 4032}],
'price': 15114,
'price_includes_vat': False,
'registration_date': '2016-04-25',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Macan S D S-A',
'transmission': 'automatic',
'trim': 'S D S-A',
'vin': 'WP1ZZZ95ZHLB31922',
'year': 2016}
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717874420%27 HTTP/1.1" 200 None
2026-03-29 20:11:55 [motorway.uk] INFO: Saving data for 17874420: {'created_time': 1774815115.648308, 'last_price_update_time': 1774815115.648319, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17874420') HTTP/1.1" 204 0
2026-03-29 20:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19935539.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddb9910>
2026-03-29 20:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6771%252F20436771%252Fexterior_rear_driver-1774637200207.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6771/20436771/exterior_rear_driver-1774637200207.jpeg saved to cache
2026-03-29 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13c36ae8-de95-55eb-ac4b-3574f12051ec
2026-03-29 20:11:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13c36ae8-de95-55eb-ac4b-3574f12051ec, skipping ID generation
2026-03-29 20:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13c36ae8-de95-55eb-ac4b-3574f12051ec with scrape type 1
2026-03-29 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13c36ae8-de95-55eb-ac4b-3574f12051ec sending to next pipeline
2026-03-29 20:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 13c36ae8-de95-55eb-ac4b-3574f12051ec, identifier: 20436771
2026-03-29 20:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 13c36ae8-de95-55eb-ac4b-3574f12051ec with identifier: 20436771
2026-03-29 20:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 13c36ae8-de95-55eb-ac4b-3574f12051ec with identifier: 20436771
2026-03-29 20:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 13c36ae8-de95-55eb-ac4b-3574f12051ec with identifier: 20436771 to the API
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6771/20436771/exterior_rear_driver-1774637200207.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '13c36ae8-de95-55eb-ac4b-3574f12051ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU16 LUL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20436771',
'listing': 'auction',
'location': 'Flintshire Buckley',
'make': 'Vauxhall',
'model': 'Zafira',
'odometer': 63191,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1643924,
'Height': 2799,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6771/20436771/exterior_front_driver-1774637154102.jpeg',
'Width': 3732},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1378643,
'Height': 2900,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6771/20436771/exterior_rear_driver-1774637200207.jpeg',
'Width': 3867},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1775218,
'Height': 2753,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6771/20436771/exterior_front_passenger-1774637178208.jpeg',
'Width': 3670},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2076094,
'Height': 2727,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6771/20436771/20436771-exterior_rear_passenger-modified-1774689920393.jpeg',
'Width': 3636},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2349460,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6771/20436771/interior_front_seats-1774637353744.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2448407,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6771/20436771/interior_rear_seats-1774637290768.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1431467,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6771/20436771/interior_dashboard-1774637319999.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1898932,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6771/20436771/instrument_cluster-1774637395176.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3046907,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6771/20436771/interior_boot-1774637323640.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c36ae8-de95-55eb-ac4b-3574f12051ec/13c36ae8-de95-55eb-ac4b-3574f12051ec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1858637,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6771/20436771/docs_service_history-1774638072383.jpeg?ixlib=js-3.8.0&auto=format&s=8dd0e53e0f83fc0d18c7a5897a992660',
'Width': 4032}],
'price': 4143,
'price_includes_vat': False,
'registration_date': '2016-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Zafira Tourer Elite CDTI S/S',
'transmission': 'manual',
'trim': 'Tourer Elite CDTI S/S',
'vin': 'W0LPE9E71G1082706',
'year': 2016}
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720436771%27 HTTP/1.1" 200 None
2026-03-29 20:11:56 [motorway.uk] INFO: Saving data for 20436771: {'created_time': 1774815116.23323, 'last_price_update_time': 1774815116.23324, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20436771') HTTP/1.1" 204 0
2026-03-29 20:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c0c262b-0b98-581d-b28d-a0f828af043a with identifier: 19935539
2026-03-29 20:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c0c262b-0b98-581d-b28d-a0f828af043a with scrape type 1
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c0c262b-0b98-581d-b28d-a0f828af043a
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5539%252F19935539%252Fexterior_front_driver-1771779990512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5539/19935539/exterior_front_driver-1771779990512.jpg already downloaded
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5539%252F19935539%252Fexterior_rear_driver-1771780002770.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5539/19935539/exterior_rear_driver-1771780002770.jpg already downloaded
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5539%252F19935539%252Fexterior_front_passenger-1771780026477.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5539/19935539/exterior_front_passenger-1771780026477.jpg already downloaded
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5539%252F19935539%252Fexterior_rear_passenger-1771780013519.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5539/19935539/exterior_rear_passenger-1771780013519.jpg already downloaded
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5539%252F19935539%252Finterior_front_seats-1774190586335.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5539/19935539/interior_front_seats-1774190586335.jpg already downloaded
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5539%252F19935539%252Finterior_rear_seats-1774190601740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5539/19935539/interior_rear_seats-1774190601740.jpg already downloaded
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5539%252F19935539%252Finterior_dashboard-1774190632108.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5539/19935539/interior_dashboard-1774190632108.jpg already downloaded
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5539%252F19935539%252Finterior_boot-1774190663227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5539/19935539/interior_boot-1774190663227.jpg already downloaded
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5539%252F19935539%252Fdocs_service_history-1774192027001.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2bb7c1a20bbb4790842c2e908306ae2d%27 HTTP/1.1" 200 None
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5539/19935539/docs_service_history-1774192027001.jpg?ixlib=js-3.8.0&auto=format&s=2bb7c1a20bbb4790842c2e908306ae2d already downloaded
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5539%252F19935539%252Fdocs_service_history-1774192027940.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De5f3a6aa0b07dab5a28246ff404801f3%27 HTTP/1.1" 200 None
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5539/19935539/docs_service_history-1774192027940.jpg?ixlib=js-3.8.0&auto=format&s=e5f3a6aa0b07dab5a28246ff404801f3 already downloaded
2026-03-29 20:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8c0c262b-0b98-581d-b28d-a0f828af043a, identifier: 19935539
2026-03-29 20:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8c0c262b-0b98-581d-b28d-a0f828af043a with identifier: 19935539
2026-03-29 20:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8c0c262b-0b98-581d-b28d-a0f828af043a with identifier: 19935539
2026-03-29 20:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8c0c262b-0b98-581d-b28d-a0f828af043a with identifier: 19935539 to the API
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19935539.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '8c0c262b-0b98-581d-b28d-a0f828af043a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK14 NVC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19935539',
'listing': 'auction',
'location': 'Swindon Swindon',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 129000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/5539/19935539/exterior_front_driver-1771779990512.jpg',
'https://motorway-photos-redacted.imgix.net/5539/19935539/exterior_rear_driver-1771780002770.jpg',
'https://motorway-photos-redacted.imgix.net/5539/19935539/exterior_front_passenger-1771780026477.jpg',
'https://motorway-photos-redacted.imgix.net/5539/19935539/exterior_rear_passenger-1771780013519.jpg',
'https://motorway-photos.imgix.net/5539/19935539/interior_front_seats-1774190586335.jpg',
'https://motorway-photos.imgix.net/5539/19935539/interior_rear_seats-1774190601740.jpg',
'https://motorway-photos-redacted.imgix.net/5539/19935539/interior_dashboard-1774190632108.jpg',
'https://motorway-photos.imgix.net/5539/19935539/interior_boot-1774190663227.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/5539/19935539/docs_service_history-1774192027001.jpg?ixlib=js-3.8.0&auto=format&s=2bb7c1a20bbb4790842c2e908306ae2d',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/5539/19935539/docs_service_history-1774192027940.jpg?ixlib=js-3.8.0&auto=format&s=e5f3a6aa0b07dab5a28246ff404801f3'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0c262b-0b98-581d-b28d-a0f828af043a/8c0c262b-0b98-581d-b28d-a0f828af043a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1557327,
'Height': 2672,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5539/19935539/exterior_front_driver-1771779990512.jpg',
'Width': 3562},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0c262b-0b98-581d-b28d-a0f828af043a/8c0c262b-0b98-581d-b28d-a0f828af043a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1444032,
'Height': 2677,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5539/19935539/exterior_rear_driver-1771780002770.jpg',
'Width': 3569},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0c262b-0b98-581d-b28d-a0f828af043a/8c0c262b-0b98-581d-b28d-a0f828af043a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1551656,
'Height': 2449,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5539/19935539/exterior_front_passenger-1771780026477.jpg',
'Width': 3265},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0c262b-0b98-581d-b28d-a0f828af043a/8c0c262b-0b98-581d-b28d-a0f828af043a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1805644,
'Height': 2737,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5539/19935539/exterior_rear_passenger-1771780013519.jpg',
'Width': 3649},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0c262b-0b98-581d-b28d-a0f828af043a/8c0c262b-0b98-581d-b28d-a0f828af043a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3596218,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5539/19935539/interior_front_seats-1774190586335.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0c262b-0b98-581d-b28d-a0f828af043a/8c0c262b-0b98-581d-b28d-a0f828af043a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3788231,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5539/19935539/interior_rear_seats-1774190601740.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0c262b-0b98-581d-b28d-a0f828af043a/8c0c262b-0b98-581d-b28d-a0f828af043a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1675339,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5539/19935539/interior_dashboard-1774190632108.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0c262b-0b98-581d-b28d-a0f828af043a/8c0c262b-0b98-581d-b28d-a0f828af043a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3822793,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5539/19935539/interior_boot-1774190663227.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0c262b-0b98-581d-b28d-a0f828af043a/8c0c262b-0b98-581d-b28d-a0f828af043a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 819416,
'Height': 3327,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5539/19935539/docs_service_history-1774192027001.jpg?ixlib=js-3.8.0&auto=format&s=2bb7c1a20bbb4790842c2e908306ae2d',
'Width': 2390},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0c262b-0b98-581d-b28d-a0f828af043a/8c0c262b-0b98-581d-b28d-a0f828af043a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 724983,
'Height': 3294,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5539/19935539/docs_service_history-1774192027940.jpg?ixlib=js-3.8.0&auto=format&s=e5f3a6aa0b07dab5a28246ff404801f3',
'Width': 2307}],
'price': 761,
'price_includes_vat': False,
'registration_date': '2014-05-27',
'seats_number': None,
'seller_name': None,
'title': 'Mitsubishi ASX 2',
'transmission': 'manual',
'trim': '2',
'vin': 'JMAXNGA1WEZ000240',
'year': 2014}
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719935539%27 HTTP/1.1" 200 None
2026-03-29 20:11:56 [motorway.uk] INFO: Saving data for 19935539: {'created_time': 1774815116.924157, 'last_price_update_time': 1774815116.924169, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19935539') HTTP/1.1" 204 0
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1332&page=37&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7913/17627913/interior_dashboard-1774630321287.jpg> (referer: None)
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7913/17627913/interior_front_seats-1774630291827.jpg> (referer: None)
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_rear_passenger-1774629674594.jpg> (referer: None)
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5931/20375931/interior_rear_seats-1774107591976.jpg> (referer: None)
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7195/20357195/20357195-interior_dashboard-modified-1774693475014.jpeg> (referer: None)
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5931/20375931/interior_dashboard-1774107631717.jpg> (referer: None)
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7913/17627913/docs_service_history-1774689900589.jpg?ixlib=js-3.8.0&auto=format&s=cd6c22cbfce267eb2808739f5377390e> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7913/17627913/docs_service_history-1774630493179.jpg?ixlib=js-3.8.0&auto=format&s=f331f380ac5b32e565b6a3bd8c86b4db> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7913/17627913/interior_rear_seats-1774630293535.jpg> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7913/17627913/interior_boot-1774630299509.jpg> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5750/20325750/interior_dashboard-1774700163879.jpg> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7195/20357195/interior_rear_seats-1774635008128.jpeg> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5750/20325750/interior_rear_seats-1774700129969.jpg> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5750/20325750/interior_front_seats-1774700114495.jpg> (referer: None)
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 1393364
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%271393364%27 HTTP/1.1" 200 None
2026-03-29 20:11:57 [motorway.uk] INFO: Scrape type for 1393364: 1
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 18170236
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 19713905
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 20474485
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 20298443
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 20477842
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 17624223
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 18291869
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718291869%27 HTTP/1.1" 200 None
2026-03-29 20:11:57 [motorway.uk] INFO: Scrape type for 18291869: 1
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 19097600
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 9530683
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 20452858
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 20455993
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720455993%27 HTTP/1.1" 200 None
2026-03-29 20:11:57 [motorway.uk] INFO: Scrape type for 20455993: 1
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6fd890>
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7913%252F17627913%252Finterior_dashboard-1774630321287.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7913/17627913/interior_dashboard-1774630321287.jpg saved to cache
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c3da72a-0193-5260-9644-126663bad2d3
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 11012278
2026-03-29 20:11:57 [motorway.uk] INFO: Found listing with ID: 18039395
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718039395%27 HTTP/1.1" 200 None
2026-03-29 20:11:57 [motorway.uk] INFO: Scrape type for 18039395: 2
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ceceed0>
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7913%252F17627913%252Finterior_front_seats-1774630291827.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7913/17627913/interior_front_seats-1774630291827.jpg saved to cache
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c3da72a-0193-5260-9644-126663bad2d3
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c33d0>
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7913%252F17627913%252Fexterior_rear_passenger-1774629674594.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_rear_passenger-1774629674594.jpg saved to cache
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c3da72a-0193-5260-9644-126663bad2d3
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f43a2d0>
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1870d742-7455-5161-b302-f42681e39a0b/1870d742-7455-5161-b302-f42681e39a0b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5931%252F20375931%252Finterior_rear_seats-1774107591976.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5931/20375931/interior_rear_seats-1774107591976.jpg saved to cache
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1870d742-7455-5161-b302-f42681e39a0b
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d435750>
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2eb7d1-8998-5957-bb96-f8e2c49616c2/5f2eb7d1-8998-5957-bb96-f8e2c49616c2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7195%252F20357195%252F20357195-interior_dashboard-modified-1774693475014.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7195/20357195/20357195-interior_dashboard-modified-1774693475014.jpeg saved to cache
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f2eb7d1-8998-5957-bb96-f8e2c49616c2
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f438450>
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1870d742-7455-5161-b302-f42681e39a0b/1870d742-7455-5161-b302-f42681e39a0b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5931%252F20375931%252Finterior_dashboard-1774107631717.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5931/20375931/interior_dashboard-1774107631717.jpg saved to cache
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1870d742-7455-5161-b302-f42681e39a0b
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddb9e90>
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7913%252F17627913%252Fdocs_service_history-1774689900589.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcd6c22cbfce267eb2808739f5377390e') HTTP/1.1" 204 0
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7913/17627913/docs_service_history-1774689900589.jpg?ixlib=js-3.8.0&auto=format&s=cd6c22cbfce267eb2808739f5377390e saved to cache
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c3da72a-0193-5260-9644-126663bad2d3
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cecdb90>
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7913%252F17627913%252Fdocs_service_history-1774630493179.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df331f380ac5b32e565b6a3bd8c86b4db') HTTP/1.1" 204 0
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7913/17627913/docs_service_history-1774630493179.jpg?ixlib=js-3.8.0&auto=format&s=f331f380ac5b32e565b6a3bd8c86b4db saved to cache
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c3da72a-0193-5260-9644-126663bad2d3
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2e9610>
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7913%252F17627913%252Finterior_rear_seats-1774630293535.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7913/17627913/interior_rear_seats-1774630293535.jpg saved to cache
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c3da72a-0193-5260-9644-126663bad2d3
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cebf710>
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7913%252F17627913%252Finterior_boot-1774630299509.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7913/17627913/interior_boot-1774630299509.jpg saved to cache
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c3da72a-0193-5260-9644-126663bad2d3
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d669590>
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5750%252F20325750%252Finterior_dashboard-1774700163879.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5750/20325750/interior_dashboard-1774700163879.jpg saved to cache
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00(\x11\xb2\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x8d\xf1\x00(\x07\xae\x00\x00\x00\x00'
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c0910>
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2eb7d1-8998-5957-bb96-f8e2c49616c2/5f2eb7d1-8998-5957-bb96-f8e2c49616c2_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7195%252F20357195%252Finterior_rear_seats-1774635008128.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7195/20357195/interior_rear_seats-1774635008128.jpeg saved to cache
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f2eb7d1-8998-5957-bb96-f8e2c49616c2
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6a05d0>
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5750%252F20325750%252Finterior_rear_seats-1774700129969.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5750/20325750/interior_rear_seats-1774700129969.jpg saved to cache
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f438d90>
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5750%252F20325750%252Finterior_front_seats-1774700114495.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5750/20325750/interior_front_seats-1774700114495.jpg saved to cache
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 18741336
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 20303325
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 19210640
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 18047844
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 3222560
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 19609067
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 19886187
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 19659666
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 20424304
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 17898601
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 14573343
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 19859082
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 20450166
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 18005774
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718005774%27 HTTP/1.1" 200 None
2026-03-29 20:11:58 [motorway.uk] INFO: Scrape type for 18005774: 1
2026-03-29 20:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3723283.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 17064602
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 20473269
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 19371488
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 10398218
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710398218%27 HTTP/1.1" 200 None
2026-03-29 20:11:58 [motorway.uk] INFO: Scrape type for 10398218: 1
2026-03-29 20:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 20445276
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720445276%27 HTTP/1.1" 200 None
2026-03-29 20:11:58 [motorway.uk] INFO: Scrape type for 20445276: 1
2026-03-29 20:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_front_passenger-1774629662693.jpg> (referer: None)
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 16325362
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716325362%27 HTTP/1.1" 200 None
2026-03-29 20:11:58 [motorway.uk] INFO: Scrape type for 16325362: 1
2026-03-29 20:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 17674234
2026-03-29 20:11:58 [motorway.uk] INFO: Found listing with ID: 20319628
2026-03-29 20:11:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c00c5979-2bc6-5a10-afd0-ecdf1702c3e8 with identifier: 3723283
2026-03-29 20:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8 with scrape type 1
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3283%252F3723283%252Fexterior_front_driver-1774698242925.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_front_driver-1774698242925.jpg not downloaded yet
2026-03-29 20:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_rear_driver-1774629677330.jpg> (referer: None)
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3283%252F3723283%252Fexterior_rear_driver-1774698252374.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_rear_driver-1774698252374.jpg not downloaded yet
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3283%252F3723283%252Fexterior_front_passenger-1774698279585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_front_passenger-1774698279585.jpg not downloaded yet
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3283%252F3723283%252Fexterior_rear_passenger-1774698263267.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_rear_passenger-1774698263267.jpg not downloaded yet
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3283%252F3723283%252Finterior_front_seats-1774702568679.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3283/3723283/interior_front_seats-1774702568679.jpg not downloaded yet
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c0f90>
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7913%252F17627913%252Fexterior_front_passenger-1774629662693.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_front_passenger-1774629662693.jpg saved to cache
2026-03-29 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c3da72a-0193-5260-9644-126663bad2d3
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3283%252F3723283%252Finterior_rear_seats-1774702588198.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3283/3723283/interior_rear_seats-1774702588198.jpg not downloaded yet
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3283%252F3723283%252Finterior_dashboard-1774702615079.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3283/3723283/interior_dashboard-1774702615079.jpg not downloaded yet
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3283%252F3723283%252Finterior_boot-1774702640171.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3283/3723283/interior_boot-1774702640171.jpg not downloaded yet
2026-03-29 20:11:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6ffcd0>
2026-03-29 20:11:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7913%252F17627913%252Fexterior_rear_driver-1774629677330.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_rear_driver-1774629677330.jpg saved to cache
2026-03-29 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c3da72a-0193-5260-9644-126663bad2d3
2026-03-29 20:11:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c3da72a-0193-5260-9644-126663bad2d3, skipping ID generation
2026-03-29 20:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c3da72a-0193-5260-9644-126663bad2d3 with scrape type 1
2026-03-29 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c3da72a-0193-5260-9644-126663bad2d3 sending to next pipeline
2026-03-29 20:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0c3da72a-0193-5260-9644-126663bad2d3, identifier: 17627913
2026-03-29 20:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0c3da72a-0193-5260-9644-126663bad2d3 with identifier: 17627913
2026-03-29 20:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0c3da72a-0193-5260-9644-126663bad2d3 with identifier: 17627913
2026-03-29 20:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0c3da72a-0193-5260-9644-126663bad2d3 with identifier: 17627913 to the API
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_rear_driver-1774629677330.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '0c3da72a-0193-5260-9644-126663bad2d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'W200 CAP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17627913',
'listing': 'auction',
'location': 'Southend-on-Sea Westcliff-on-Sea',
'make': 'Vauxhall',
'model': 'Mokka',
'odometer': 75600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453223,
'Height': 2000,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_front_driver-1774629665957.jpg',
'Width': 2666},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 666785,
'Height': 2357,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_rear_driver-1774629677330.jpg',
'Width': 3143},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556263,
'Height': 2262,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_front_passenger-1774629662693.jpg',
'Width': 3016},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641805,
'Height': 2235,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7913/17627913/exterior_rear_passenger-1774629674594.jpg',
'Width': 2980},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1475136,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7913/17627913/interior_front_seats-1774630291827.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1381960,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7913/17627913/interior_rear_seats-1774630293535.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1226632,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7913/17627913/interior_dashboard-1774630321287.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1403517,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7913/17627913/interior_boot-1774630299509.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1015156,
'Height': 2822,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7913/17627913/docs_service_history-1774689900589.jpg?ixlib=js-3.8.0&auto=format&s=cd6c22cbfce267eb2808739f5377390e',
'Width': 3763},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3da72a-0193-5260-9644-126663bad2d3/0c3da72a-0193-5260-9644-126663bad2d3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1161113,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7913/17627913/docs_service_history-1774630493179.jpg?ixlib=js-3.8.0&auto=format&s=f331f380ac5b32e565b6a3bd8c86b4db',
'Width': 3840}],
'price': 2879,
'price_includes_vat': False,
'registration_date': '2014-09-01',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Mokka Tech Line Turbo S/S',
'transmission': 'manual',
'trim': 'Tech Line Turbo S/S',
'vin': 'W0LJC7E81EB764453',
'year': 2014}
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717627913%27 HTTP/1.1" 200 None
2026-03-29 20:11:59 [motorway.uk] INFO: Saving data for 17627913: {'created_time': 1774815119.846277, 'last_price_update_time': 1774815119.846287, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17627913') HTTP/1.1" 204 0
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3283%252F3723283%252Fdocs_service_history-1774779434194.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df3f2dd4274b3256fec5c9b6d380b40ca%27 HTTP/1.1" 200 None
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3283/3723283/docs_service_history-1774779434194.jpg?ixlib=js-3.8.0&auto=format&s=f3f2dd4274b3256fec5c9b6d380b40ca not downloaded yet
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3283%252F3723283%252Fdamage_scratches-1774778675146.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3283/3723283/damage_scratches-1774778675146.jpg not downloaded yet
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7195/20357195/exterior_rear_passenger-1774632326973.jpeg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5931/20375931/exterior_rear_passenger-1774106681379.jpg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5931/20375931/interior_front_seats-1774107695350.jpg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_rear_passenger-1774699539539.jpg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7195/20357195/interior_front_seats-1774634969273.jpeg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_front_driver-1774698242925.jpg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9595/16059595/interior_boot-1774619841073.jpg> (referer: None)
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddd4d50>
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2eb7d1-8998-5957-bb96-f8e2c49616c2/5f2eb7d1-8998-5957-bb96-f8e2c49616c2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7195%252F20357195%252Fexterior_rear_passenger-1774632326973.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7195/20357195/exterior_rear_passenger-1774632326973.jpeg saved to cache
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f2eb7d1-8998-5957-bb96-f8e2c49616c2
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5920d0>
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1870d742-7455-5161-b302-f42681e39a0b/1870d742-7455-5161-b302-f42681e39a0b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5931%252F20375931%252Fexterior_rear_passenger-1774106681379.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5931/20375931/exterior_rear_passenger-1774106681379.jpg saved to cache
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1870d742-7455-5161-b302-f42681e39a0b
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6ecc50>
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1870d742-7455-5161-b302-f42681e39a0b/1870d742-7455-5161-b302-f42681e39a0b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5931%252F20375931%252Finterior_front_seats-1774107695350.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5931/20375931/interior_front_seats-1774107695350.jpg saved to cache
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1870d742-7455-5161-b302-f42681e39a0b
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d19d890>
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5750%252F20325750%252Fexterior_rear_passenger-1774699539539.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_rear_passenger-1774699539539.jpg saved to cache
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc
2026-03-29 20:12:00 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:00 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:00 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003\xa5\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xee1\x003\x9b\xbc\x00\x00\x00\x00'
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc6be10>
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2eb7d1-8998-5957-bb96-f8e2c49616c2/5f2eb7d1-8998-5957-bb96-f8e2c49616c2_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7195%252F20357195%252Finterior_front_seats-1774634969273.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7195/20357195/interior_front_seats-1774634969273.jpeg saved to cache
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f2eb7d1-8998-5957-bb96-f8e2c49616c2
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc81fd0>
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3283%252F3723283%252Fexterior_front_driver-1774698242925.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_front_driver-1774698242925.jpg saved to cache
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8
2026-03-29 20:12:00 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:00 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:00 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x92\xb6r\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\xf9\xc9\x00\x92\xa1E\x00\x00\x00\x00'
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7aac90>
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eac07d2-9bd6-585c-beba-ccb9522acd50/3eac07d2-9bd6-585c-beba-ccb9522acd50_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9595%252F16059595%252Finterior_boot-1774619841073.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9595/16059595/interior_boot-1774619841073.jpg saved to cache
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3eac07d2-9bd6-585c-beba-ccb9522acd50
2026-03-29 20:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3283/3723283/docs_service_history-1774779434194.jpg?ixlib=js-3.8.0&auto=format&s=f3f2dd4274b3256fec5c9b6d380b40ca> (referer: None)
2026-03-29 20:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_front_passenger-1774699476491.jpg> (referer: None)
2026-03-29 20:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3283/3723283/damage_scratches-1774778675146.jpg> (referer: None)
2026-03-29 20:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3283/3723283/interior_boot-1774702640171.jpg> (referer: None)
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da51010>
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3283%252F3723283%252Fdocs_service_history-1774779434194.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df3f2dd4274b3256fec5c9b6d380b40ca') HTTP/1.1" 204 0
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3283/3723283/docs_service_history-1774779434194.jpg?ixlib=js-3.8.0&auto=format&s=f3f2dd4274b3256fec5c9b6d380b40ca saved to cache
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d693b50>
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5750%252F20325750%252Fexterior_front_passenger-1774699476491.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_front_passenger-1774699476491.jpg saved to cache
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da8c350>
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3283%252F3723283%252Fdamage_scratches-1774778675146.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3283/3723283/damage_scratches-1774778675146.jpg saved to cache
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9b8a10>
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3283%252F3723283%252Finterior_boot-1774702640171.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3283/3723283/interior_boot-1774702640171.jpg saved to cache
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8
2026-03-29 20:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_rear_driver-1774698252374.jpg> (referer: None)
2026-03-29 20:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_front_passenger-1774698279585.jpg> (referer: None)
2026-03-29 20:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3283/3723283/interior_front_seats-1774702568679.jpg> (referer: None)
2026-03-29 20:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3283/3723283/interior_dashboard-1774702615079.jpg> (referer: None)
2026-03-29 20:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3283/3723283/interior_rear_seats-1774702588198.jpg> (referer: None)
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0e1510>
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3283%252F3723283%252Fexterior_rear_driver-1774698252374.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_rear_driver-1774698252374.jpg saved to cache
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8
2026-03-29 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_rear_passenger-1774698263267.jpg> (referer: None)
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4e9bd0>
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3283%252F3723283%252Fexterior_front_passenger-1774698279585.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_front_passenger-1774698279585.jpg saved to cache
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8a0d90>
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3283%252F3723283%252Finterior_front_seats-1774702568679.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3283/3723283/interior_front_seats-1774702568679.jpg saved to cache
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f43ed90>
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3283%252F3723283%252Finterior_dashboard-1774702615079.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3283/3723283/interior_dashboard-1774702615079.jpg saved to cache
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2abed0>
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3283%252F3723283%252Finterior_rear_seats-1774702588198.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3283/3723283/interior_rear_seats-1774702588198.jpg saved to cache
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8
2026-03-29 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20445276.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d7f2350>
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3283%252F3723283%252Fexterior_rear_passenger-1774698263267.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_rear_passenger-1774698263267.jpg saved to cache
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8
2026-03-29 20:12:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c00c5979-2bc6-5a10-afd0-ecdf1702c3e8, skipping ID generation
2026-03-29 20:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8 with scrape type 1
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c00c5979-2bc6-5a10-afd0-ecdf1702c3e8 sending to next pipeline
2026-03-29 20:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c00c5979-2bc6-5a10-afd0-ecdf1702c3e8, identifier: 3723283
2026-03-29 20:12:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c00c5979-2bc6-5a10-afd0-ecdf1702c3e8 with identifier: 3723283
2026-03-29 20:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c00c5979-2bc6-5a10-afd0-ecdf1702c3e8 with identifier: 3723283
2026-03-29 20:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c00c5979-2bc6-5a10-afd0-ecdf1702c3e8 with identifier: 3723283 to the API
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_rear_passenger-1774698263267.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c00c5979-2bc6-5a10-afd0-ecdf1702c3e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EK64 EBC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3723283',
'listing': 'auction',
'location': 'Greater London Upminster',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 76100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2249952,
'Height': 2956,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_front_driver-1774698242925.jpg',
'Width': 3941},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1334839,
'Height': 2442,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_rear_driver-1774698252374.jpg',
'Width': 3256},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1697282,
'Height': 2500,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_front_passenger-1774698279585.jpg',
'Width': 3333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1616790,
'Height': 2548,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3283/3723283/exterior_rear_passenger-1774698263267.jpg',
'Width': 3397},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3169296,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3283/3723283/interior_front_seats-1774702568679.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4268577,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3283/3723283/interior_rear_seats-1774702588198.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3441970,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3283/3723283/interior_dashboard-1774702615079.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4066345,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3283/3723283/interior_boot-1774702640171.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1018858,
'Height': 4412,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3283/3723283/docs_service_history-1774779434194.jpg?ixlib=js-3.8.0&auto=format&s=f3f2dd4274b3256fec5c9b6d380b40ca',
'Width': 2600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00c5979-2bc6-5a10-afd0-ecdf1702c3e8/c00c5979-2bc6-5a10-afd0-ecdf1702c3e8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3525227,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3283/3723283/damage_scratches-1774778675146.jpg',
'Width': 4032}],
'price': 2578,
'price_includes_vat': False,
'registration_date': '2014-10-28',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Zetec',
'transmission': 'manual',
'trim': 'Zetec',
'vin': 'WF0CXXGAKCEP55742',
'year': 2014}
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273723283%27 HTTP/1.1" 200 None
2026-03-29 20:12:03 [motorway.uk] INFO: Saving data for 3723283: {'created_time': 1774815123.37401, 'last_price_update_time': 1774815123.374038, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3723283') HTTP/1.1" 204 0
2026-03-29 20:12:03 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12275636) larger than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/9595/16059595/instrument_cluster-1774619922378.jpg>.
2026-03-29 20:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18039395.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18291869.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20455993.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20492752.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04e89c48-32e7-55cc-bdbc-07873b1bbce7 with identifier: 20445276
2026-03-29 20:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04e89c48-32e7-55cc-bdbc-07873b1bbce7 with scrape type 1
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04e89c48-32e7-55cc-bdbc-07873b1bbce7
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5276%252F20445276%252Fexterior_front_driver-1774523312440.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5276/20445276/exterior_front_driver-1774523312440.jpg not downloaded yet
2026-03-29 20:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5276%252F20445276%252Fexterior_rear_driver-1774523311337.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5276/20445276/exterior_rear_driver-1774523311337.jpg not downloaded yet
2026-03-29 20:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5276%252F20445276%252Fexterior_front_passenger-1774523304368.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5276/20445276/exterior_front_passenger-1774523304368.jpg not downloaded yet
2026-03-29 20:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7195/20357195/exterior_front_passenger-1774632300520.jpeg> (referer: None)
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5276%252F20445276%252Fexterior_rear_passenger-1774523303613.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5276/20445276/exterior_rear_passenger-1774523303613.jpg not downloaded yet
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5276%252F20445276%252Finterior_front_seats-1774523715566.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5276/20445276/interior_front_seats-1774523715566.jpg not downloaded yet
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5276%252F20445276%252Finterior_rear_seats-1774523710725.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5276/20445276/interior_rear_seats-1774523710725.jpg not downloaded yet
2026-03-29 20:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5931/20375931/exterior_front_passenger-1774106679579.jpg> (referer: None)
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5276%252F20445276%252Finterior_dashboard-1774523773176.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5276/20445276/interior_dashboard-1774523773176.jpg not downloaded yet
2026-03-29 20:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 172f2fa3-c348-510d-a40e-0b6e89106960 with identifier: 18039395
2026-03-29 20:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 172f2fa3-c348-510d-a40e-0b6e89106960 with scrape type 2
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 172f2fa3-c348-510d-a40e-0b6e89106960 with scrape type 2
2026-03-29 20:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 172f2fa3-c348-510d-a40e-0b6e89106960, identifier: 18039395
2026-03-29 20:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e3dac98-5237-5a43-8a63-0fdc69a8ea09 with identifier: 18291869
2026-03-29 20:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e3dac98-5237-5a43-8a63-0fdc69a8ea09 with scrape type 1
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e3dac98-5237-5a43-8a63-0fdc69a8ea09
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1869%252F18291869%252Fexterior_front_driver-1774708529738.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1869/18291869/exterior_front_driver-1774708529738.jpg not downloaded yet
2026-03-29 20:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd4bdd7f-af75-540b-8946-943994b3350e with identifier: 20455993
2026-03-29 20:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd4bdd7f-af75-540b-8946-943994b3350e with scrape type 1
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd4bdd7f-af75-540b-8946-943994b3350e
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5993%252F20455993%252Fexterior_front_driver-1774630372527.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5993/20455993/exterior_front_driver-1774630372527.jpg not downloaded yet
2026-03-29 20:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91a5d72b-4552-5f91-a56c-898eeea5dc6e with identifier: 20492752
2026-03-29 20:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91a5d72b-4552-5f91-a56c-898eeea5dc6e with scrape type 1
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91a5d72b-4552-5f91-a56c-898eeea5dc6e
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2752%252F20492752%252Fexterior_front_driver-1774717022990.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2752/20492752/exterior_front_driver-1774717022990.jpg not downloaded yet
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5276%252F20445276%252Finstrument_cluster-1774523807495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5276/20445276/instrument_cluster-1774523807495.jpg not downloaded yet
2026-03-29 20:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 172f2fa3-c348-510d-a40e-0b6e89106960 with identifier: 18039395
2026-03-29 20:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 172f2fa3-c348-510d-a40e-0b6e89106960 with identifier: 18039395
2026-03-29 20:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 172f2fa3-c348-510d-a40e-0b6e89106960 with identifier: 18039395 to the API
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18039395.json>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '172f2fa3-c348-510d-a40e-0b6e89106960',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DGZ 3243',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18039395',
'listing': 'auction',
'location': 'Ards and North Down Newtownards',
'make': 'BMW',
'model': '2 Series',
'odometer': 39200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 10764,
'price_includes_vat': False,
'registration_date': '2016-08-24',
'seats_number': None,
'seller_name': None,
'title': 'BMW 220I M Sport Auto',
'transmission': 'automatic',
'trim': '220I M Sport Auto',
'vin': 'WBA1L72060V492048',
'year': 2016}
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718039395%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [motorway.uk] INFO: Saving data for 18039395: {'auction_closing_time': 1774884600.0, 'created_time': 1774728487.529268, 'last_price_update_time': 1774815124.371583}
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18039395') HTTP/1.1" 204 0
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1869%252F18291869%252Fexterior_rear_driver-1774708522599.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1869/18291869/exterior_rear_driver-1774708522599.jpg not downloaded yet
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5993%252F20455993%252Fexterior_rear_driver-1774630398630.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5993/20455993/exterior_rear_driver-1774630398630.jpg not downloaded yet
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2752%252F20492752%252Fexterior_rear_driver-1774717044607.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2752/20492752/exterior_rear_driver-1774717044607.jpg not downloaded yet
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5276%252F20445276%252Finterior_boot-1774716568980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5276/20445276/interior_boot-1774716568980.jpg not downloaded yet
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9b9f50>
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2eb7d1-8998-5957-bb96-f8e2c49616c2/5f2eb7d1-8998-5957-bb96-f8e2c49616c2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7195%252F20357195%252Fexterior_front_passenger-1774632300520.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7195/20357195/exterior_front_passenger-1774632300520.jpeg saved to cache
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f2eb7d1-8998-5957-bb96-f8e2c49616c2
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dce7a90>
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1870d742-7455-5161-b302-f42681e39a0b/1870d742-7455-5161-b302-f42681e39a0b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5931%252F20375931%252Fexterior_front_passenger-1774106679579.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5931/20375931/exterior_front_passenger-1774106679579.jpg saved to cache
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1870d742-7455-5161-b302-f42681e39a0b
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1869%252F18291869%252Fexterior_front_passenger-1774708536115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1869/18291869/exterior_front_passenger-1774708536115.jpg not downloaded yet
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5993%252F20455993%252Fexterior_front_passenger-1774630452494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5993/20455993/exterior_front_passenger-1774630452494.jpg not downloaded yet
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2752%252F20492752%252Fexterior_front_passenger-1774717083857.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2752/20492752/exterior_front_passenger-1774717083857.jpg not downloaded yet
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5276%252F20445276%252Fdamage_scratches-1774523351412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5276/20445276/damage_scratches-1774523351412.jpg not downloaded yet
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1869%252F18291869%252Fexterior_rear_passenger-1774708525585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1869/18291869/exterior_rear_passenger-1774708525585.jpg not downloaded yet
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5993%252F20455993%252Fexterior_rear_passenger-1774630423995.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5993/20455993/exterior_rear_passenger-1774630423995.jpg not downloaded yet
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2752%252F20492752%252Fexterior_rear_passenger-1774717061879.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2752/20492752/exterior_rear_passenger-1774717061879.jpg not downloaded yet
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1869%252F18291869%252Finterior_front_seats-1774773085492.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1869/18291869/interior_front_seats-1774773085492.jpg not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5993%252F20455993%252Finterior_front_seats-1774630856806.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5993/20455993/interior_front_seats-1774630856806.jpg not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2752%252F20492752%252Finterior_front_seats-1774717551754.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2752/20492752/interior_front_seats-1774717551754.jpg not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1869%252F18291869%252Finterior_rear_seats-1774710269289.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1869/18291869/interior_rear_seats-1774710269289.jpg not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5993%252F20455993%252Finterior_rear_seats-1774630887669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5993/20455993/interior_rear_seats-1774630887669.jpg not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2752%252F20492752%252Finterior_rear_seats-1774717589583.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2752/20492752/interior_rear_seats-1774717589583.jpg not downloaded yet
2026-03-29 20:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5276/20445276/exterior_front_driver-1774523312440.jpg> (referer: None)
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1869%252F18291869%252Finterior_dashboard-1774712936961.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1869/18291869/interior_dashboard-1774712936961.jpg not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5993%252F20455993%252Finterior_dashboard-1774630935015.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5993/20455993/interior_dashboard-1774630935015.jpg not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2752%252F20492752%252Finterior_dashboard-1774717534362.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2752/20492752/interior_dashboard-1774717534362.jpg not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1869%252F18291869%252Finterior_boot-1774773062684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1869/18291869/interior_boot-1774773062684.jpg not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5993%252F20455993%252Finterior_boot-1774630945624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5993/20455993/interior_boot-1774630945624.jpg not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2752%252F20492752%252Finstrument_cluster-1774717610121.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2752/20492752/instrument_cluster-1774717610121.jpg not downloaded yet
2026-03-29 20:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7195/20357195/exterior_rear_driver-1774632341586.jpeg> (referer: None)
2026-03-29 20:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5931/20375931/exterior_rear_driver-1774106674513.jpg> (referer: None)
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1869%252F18291869%252Fwheels_front_driver-1774709543732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1869/18291869/wheels_front_driver-1774709543732.jpg not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5993%252F20455993%252Fdocs_service_history-1774704776910.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9969cba5d5e7e23987541f56f2a702fa%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5993/20455993/docs_service_history-1774704776910.jpg?ixlib=js-3.8.0&auto=format&s=9969cba5d5e7e23987541f56f2a702fa not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2752%252F20492752%252Finterior_boot-1774717633937.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2752/20492752/interior_boot-1774717633937.jpg not downloaded yet
2026-03-29 20:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5276/20445276/exterior_front_passenger-1774523304368.jpg> (referer: None)
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1869%252F18291869%252Fwheels_rear_driver-1774709553435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1869/18291869/wheels_rear_driver-1774709553435.jpg not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5993%252F20455993%252Fdocs_service_history-1774704776943.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da729a74069de473ffdd2d56a78975c53%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5993/20455993/docs_service_history-1774704776943.jpg?ixlib=js-3.8.0&auto=format&s=a729a74069de473ffdd2d56a78975c53 not downloaded yet
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2752%252F20492752%252Fdocs_service_history-1774774030687.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D660a43ca7a8c8710a6111be5559f6f51%27 HTTP/1.1" 200 None
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2752/20492752/docs_service_history-1774774030687.jpg?ixlib=js-3.8.0&auto=format&s=660a43ca7a8c8710a6111be5559f6f51 not downloaded yet
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db781d0>
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04e89c48-32e7-55cc-bdbc-07873b1bbce7/04e89c48-32e7-55cc-bdbc-07873b1bbce7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5276%252F20445276%252Fexterior_front_driver-1774523312440.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5276/20445276/exterior_front_driver-1774523312440.jpg saved to cache
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04e89c48-32e7-55cc-bdbc-07873b1bbce7
2026-03-29 20:12:05 [scrapy.extensions.logstats] INFO: Crawled 292 pages (at 45 pages/min), scraped 148 items (at 20 items/min)
2026-03-29 20:12:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 302MiB
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce7dd10>
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f2eb7d1-8998-5957-bb96-f8e2c49616c2/5f2eb7d1-8998-5957-bb96-f8e2c49616c2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7195%252F20357195%252Fexterior_rear_driver-1774632341586.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7195/20357195/exterior_rear_driver-1774632341586.jpeg saved to cache
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f2eb7d1-8998-5957-bb96-f8e2c49616c2
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0e4210>
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1870d742-7455-5161-b302-f42681e39a0b/1870d742-7455-5161-b302-f42681e39a0b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5931%252F20375931%252Fexterior_rear_driver-1774106674513.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5931/20375931/exterior_rear_driver-1774106674513.jpg saved to cache
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1870d742-7455-5161-b302-f42681e39a0b
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8bbd50>
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04e89c48-32e7-55cc-bdbc-07873b1bbce7/04e89c48-32e7-55cc-bdbc-07873b1bbce7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5276%252F20445276%252Fexterior_front_passenger-1774523304368.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5276/20445276/exterior_front_passenger-1774523304368.jpg saved to cache
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04e89c48-32e7-55cc-bdbc-07873b1bbce7
2026-03-29 20:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_front_driver-1774699354874.jpg> (referer: None)
2026-03-29 20:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5276/20445276/interior_rear_seats-1774523710725.jpg> (referer: None)
2026-03-29 20:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2752/20492752/instrument_cluster-1774717610121.jpg> (referer: None)
2026-03-29 20:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5993/20455993/interior_boot-1774630945624.jpg> (referer: None)
2026-03-29 20:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5993/20455993/docs_service_history-1774704776943.jpg?ixlib=js-3.8.0&auto=format&s=a729a74069de473ffdd2d56a78975c53> (referer: None)
2026-03-29 20:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2752/20492752/interior_rear_seats-1774717589583.jpg> (referer: None)
2026-03-29 20:12:05 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/9595/16059595/instrument_cluster-1774619922378.jpg>.
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8b9b90>
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5750%252F20325750%252Fexterior_front_driver-1774699354874.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_front_driver-1774699354874.jpg saved to cache
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc
2026-03-29 20:12:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 147f1fb4-587b-5dcf-abab-0d8c8591dcdc, skipping ID generation
2026-03-29 20:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc with scrape type 1
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 147f1fb4-587b-5dcf-abab-0d8c8591dcdc sending to next pipeline
2026-03-29 20:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 147f1fb4-587b-5dcf-abab-0d8c8591dcdc, identifier: 20325750
2026-03-29 20:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 147f1fb4-587b-5dcf-abab-0d8c8591dcdc with identifier: 20325750
2026-03-29 20:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 147f1fb4-587b-5dcf-abab-0d8c8591dcdc with identifier: 20325750
2026-03-29 20:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 147f1fb4-587b-5dcf-abab-0d8c8591dcdc with identifier: 20325750 to the API
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_front_driver-1774699354874.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '147f1fb4-587b-5dcf-abab-0d8c8591dcdc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WL17 DVA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20325750',
'listing': 'auction',
'location': 'Buckinghamshire Aylesbury',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 95000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2739580,
'Height': 2990,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_front_driver-1774699354874.jpg',
'Width': 3986},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1787624,
'Height': 2564,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_rear_driver-1774699604907.jpg',
'Width': 3418},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2858944,
'Height': 2999,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_front_passenger-1774699476491.jpg',
'Width': 3999},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2825322,
'Height': 2993,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5750/20325750/exterior_rear_passenger-1774699539539.jpg',
'Width': 3991},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4084943,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5750/20325750/interior_front_seats-1774700114495.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4098911,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5750/20325750/interior_rear_seats-1774700129969.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3850739,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5750/20325750/interior_dashboard-1774700163879.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3576407,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5750/20325750/instrument_cluster-1774700207336.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4165363,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5750/20325750/interior_boot-1774700180813.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147f1fb4-587b-5dcf-abab-0d8c8591dcdc/147f1fb4-587b-5dcf-abab-0d8c8591dcdc_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3537247,
'Height': 2268,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5750/20325750/docs_service_history-1774711510720.jpg?ixlib=js-3.8.0&auto=format&s=10070c546dc8e70031783c7e9d0b1ac5',
'Width': 4032}],
'price': 4095,
'price_includes_vat': False,
'registration_date': '2017-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai Acenta Smart VIS DCI',
'transmission': 'manual',
'trim': 'Acenta Smart VIS DCI',
'vin': 'SJNFAAJ11UZ085834',
'year': 2017}
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720325750%27 HTTP/1.1" 200 None
2026-03-29 20:12:06 [motorway.uk] INFO: Saving data for 20325750: {'created_time': 1774815126.511097, 'last_price_update_time': 1774815126.511108, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20325750') HTTP/1.1" 204 0
2026-03-29 20:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9595/16059595/instrument_cluster-1774619922378.jpg> (referer: None)
2026-03-29 20:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1368&page=38&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e106290>
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04e89c48-32e7-55cc-bdbc-07873b1bbce7/04e89c48-32e7-55cc-bdbc-07873b1bbce7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5276%252F20445276%252Finterior_rear_seats-1774523710725.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5276/20445276/interior_rear_seats-1774523710725.jpg saved to cache
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04e89c48-32e7-55cc-bdbc-07873b1bbce7
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dabef50>
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91a5d72b-4552-5f91-a56c-898eeea5dc6e/91a5d72b-4552-5f91-a56c-898eeea5dc6e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2752%252F20492752%252Finstrument_cluster-1774717610121.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2752/20492752/instrument_cluster-1774717610121.jpg saved to cache
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91a5d72b-4552-5f91-a56c-898eeea5dc6e
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da89850>
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4bdd7f-af75-540b-8946-943994b3350e/bd4bdd7f-af75-540b-8946-943994b3350e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5993%252F20455993%252Finterior_boot-1774630945624.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5993/20455993/interior_boot-1774630945624.jpg saved to cache
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd4bdd7f-af75-540b-8946-943994b3350e
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3e4c50>
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4bdd7f-af75-540b-8946-943994b3350e/bd4bdd7f-af75-540b-8946-943994b3350e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5993%252F20455993%252Fdocs_service_history-1774704776943.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da729a74069de473ffdd2d56a78975c53') HTTP/1.1" 204 0
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5993/20455993/docs_service_history-1774704776943.jpg?ixlib=js-3.8.0&auto=format&s=a729a74069de473ffdd2d56a78975c53 saved to cache
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd4bdd7f-af75-540b-8946-943994b3350e
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4b75d0>
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91a5d72b-4552-5f91-a56c-898eeea5dc6e/91a5d72b-4552-5f91-a56c-898eeea5dc6e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2752%252F20492752%252Finterior_rear_seats-1774717589583.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2752/20492752/interior_rear_seats-1774717589583.jpg saved to cache
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91a5d72b-4552-5f91-a56c-898eeea5dc6e
2026-03-29 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10398218.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:07 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:07 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:07 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xb5}J\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\xd2j\x00\xb5h9\x00\x00\x00\x00'
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0cf3d0>
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eac07d2-9bd6-585c-beba-ccb9522acd50/3eac07d2-9bd6-585c-beba-ccb9522acd50_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9595%252F16059595%252Finstrument_cluster-1774619922378.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9595/16059595/instrument_cluster-1774619922378.jpg saved to cache
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3eac07d2-9bd6-585c-beba-ccb9522acd50
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20171913
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20353654
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720353654%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Scrape type for 20353654: 1
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 19798610
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719798610%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Scrape type for 19798610: 1
2026-03-29 20:12:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0947bb9f-266e-5ff1-b2a9-8900fcaf00c2 with identifier: 10398218
2026-03-29 20:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0947bb9f-266e-5ff1-b2a9-8900fcaf00c2 with scrape type 1
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0947bb9f-266e-5ff1-b2a9-8900fcaf00c2
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8218%252F10398218%252Fexterior_front_driver-1774633781102.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8218/10398218/exterior_front_driver-1774633781102.jpg not downloaded yet
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20208609
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720208609%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Scrape type for 20208609: 1
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8218%252F10398218%252Fexterior_rear_driver-1774633828127.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8218/10398218/exterior_rear_driver-1774633828127.jpg not downloaded yet
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20403793
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 18826766
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 15306667
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 18106884
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20481936
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 17411348
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717411348%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Scrape type for 17411348: 1
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8218%252F10398218%252Fexterior_front_passenger-1774633792825.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8218/10398218/exterior_front_passenger-1774633792825.jpg not downloaded yet
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20387296
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20352821
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720352821%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Scrape type for 20352821: 1
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8218%252F10398218%252Fexterior_rear_passenger-1774633813485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8218/10398218/exterior_rear_passenger-1774633813485.jpg not downloaded yet
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20440778
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720440778%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Scrape type for 20440778: 1
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8218%252F10398218%252Finterior_front_seats-1774634068185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8218/10398218/interior_front_seats-1774634068185.jpg not downloaded yet
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20434747
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20475784
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475784%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Scrape type for 20475784: 1
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8218%252F10398218%252Finterior_rear_seats-1774634130254.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8218/10398218/interior_rear_seats-1774634130254.jpg not downloaded yet
2026-03-29 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20436941.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 13472860
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 19800646
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719800646%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Scrape type for 19800646: 1
2026-03-29 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16325362.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8218%252F10398218%252F10398218-interior_dashboard-modified-1774680255610.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8218/10398218/10398218-interior_dashboard-modified-1774680255610.jpeg not downloaded yet
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20486113
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486113%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Scrape type for 20486113: 1
2026-03-29 20:12:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8218%252F10398218%252Finstrument_cluster-1774634291545.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8218/10398218/instrument_cluster-1774634291545.jpg not downloaded yet
2026-03-29 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2752/20492752/docs_service_history-1774774030687.jpg?ixlib=js-3.8.0&auto=format&s=660a43ca7a8c8710a6111be5559f6f51> (referer: None)
2026-03-29 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5993/20455993/docs_service_history-1774704776910.jpg?ixlib=js-3.8.0&auto=format&s=9969cba5d5e7e23987541f56f2a702fa> (referer: None)
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 9188015
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 19873205
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 19831066
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 18930020
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 19619181
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719619181%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Scrape type for 19619181: 1
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8218%252F10398218%252Finterior_boot-1774634198703.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8218/10398218/interior_boot-1774634198703.jpg not downloaded yet
2026-03-29 20:12:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f5a2878-ce22-5ad5-8c39-822bc163db6c with identifier: 20436941
2026-03-29 20:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c with scrape type 1
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6941%252F20436941%252Fexterior_front_driver-1774694772113.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_front_driver-1774694772113.jpg not downloaded yet
2026-03-29 20:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d138d72b-be0c-5866-9dc0-3181506dbb10 with identifier: 16325362
2026-03-29 20:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d138d72b-be0c-5866-9dc0-3181506dbb10 with scrape type 1
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d138d72b-be0c-5866-9dc0-3181506dbb10
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5362%252F16325362%252Fexterior_front_driver-1774699975834.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_front_driver-1774699975834.jpg not downloaded yet
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20103257
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20453524
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 4610978
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20397419
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 17989138
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20389959
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20460435
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20487343
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 19895213
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719895213%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [motorway.uk] INFO: Scrape type for 19895213: 1
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8218%252F10398218%252Fdocs_service_history-1774634467776.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D762c278a54e4f5aae00d37fafc744b9c%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8218/10398218/docs_service_history-1774634467776.jpg?ixlib=js-3.8.0&auto=format&s=762c278a54e4f5aae00d37fafc744b9c not downloaded yet
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6941%252F20436941%252Fexterior_rear_driver-1774694796149.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_rear_driver-1774694796149.jpg not downloaded yet
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5362%252F16325362%252Fexterior_rear_driver-1774700010124.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_rear_driver-1774700010124.jpg not downloaded yet
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20432299
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 19974522
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 18180278
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718180278%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [motorway.uk] INFO: Scrape type for 18180278: 1
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d459590>
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91a5d72b-4552-5f91-a56c-898eeea5dc6e/91a5d72b-4552-5f91-a56c-898eeea5dc6e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2752%252F20492752%252Fdocs_service_history-1774774030687.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D660a43ca7a8c8710a6111be5559f6f51') HTTP/1.1" 204 0
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2752/20492752/docs_service_history-1774774030687.jpg?ixlib=js-3.8.0&auto=format&s=660a43ca7a8c8710a6111be5559f6f51 saved to cache
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91a5d72b-4552-5f91-a56c-898eeea5dc6e
2026-03-29 20:12:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddd62d0>
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4bdd7f-af75-540b-8946-943994b3350e/bd4bdd7f-af75-540b-8946-943994b3350e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5993%252F20455993%252Fdocs_service_history-1774704776910.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9969cba5d5e7e23987541f56f2a702fa') HTTP/1.1" 204 0
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5993/20455993/docs_service_history-1774704776910.jpg?ixlib=js-3.8.0&auto=format&s=9969cba5d5e7e23987541f56f2a702fa saved to cache
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd4bdd7f-af75-540b-8946-943994b3350e
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6941%252F20436941%252Fexterior_front_passenger-1774694816407.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_front_passenger-1774694816407.jpg not downloaded yet
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5362%252F16325362%252Fexterior_front_passenger-1774700084306.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_front_passenger-1774700084306.jpg not downloaded yet
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 19957959
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6941%252F20436941%252Fexterior_rear_passenger-1774694805337.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_rear_passenger-1774694805337.jpg not downloaded yet
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5362%252F16325362%252Fexterior_rear_passenger-1774700033305.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_rear_passenger-1774700033305.jpg not downloaded yet
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6941%252F20436941%252Finterior_front_seats-1774695439248.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6941/20436941/interior_front_seats-1774695439248.jpg not downloaded yet
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5362%252F16325362%252Finterior_front_seats-1774700756924.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5362/16325362/interior_front_seats-1774700756924.jpg not downloaded yet
2026-03-29 20:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5993/20455993/interior_dashboard-1774630935015.jpg> (referer: None)
2026-03-29 20:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1869/18291869/wheels_front_driver-1774709543732.jpg> (referer: None)
2026-03-29 20:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9595/16059595/interior_dashboard-1774619841780.jpg> (referer: None)
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6941%252F20436941%252Finterior_rear_seats-1774695458129.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6941/20436941/interior_rear_seats-1774695458129.jpg not downloaded yet
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5362%252F16325362%252Finterior_rear_seats-1774700694383.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5362/16325362/interior_rear_seats-1774700694383.jpg not downloaded yet
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6941%252F20436941%252Finterior_dashboard-1774702455688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6941/20436941/interior_dashboard-1774702455688.jpg not downloaded yet
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5362%252F16325362%252Finterior_dashboard-1774700807611.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5362/16325362/interior_dashboard-1774700807611.jpg not downloaded yet
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6941%252F20436941%252Finterior_boot-1774695518045.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6941/20436941/interior_boot-1774695518045.jpg not downloaded yet
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5362%252F16325362%252Finterior_boot-1774700738692.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5362/16325362/interior_boot-1774700738692.jpg not downloaded yet
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6941%252F20436941%252Fdamage_scratches-1774694856392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6941/20436941/damage_scratches-1774694856392.jpg not downloaded yet
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5362%252F16325362%252Fdocs_service_history-1774701273445.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D592f37b50ad9b7423ec0d46802b17fe4%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5362/16325362/docs_service_history-1774701273445.jpg?ixlib=js-3.8.0&auto=format&s=592f37b50ad9b7423ec0d46802b17fe4 not downloaded yet
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d7f2350>
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4bdd7f-af75-540b-8946-943994b3350e/bd4bdd7f-af75-540b-8946-943994b3350e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5993%252F20455993%252Finterior_dashboard-1774630935015.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5993/20455993/interior_dashboard-1774630935015.jpg saved to cache
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd4bdd7f-af75-540b-8946-943994b3350e
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d19c810>
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e3dac98-5237-5a43-8a63-0fdc69a8ea09/1e3dac98-5237-5a43-8a63-0fdc69a8ea09_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1869%252F18291869%252Fwheels_front_driver-1774709543732.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1869/18291869/wheels_front_driver-1774709543732.jpg saved to cache
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e3dac98-5237-5a43-8a63-0fdc69a8ea09
2026-03-29 20:12:08 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:08 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:08 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x89O\x85\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04T\xd2\x00\x89:X\x00\x00\x00\x00'
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c646d90>
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eac07d2-9bd6-585c-beba-ccb9522acd50/3eac07d2-9bd6-585c-beba-ccb9522acd50_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9595%252F16059595%252Finterior_dashboard-1774619841780.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9595/16059595/interior_dashboard-1774619841780.jpg saved to cache
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3eac07d2-9bd6-585c-beba-ccb9522acd50
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6941%252F20436941%252Fdamage_scratches-1774694877815.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6941/20436941/damage_scratches-1774694877815.jpg not downloaded yet
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5362%252F16325362%252Fdocs_service_history-1774701274209.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D90b5fc3d0e98689d174c34c789019cee%27 HTTP/1.1" 200 None
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5362/16325362/docs_service_history-1774701274209.jpg?ixlib=js-3.8.0&auto=format&s=90b5fc3d0e98689d174c34c789019cee not downloaded yet
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20461651.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1869/18291869/wheels_rear_driver-1774709553435.jpg> (referer: None)
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8218/10398218/instrument_cluster-1774634291545.jpg> (referer: None)
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1869/18291869/interior_boot-1774773062684.jpg> (referer: None)
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_rear_passenger-1774694805337.jpg> (referer: None)
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_rear_passenger-1774700033305.jpg> (referer: None)
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2752/20492752/interior_dashboard-1774717534362.jpg> (referer: None)
2026-03-29 20:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d1b1050-007c-5085-bba6-0509b1c10077 with identifier: 20461651
2026-03-29 20:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d1b1050-007c-5085-bba6-0509b1c10077 with scrape type 1
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d1b1050-007c-5085-bba6-0509b1c10077
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1651%252F20461651%252Fexterior_front_driver-1774611713501.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_front_driver-1774611713501.jpg not downloaded yet
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1651%252F20461651%252Fexterior_rear_driver-1774611738219.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_rear_driver-1774611738219.jpg not downloaded yet
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20471387.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1651%252F20461651%252Fexterior_front_passenger-1774611750519.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_front_passenger-1774611750519.jpg not downloaded yet
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2f5bd0>
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e3dac98-5237-5a43-8a63-0fdc69a8ea09/1e3dac98-5237-5a43-8a63-0fdc69a8ea09_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1869%252F18291869%252Fwheels_rear_driver-1774709553435.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1869/18291869/wheels_rear_driver-1774709553435.jpg saved to cache
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e3dac98-5237-5a43-8a63-0fdc69a8ea09
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6b6a90>
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0947bb9f-266e-5ff1-b2a9-8900fcaf00c2/0947bb9f-266e-5ff1-b2a9-8900fcaf00c2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8218%252F10398218%252Finstrument_cluster-1774634291545.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8218/10398218/instrument_cluster-1774634291545.jpg saved to cache
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0947bb9f-266e-5ff1-b2a9-8900fcaf00c2
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d47b210>
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e3dac98-5237-5a43-8a63-0fdc69a8ea09/1e3dac98-5237-5a43-8a63-0fdc69a8ea09_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1869%252F18291869%252Finterior_boot-1774773062684.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1869/18291869/interior_boot-1774773062684.jpg saved to cache
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e3dac98-5237-5a43-8a63-0fdc69a8ea09
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f682fd0>
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6941%252F20436941%252Fexterior_rear_passenger-1774694805337.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_rear_passenger-1774694805337.jpg saved to cache
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c788e10>
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5362%252F16325362%252Fexterior_rear_passenger-1774700033305.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_rear_passenger-1774700033305.jpg saved to cache
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d138d72b-be0c-5866-9dc0-3181506dbb10
2026-03-29 20:12:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddfbb50>
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91a5d72b-4552-5f91-a56c-898eeea5dc6e/91a5d72b-4552-5f91-a56c-898eeea5dc6e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2752%252F20492752%252Finterior_dashboard-1774717534362.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2752/20492752/interior_dashboard-1774717534362.jpg saved to cache
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91a5d72b-4552-5f91-a56c-898eeea5dc6e
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1651%252F20461651%252Fexterior_rear_passenger-1774611694289.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_rear_passenger-1774611694289.jpg not downloaded yet
2026-03-29 20:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f37da565-4324-5ee8-854b-cd4571417849 with identifier: 20471387
2026-03-29 20:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f37da565-4324-5ee8-854b-cd4571417849 with scrape type 1
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f37da565-4324-5ee8-854b-cd4571417849
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1387%252F20471387%252Fexterior_front_driver-1774614947096.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_front_driver-1774614947096.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1651%252F20461651%252Finterior_front_seats-1774613279281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1651/20461651/interior_front_seats-1774613279281.jpg not downloaded yet
2026-03-29 20:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18005774.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20353654.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1387%252F20471387%252Fexterior_rear_driver-1774614960881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_rear_driver-1774614960881.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1651%252F20461651%252Finterior_rear_seats-1774613273983.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1651/20461651/interior_rear_seats-1774613273983.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1387%252F20471387%252Fexterior_front_passenger-1774615012329.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_front_passenger-1774615012329.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1651%252F20461651%252Finterior_dashboard-1774612212329.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1651/20461651/interior_dashboard-1774612212329.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1387%252F20471387%252Fexterior_rear_passenger-1774614980486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_rear_passenger-1774614980486.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1651%252F20461651%252Finterior_boot-1774613267368.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1651/20461651/interior_boot-1774613267368.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1387%252F20471387%252Finterior_front_seats-1774616188258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1387/20471387/interior_front_seats-1774616188258.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1651%252F20461651%252Fdocs_service_history-1774624542712.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D509705f78a8cd43db5d6990b26289fe6%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1651/20461651/docs_service_history-1774624542712.png?ixlib=js-3.8.0&auto=format&s=509705f78a8cd43db5d6990b26289fe6 not downloaded yet
2026-03-29 20:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c with identifier: 18005774
2026-03-29 20:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c with scrape type 1
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5774%252F18005774%252Fexterior_front_driver-1774610692918.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_front_driver-1774610692918.jpg not downloaded yet
2026-03-29 20:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c80decf3-d69e-52fc-b22b-3b28f59c1e71 with identifier: 20353654
2026-03-29 20:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80decf3-d69e-52fc-b22b-3b28f59c1e71 with scrape type 1
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c80decf3-d69e-52fc-b22b-3b28f59c1e71
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3654%252F20353654%252Fexterior_front_driver-1774695957678.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_front_driver-1774695957678.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1387%252F20471387%252Finterior_rear_seats-1774616208363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1387/20471387/interior_rear_seats-1774616208363.jpg not downloaded yet
2026-03-29 20:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20475784.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1651%252F20461651%252Fdamage_scratches-1774611746573.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1651/20461651/damage_scratches-1774611746573.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5774%252F18005774%252Fexterior_rear_driver-1774610676224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_rear_driver-1774610676224.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3654%252F20353654%252Fexterior_rear_driver-1774695972754.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_rear_driver-1774695972754.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1387%252F20471387%252Finterior_dashboard-1774616463110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1387/20471387/interior_dashboard-1774616463110.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5774%252F18005774%252Fexterior_front_passenger-1774610653108.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_front_passenger-1774610653108.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3654%252F20353654%252Fexterior_front_passenger-1774695996373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_front_passenger-1774695996373.jpg not downloaded yet
2026-03-29 20:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5362/16325362/docs_service_history-1774701274209.jpg?ixlib=js-3.8.0&auto=format&s=90b5fc3d0e98689d174c34c789019cee> (referer: None)
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1387%252F20471387%252Finstrument_cluster-1774616303259.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1387/20471387/instrument_cluster-1774616303259.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5774%252F18005774%252Fexterior_rear_passenger-1774610625907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_rear_passenger-1774610625907.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3654%252F20353654%252Fexterior_rear_passenger-1774695987163.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_rear_passenger-1774695987163.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1387%252F20471387%252Finterior_boot-1774616448031.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1387/20471387/interior_boot-1774616448031.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5774%252F18005774%252Finterior_front_seats-1774611037534.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5774/18005774/interior_front_seats-1774611037534.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3654%252F20353654%252Finterior_front_seats-1774696160715.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3654/20353654/interior_front_seats-1774696160715.jpg not downloaded yet
2026-03-29 20:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486113.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19800646.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dfd24de-554f-56b0-a360-b09f017358bc with identifier: 20475784
2026-03-29 20:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dfd24de-554f-56b0-a360-b09f017358bc with scrape type 1
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7dfd24de-554f-56b0-a360-b09f017358bc
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5784%252F20475784%252Fexterior_front_driver-1774700687389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_front_driver-1774700687389.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1387%252F20471387%252Fdocs_service_history-1774617075335.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9900143c3111c0e615d44314a769c8f2%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1387/20471387/docs_service_history-1774617075335.jpg?ixlib=js-3.8.0&auto=format&s=9900143c3111c0e615d44314a769c8f2 not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5774%252F18005774%252Finterior_rear_seats-1774611051861.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5774/18005774/interior_rear_seats-1774611051861.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3654%252F20353654%252Finterior_rear_seats-1774696181916.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3654/20353654/interior_rear_seats-1774696181916.jpg not downloaded yet
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5784%252F20475784%252Fexterior_rear_driver-1774700695960.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_rear_driver-1774700695960.jpg not downloaded yet
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3073d0>
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5362%252F16325362%252Fdocs_service_history-1774701274209.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D90b5fc3d0e98689d174c34c789019cee') HTTP/1.1" 204 0
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5362/16325362/docs_service_history-1774701274209.jpg?ixlib=js-3.8.0&auto=format&s=90b5fc3d0e98689d174c34c789019cee saved to cache
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d138d72b-be0c-5866-9dc0-3181506dbb10
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5774%252F18005774%252Finterior_dashboard-1774611080047.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5774/18005774/interior_dashboard-1774611080047.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3654%252F20353654%252Finterior_dashboard-1774696270694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3654/20353654/interior_dashboard-1774696270694.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5784%252F20475784%252Fexterior_front_passenger-1774700721616.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_front_passenger-1774700721616.jpg not downloaded yet
2026-03-29 20:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5defd042-1631-5e0b-b1d9-bbbbdbc32790 with identifier: 20486113
2026-03-29 20:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790 with scrape type 1
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6113%252F20486113%252Fexterior_front_driver-1774720112777.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_front_driver-1774720112777.jpg not downloaded yet
2026-03-29 20:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9d712d2-7c29-5b31-800a-471a952be430 with identifier: 19800646
2026-03-29 20:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9d712d2-7c29-5b31-800a-471a952be430 with scrape type 1
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9d712d2-7c29-5b31-800a-471a952be430
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0646%252F19800646%252Fexterior_front_driver-1774716158444.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_front_driver-1774716158444.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5774%252F18005774%252Finstrument_cluster-1774611145511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5774/18005774/instrument_cluster-1774611145511.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3654%252F20353654%252Finstrument_cluster-1774696268899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3654/20353654/instrument_cluster-1774696268899.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5784%252F20475784%252Fexterior_rear_passenger-1774700704381.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_rear_passenger-1774700704381.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6113%252F20486113%252Fexterior_rear_driver-1774720046005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_rear_driver-1774720046005.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0646%252F19800646%252Fexterior_rear_driver-1774715122727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_rear_driver-1774715122727.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5774%252F18005774%252Finterior_boot-1774611267717.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5774/18005774/interior_boot-1774611267717.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3654%252F20353654%252Finterior_boot-1774696232975.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3654/20353654/interior_boot-1774696232975.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5784%252F20475784%252Finterior_front_seats-1774693925460.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5784/20475784/interior_front_seats-1774693925460.jpg not downloaded yet
2026-03-29 20:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/1393364.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6113%252F20486113%252Fexterior_front_passenger-1774720113812.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_front_passenger-1774720113812.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0646%252F19800646%252Fexterior_front_passenger-1774717509889.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_front_passenger-1774717509889.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5774%252F18005774%252Fdocs_service_history-1774612296496.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D766148e2c1544b4bc378078aa7acc6df%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5774/18005774/docs_service_history-1774612296496.png?ixlib=js-3.8.0&auto=format&s=766148e2c1544b4bc378078aa7acc6df not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3654%252F20353654%252Fdocs_service_history-1774696542959.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd3c431a313de6afdf9277e4ad5049bb8%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3654/20353654/docs_service_history-1774696542959.jpg?ixlib=js-3.8.0&auto=format&s=d3c431a313de6afdf9277e4ad5049bb8 not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5784%252F20475784%252Finterior_rear_seats-1774693962323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5784/20475784/interior_rear_seats-1774693962323.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6113%252F20486113%252Fexterior_rear_passenger-1774720080385.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_rear_passenger-1774720080385.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0646%252F19800646%252Fexterior_rear_passenger-1774717487715.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_rear_passenger-1774717487715.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5784%252F20475784%252Finterior_dashboard-1774694016481.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5784/20475784/interior_dashboard-1774694016481.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6113%252F20486113%252Finterior_front_seats-1774720719658.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6113/20486113/interior_front_seats-1774720719658.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0646%252F19800646%252Finterior_front_seats-1774715765165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0646/19800646/interior_front_seats-1774715765165.jpg not downloaded yet
2026-03-29 20:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_front_passenger-1774611750519.jpg> (referer: None)
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5784%252F20475784%252Finstrument_cluster-1774694022317.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5784/20475784/instrument_cluster-1774694022317.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6113%252F20486113%252Finterior_rear_seats-1774720825194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6113/20486113/interior_rear_seats-1774720825194.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0646%252F19800646%252Finterior_rear_seats-1774715803901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0646/19800646/interior_rear_seats-1774715803901.jpg not downloaded yet
2026-03-29 20:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e17e33d-d921-55cb-a486-40c1122772b4 with identifier: 1393364
2026-03-29 20:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e17e33d-d921-55cb-a486-40c1122772b4 with scrape type 1
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e17e33d-d921-55cb-a486-40c1122772b4
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3364%252F1393364%252Fexterior_front_driver-1774711288966.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_front_driver-1774711288966.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5784%252F20475784%252Finterior_boot-1774700971403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5784/20475784/interior_boot-1774700971403.jpg not downloaded yet
2026-03-29 20:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_front_driver-1774614947096.jpg> (referer: None)
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6113%252F20486113%252Finterior_dashboard-1774720809954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6113/20486113/interior_dashboard-1774720809954.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0646%252F19800646%252Finterior_dashboard-1774715679709.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0646/19800646/interior_dashboard-1774715679709.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3364%252F1393364%252Fexterior_rear_driver-1774711312653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_rear_driver-1774711312653.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5784%252F20475784%252Fdocs_service_history-1774701039171.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D744e9ea6173ab76fafb2d7c58df19ba6%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5784/20475784/docs_service_history-1774701039171.jpg?ixlib=js-3.8.0&auto=format&s=744e9ea6173ab76fafb2d7c58df19ba6 not downloaded yet
2026-03-29 20:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db0d890>
2026-03-29 20:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1651%252F20461651%252Fexterior_front_passenger-1774611750519.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_front_passenger-1774611750519.jpg saved to cache
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d1b1050-007c-5085-bba6-0509b1c10077
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6113%252F20486113%252Finterior_boot-1774720795767.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6113/20486113/interior_boot-1774720795767.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0646%252F19800646%252Finstrument_cluster-1774715661242.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0646/19800646/instrument_cluster-1774715661242.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3364%252F1393364%252Fexterior_front_passenger-1774711393752.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_front_passenger-1774711393752.jpg not downloaded yet
2026-03-29 20:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_front_driver-1774611713501.jpg> (referer: None)
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6113%252F20486113%252Fdamage_scratches-1774720222532.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6113/20486113/damage_scratches-1774720222532.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0646%252F19800646%252Finterior_boot-1774715702412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0646/19800646/interior_boot-1774715702412.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3364%252F1393364%252Fexterior_rear_passenger-1774711328151.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_rear_passenger-1774711328151.jpg not downloaded yet
2026-03-29 20:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_front_driver-1774695957678.jpg> (referer: None)
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6113%252F20486113%252Fwheels_front_driver-1774721988547.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6113/20486113/wheels_front_driver-1774721988547.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0646%252F19800646%252Fdamage_scratches-1774715225430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0646/19800646/damage_scratches-1774715225430.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3364%252F1393364%252Finterior_front_seats-1774712074991.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3364/1393364/interior_front_seats-1774712074991.jpg not downloaded yet
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f503150>
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1387%252F20471387%252Fexterior_front_driver-1774614947096.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_front_driver-1774614947096.jpg saved to cache
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f37da565-4324-5ee8-854b-cd4571417849
2026-03-29 20:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6941/20436941/damage_scratches-1774694877815.jpg> (referer: None)
2026-03-29 20:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_rear_passenger-1774611694289.jpg> (referer: None)
2026-03-29 20:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_rear_driver-1774611738219.jpg> (referer: None)
2026-03-29 20:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1387/20471387/interior_dashboard-1774616463110.jpg> (referer: None)
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3364%252F1393364%252Finterior_rear_seats-1774712147352.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3364/1393364/interior_rear_seats-1774712147352.jpg not downloaded yet
2026-03-29 20:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2752/20492752/interior_boot-1774717633937.jpg> (referer: None)
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3364%252F1393364%252Finterior_dashboard-1774712166877.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3364/1393364/interior_dashboard-1774712166877.jpg not downloaded yet
2026-03-29 20:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5362/16325362/docs_service_history-1774701273445.jpg?ixlib=js-3.8.0&auto=format&s=592f37b50ad9b7423ec0d46802b17fe4> (referer: None)
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc2f750>
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1651%252F20461651%252Fexterior_front_driver-1774611713501.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_front_driver-1774611713501.jpg saved to cache
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d1b1050-007c-5085-bba6-0509b1c10077
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f29f1d0>
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3654%252F20353654%252Fexterior_front_driver-1774695957678.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_front_driver-1774695957678.jpg saved to cache
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c80decf3-d69e-52fc-b22b-3b28f59c1e71
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3364%252F1393364%252Finstrument_cluster-1774712185142.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3364/1393364/instrument_cluster-1774712185142.jpg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3364%252F1393364%252Finterior_boot-1774712182452.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3364/1393364/interior_boot-1774712182452.jpg not downloaded yet
2026-03-29 20:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_front_driver-1774700687389.jpg> (referer: None)
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3364%252F1393364%252Fdocs_service_history-1774713760937.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D58d9e053fd594f7b04717615cf5c146d%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3364/1393364/docs_service_history-1774713760937.jpg?ixlib=js-3.8.0&auto=format&s=58d9e053fd594f7b04717615cf5c146d not downloaded yet
2026-03-29 20:12:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6ae4d0>
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6941%252F20436941%252Fdamage_scratches-1774694877815.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6941/20436941/damage_scratches-1774694877815.jpg saved to cache
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4cd750>
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1651%252F20461651%252Fexterior_rear_passenger-1774611694289.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_rear_passenger-1774611694289.jpg saved to cache
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d1b1050-007c-5085-bba6-0509b1c10077
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d23a810>
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1651%252F20461651%252Fexterior_rear_driver-1774611738219.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_rear_driver-1774611738219.jpg saved to cache
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d1b1050-007c-5085-bba6-0509b1c10077
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f3547cf50>
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1387%252F20471387%252Finterior_dashboard-1774616463110.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1387/20471387/interior_dashboard-1774616463110.jpg saved to cache
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f37da565-4324-5ee8-854b-cd4571417849
2026-03-29 20:12:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d238150>
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91a5d72b-4552-5f91-a56c-898eeea5dc6e/91a5d72b-4552-5f91-a56c-898eeea5dc6e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2752%252F20492752%252Finterior_boot-1774717633937.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2752/20492752/interior_boot-1774717633937.jpg saved to cache
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91a5d72b-4552-5f91-a56c-898eeea5dc6e
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4ecc50>
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5362%252F16325362%252Fdocs_service_history-1774701273445.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D592f37b50ad9b7423ec0d46802b17fe4') HTTP/1.1" 204 0
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5362/16325362/docs_service_history-1774701273445.jpg?ixlib=js-3.8.0&auto=format&s=592f37b50ad9b7423ec0d46802b17fe4 saved to cache
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d138d72b-be0c-5866-9dc0-3181506dbb10
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5b5510>
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5784%252F20475784%252Fexterior_front_driver-1774700687389.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_front_driver-1774700687389.jpg saved to cache
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7dfd24de-554f-56b0-a360-b09f017358bc
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6941/20436941/damage_scratches-1774694856392.jpg> (referer: None)
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6941/20436941/interior_boot-1774695518045.jpg> (referer: None)
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5362/16325362/interior_boot-1774700738692.jpg> (referer: None)
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5784/20475784/interior_front_seats-1774693925460.jpg> (referer: None)
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3654/20353654/interior_front_seats-1774696160715.jpg> (referer: None)
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5784/20475784/interior_boot-1774700971403.jpg> (referer: None)
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0646/19800646/interior_front_seats-1774715765165.jpg> (referer: None)
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d67c750>
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6941%252F20436941%252Fdamage_scratches-1774694856392.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6941/20436941/damage_scratches-1774694856392.jpg saved to cache
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3364/1393364/docs_service_history-1774713760937.jpg?ixlib=js-3.8.0&auto=format&s=58d9e053fd594f7b04717615cf5c146d> (referer: None)
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1c2890>
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6941%252F20436941%252Finterior_boot-1774695518045.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6941/20436941/interior_boot-1774695518045.jpg saved to cache
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4dab10>
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5362%252F16325362%252Finterior_boot-1774700738692.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5362/16325362/interior_boot-1774700738692.jpg saved to cache
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d138d72b-be0c-5866-9dc0-3181506dbb10
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da78d50>
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5784%252F20475784%252Finterior_front_seats-1774693925460.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5784/20475784/interior_front_seats-1774693925460.jpg saved to cache
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7dfd24de-554f-56b0-a360-b09f017358bc
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d44aad0>
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3654%252F20353654%252Finterior_front_seats-1774696160715.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3654/20353654/interior_front_seats-1774696160715.jpg saved to cache
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c80decf3-d69e-52fc-b22b-3b28f59c1e71
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1c2550>
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5784%252F20475784%252Finterior_boot-1774700971403.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5784/20475784/interior_boot-1774700971403.jpg saved to cache
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7dfd24de-554f-56b0-a360-b09f017358bc
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0bd350>
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0646%252F19800646%252Finterior_front_seats-1774715765165.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0646/19800646/interior_front_seats-1774715765165.jpg saved to cache
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9d712d2-7c29-5b31-800a-471a952be430
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da7af50>
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3364%252F1393364%252Fdocs_service_history-1774713760937.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D58d9e053fd594f7b04717615cf5c146d') HTTP/1.1" 204 0
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3364/1393364/docs_service_history-1774713760937.jpg?ixlib=js-3.8.0&auto=format&s=58d9e053fd594f7b04717615cf5c146d saved to cache
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e17e33d-d921-55cb-a486-40c1122772b4
2026-03-29 20:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6113/20486113/wheels_front_driver-1774721988547.jpg> (referer: None)
2026-03-29 20:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_rear_passenger-1774711328151.jpg> (referer: None)
2026-03-29 20:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3364/1393364/interior_front_seats-1774712074991.jpg> (referer: None)
2026-03-29 20:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3364/1393364/instrument_cluster-1774712185142.jpg> (referer: None)
2026-03-29 20:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3364/1393364/interior_rear_seats-1774712147352.jpg> (referer: None)
2026-03-29 20:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0646/19800646/damage_scratches-1774715225430.jpg> (referer: None)
2026-03-29 20:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0646/19800646/interior_boot-1774715702412.jpg> (referer: None)
2026-03-29 20:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3364/1393364/interior_boot-1774712182452.jpg> (referer: None)
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d95af90>
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6113%252F20486113%252Fwheels_front_driver-1774721988547.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6113/20486113/wheels_front_driver-1774721988547.jpg saved to cache
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f68e350>
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3364%252F1393364%252Fexterior_rear_passenger-1774711328151.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_rear_passenger-1774711328151.jpg saved to cache
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e17e33d-d921-55cb-a486-40c1122772b4
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9a9390>
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3364%252F1393364%252Finterior_front_seats-1774712074991.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3364/1393364/interior_front_seats-1774712074991.jpg saved to cache
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e17e33d-d921-55cb-a486-40c1122772b4
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d09c650>
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3364%252F1393364%252Finstrument_cluster-1774712185142.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3364/1393364/instrument_cluster-1774712185142.jpg saved to cache
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e17e33d-d921-55cb-a486-40c1122772b4
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc8d390>
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3364%252F1393364%252Finterior_rear_seats-1774712147352.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3364/1393364/interior_rear_seats-1774712147352.jpg saved to cache
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e17e33d-d921-55cb-a486-40c1122772b4
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f26ae10>
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0646%252F19800646%252Fdamage_scratches-1774715225430.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0646/19800646/damage_scratches-1774715225430.jpg saved to cache
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9d712d2-7c29-5b31-800a-471a952be430
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc8f650>
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0646%252F19800646%252Finterior_boot-1774715702412.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0646/19800646/interior_boot-1774715702412.jpg saved to cache
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9d712d2-7c29-5b31-800a-471a952be430
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1867d0>
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3364%252F1393364%252Finterior_boot-1774712182452.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3364/1393364/interior_boot-1774712182452.jpg saved to cache
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e17e33d-d921-55cb-a486-40c1122772b4
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3364/1393364/interior_dashboard-1774712166877.jpg> (referer: None)
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_front_driver-1774711288966.jpg> (referer: None)
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_rear_driver-1774711312653.jpg> (referer: None)
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_front_passenger-1774711393752.jpg> (referer: None)
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0646/19800646/interior_dashboard-1774715679709.jpg> (referer: None)
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6113/20486113/damage_scratches-1774720222532.jpg> (referer: None)
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0646/19800646/instrument_cluster-1774715661242.jpg> (referer: None)
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6113/20486113/interior_dashboard-1774720809954.jpg> (referer: None)
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6113/20486113/interior_boot-1774720795767.jpg> (referer: None)
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0646/19800646/interior_rear_seats-1774715803901.jpg> (referer: None)
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5784/20475784/docs_service_history-1774701039171.jpg?ixlib=js-3.8.0&auto=format&s=744e9ea6173ab76fafb2d7c58df19ba6> (referer: None)
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d231050>
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3364%252F1393364%252Finterior_dashboard-1774712166877.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3364/1393364/interior_dashboard-1774712166877.jpg saved to cache
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e17e33d-d921-55cb-a486-40c1122772b4
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2bd7d0>
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3364%252F1393364%252Fexterior_front_driver-1774711288966.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_front_driver-1774711288966.jpg saved to cache
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e17e33d-d921-55cb-a486-40c1122772b4
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2bc350>
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3364%252F1393364%252Fexterior_rear_driver-1774711312653.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_rear_driver-1774711312653.jpg saved to cache
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e17e33d-d921-55cb-a486-40c1122772b4
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4f8dd0>
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3364%252F1393364%252Fexterior_front_passenger-1774711393752.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_front_passenger-1774711393752.jpg saved to cache
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e17e33d-d921-55cb-a486-40c1122772b4
2026-03-29 20:12:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e17e33d-d921-55cb-a486-40c1122772b4, skipping ID generation
2026-03-29 20:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e17e33d-d921-55cb-a486-40c1122772b4 with scrape type 1
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e17e33d-d921-55cb-a486-40c1122772b4 sending to next pipeline
2026-03-29 20:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3e17e33d-d921-55cb-a486-40c1122772b4, identifier: 1393364
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da799d0>
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0646%252F19800646%252Finterior_dashboard-1774715679709.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0646/19800646/interior_dashboard-1774715679709.jpg saved to cache
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9d712d2-7c29-5b31-800a-471a952be430
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4dbc90>
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6113%252F20486113%252Fdamage_scratches-1774720222532.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6113/20486113/damage_scratches-1774720222532.jpg saved to cache
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daf3990>
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0646%252F19800646%252Finstrument_cluster-1774715661242.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0646/19800646/instrument_cluster-1774715661242.jpg saved to cache
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9d712d2-7c29-5b31-800a-471a952be430
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d664890>
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6113%252F20486113%252Finterior_dashboard-1774720809954.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6113/20486113/interior_dashboard-1774720809954.jpg saved to cache
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c830dd0>
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6113%252F20486113%252Finterior_boot-1774720795767.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6113/20486113/interior_boot-1774720795767.jpg saved to cache
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f269f10>
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0646%252F19800646%252Finterior_rear_seats-1774715803901.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0646/19800646/interior_rear_seats-1774715803901.jpg saved to cache
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9d712d2-7c29-5b31-800a-471a952be430
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f3547e1d0>
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5784%252F20475784%252Fdocs_service_history-1774701039171.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D744e9ea6173ab76fafb2d7c58df19ba6') HTTP/1.1" 204 0
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5784/20475784/docs_service_history-1774701039171.jpg?ixlib=js-3.8.0&auto=format&s=744e9ea6173ab76fafb2d7c58df19ba6 saved to cache
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7dfd24de-554f-56b0-a360-b09f017358bc
2026-03-29 20:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3e17e33d-d921-55cb-a486-40c1122772b4 with identifier: 1393364
2026-03-29 20:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3e17e33d-d921-55cb-a486-40c1122772b4 with identifier: 1393364
2026-03-29 20:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3e17e33d-d921-55cb-a486-40c1122772b4 with identifier: 1393364 to the API
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_front_passenger-1774711393752.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '3e17e33d-d921-55cb-a486-40c1122772b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YN68 XGY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/1393364',
'listing': 'auction',
'location': 'Hampshire Southampton',
'make': 'Mercedes',
'model': 'AMG',
'odometer': 41400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1334664,
'Height': 2382,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_front_driver-1774711288966.jpg',
'Width': 3176},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1251611,
'Height': 2447,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_rear_driver-1774711312653.jpg',
'Width': 3263},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1358523,
'Height': 2480,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_front_passenger-1774711393752.jpg',
'Width': 3306},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1347326,
'Height': 2584,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3364/1393364/exterior_rear_passenger-1774711328151.jpg',
'Width': 3445},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2533733,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3364/1393364/interior_front_seats-1774712074991.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2835463,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3364/1393364/interior_rear_seats-1774712147352.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3250073,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3364/1393364/interior_dashboard-1774712166877.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2779187,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3364/1393364/instrument_cluster-1774712185142.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3285777,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3364/1393364/interior_boot-1774712182452.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e17e33d-d921-55cb-a486-40c1122772b4/3e17e33d-d921-55cb-a486-40c1122772b4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57817,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3364/1393364/docs_service_history-1774713760937.jpg?ixlib=js-3.8.0&auto=format&s=58d9e053fd594f7b04717615cf5c146d',
'Width': 596}],
'price': 19794,
'price_includes_vat': False,
'registration_date': '2018-12-08',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes AMG CLA 45 Night ED + 4M A',
'transmission': 'automatic',
'trim': 'CLA 45 Night ED + 4M A',
'vin': 'WDD1173522N741322',
'year': 2018}
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%271393364%27 HTTP/1.1" 200 None
2026-03-29 20:12:18 [motorway.uk] INFO: Saving data for 1393364: {'created_time': 1774815138.294373, 'last_price_update_time': 1774815138.294384, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='1393364') HTTP/1.1" 204 0
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_rear_passenger-1774720080385.jpg> (referer: None)
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_rear_passenger-1774717487715.jpg> (referer: None)
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5784/20475784/interior_dashboard-1774694016481.jpg> (referer: None)
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5784/20475784/interior_rear_seats-1774693962323.jpg> (referer: None)
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5784/20475784/instrument_cluster-1774694022317.jpg> (referer: None)
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6113/20486113/interior_rear_seats-1774720825194.jpg> (referer: None)
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6113/20486113/interior_front_seats-1774720719658.jpg> (referer: None)
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3654/20353654/docs_service_history-1774696542959.jpg?ixlib=js-3.8.0&auto=format&s=d3c431a313de6afdf9277e4ad5049bb8> (referer: None)
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f355de7d0>
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6113%252F20486113%252Fexterior_rear_passenger-1774720080385.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_rear_passenger-1774720080385.jpg saved to cache
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d176150>
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0646%252F19800646%252Fexterior_rear_passenger-1774717487715.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_rear_passenger-1774717487715.jpg saved to cache
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9d712d2-7c29-5b31-800a-471a952be430
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc28690>
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5784%252F20475784%252Finterior_dashboard-1774694016481.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5784/20475784/interior_dashboard-1774694016481.jpg saved to cache
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7dfd24de-554f-56b0-a360-b09f017358bc
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cac9610>
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5784%252F20475784%252Finterior_rear_seats-1774693962323.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5784/20475784/interior_rear_seats-1774693962323.jpg saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7dfd24de-554f-56b0-a360-b09f017358bc
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6ac5d0>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5784%252F20475784%252Finstrument_cluster-1774694022317.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5784/20475784/instrument_cluster-1774694022317.jpg saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7dfd24de-554f-56b0-a360-b09f017358bc
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cac8910>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6113%252F20486113%252Finterior_rear_seats-1774720825194.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6113/20486113/interior_rear_seats-1774720825194.jpg saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d970e50>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6113%252F20486113%252Finterior_front_seats-1774720719658.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6113/20486113/interior_front_seats-1774720719658.jpg saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5774/18005774/docs_service_history-1774612296496.png?ixlib=js-3.8.0&auto=format&s=766148e2c1544b4bc378078aa7acc6df> (referer: None)
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d63c850>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3654%252F20353654%252Fdocs_service_history-1774696542959.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd3c431a313de6afdf9277e4ad5049bb8') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3654/20353654/docs_service_history-1774696542959.jpg?ixlib=js-3.8.0&auto=format&s=d3c431a313de6afdf9277e4ad5049bb8 saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c80decf3-d69e-52fc-b22b-3b28f59c1e71
2026-03-29 20:12:19 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:12:19 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 32768
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d56ef90>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_9.png HTTP/1.1" 201 0
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5774%252F18005774%252Fdocs_service_history-1774612296496.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D766148e2c1544b4bc378078aa7acc6df') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5774/18005774/docs_service_history-1774612296496.png?ixlib=js-3.8.0&auto=format&s=766148e2c1544b4bc378078aa7acc6df saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_rear_driver-1774720046005.jpg> (referer: None)
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_front_passenger-1774720113812.jpg> (referer: None)
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_rear_driver-1774715122727.jpg> (referer: None)
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_rear_passenger-1774700704381.jpg> (referer: None)
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_front_driver-1774716158444.jpg> (referer: None)
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_front_passenger-1774717509889.jpg> (referer: None)
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3654/20353654/instrument_cluster-1774696268899.jpg> (referer: None)
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3654/20353654/interior_boot-1774696232975.jpg> (referer: None)
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5774/18005774/interior_boot-1774611267717.jpg> (referer: None)
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de0c590>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6113%252F20486113%252Fexterior_rear_driver-1774720046005.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_rear_driver-1774720046005.jpg saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_front_driver-1774720112777.jpg> (referer: None)
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d24d710>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6113%252F20486113%252Fexterior_front_passenger-1774720113812.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_front_passenger-1774720113812.jpg saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f268a90>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0646%252F19800646%252Fexterior_rear_driver-1774715122727.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_rear_driver-1774715122727.jpg saved to cache
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9d712d2-7c29-5b31-800a-471a952be430
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f68cf90>
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5784%252F20475784%252Fexterior_rear_passenger-1774700704381.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_rear_passenger-1774700704381.jpg saved to cache
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7dfd24de-554f-56b0-a360-b09f017358bc
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d137a50>
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0646%252F19800646%252Fexterior_front_driver-1774716158444.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_front_driver-1774716158444.jpg saved to cache
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9d712d2-7c29-5b31-800a-471a952be430
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f65e550>
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0646%252F19800646%252Fexterior_front_passenger-1774717509889.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_front_passenger-1774717509889.jpg saved to cache
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9d712d2-7c29-5b31-800a-471a952be430
2026-03-29 20:12:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9d712d2-7c29-5b31-800a-471a952be430, skipping ID generation
2026-03-29 20:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9d712d2-7c29-5b31-800a-471a952be430 with scrape type 1
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9d712d2-7c29-5b31-800a-471a952be430 sending to next pipeline
2026-03-29 20:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a9d712d2-7c29-5b31-800a-471a952be430, identifier: 19800646
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0057d0>
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3654%252F20353654%252Finstrument_cluster-1774696268899.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3654/20353654/instrument_cluster-1774696268899.jpg saved to cache
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c80decf3-d69e-52fc-b22b-3b28f59c1e71
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f38b190>
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3654%252F20353654%252Finterior_boot-1774696232975.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3654/20353654/interior_boot-1774696232975.jpg saved to cache
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c80decf3-d69e-52fc-b22b-3b28f59c1e71
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc59150>
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5774%252F18005774%252Finterior_boot-1774611267717.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5774/18005774/interior_boot-1774611267717.jpg saved to cache
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c
2026-03-29 20:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a9d712d2-7c29-5b31-800a-471a952be430 with identifier: 19800646
2026-03-29 20:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a9d712d2-7c29-5b31-800a-471a952be430 with identifier: 19800646
2026-03-29 20:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a9d712d2-7c29-5b31-800a-471a952be430 with identifier: 19800646 to the API
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_front_passenger-1774717509889.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'a9d712d2-7c29-5b31-800a-471a952be430',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM18 AXU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19800646',
'listing': 'auction',
'location': 'Rhondda Cynon Taff Treorchy',
'make': 'Ford',
'model': 'Transit',
'odometer': 127000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1932093,
'Height': 2927,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_front_driver-1774716158444.jpg',
'Width': 3902},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1339441,
'Height': 2658,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_rear_driver-1774715122727.jpg',
'Width': 3544},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2012452,
'Height': 2798,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_front_passenger-1774717509889.jpg',
'Width': 3730},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1058852,
'Height': 2361,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0646/19800646/exterior_rear_passenger-1774717487715.jpg',
'Width': 3148},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4397223,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0646/19800646/interior_front_seats-1774715765165.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4586850,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0646/19800646/interior_rear_seats-1774715803901.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1845663,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0646/19800646/interior_dashboard-1774715679709.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2632423,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0646/19800646/instrument_cluster-1774715661242.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2892631,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0646/19800646/interior_boot-1774715702412.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9d712d2-7c29-5b31-800a-471a952be430/a9d712d2-7c29-5b31-800a-471a952be430_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2992849,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0646/19800646/damage_scratches-1774715225430.jpg',
'Width': 4032}],
'price': 3876,
'price_includes_vat': False,
'registration_date': '2018-06-25',
'seats_number': None,
'seller_name': None,
'title': 'Ford Transit Connect 220 Trend',
'transmission': 'manual',
'trim': 'Connect 220 Trend',
'vin': 'WF04XXWPG4JT81441',
'year': 2018}
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719800646%27 HTTP/1.1" 200 None
2026-03-29 20:12:21 [motorway.uk] INFO: Saving data for 19800646: {'created_time': 1774815141.343243, 'last_price_update_time': 1774815141.343256, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19800646') HTTP/1.1" 204 0
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a9ad0>
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6113%252F20486113%252Fexterior_front_driver-1774720112777.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_front_driver-1774720112777.jpg saved to cache
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790
2026-03-29 20:12:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5defd042-1631-5e0b-b1d9-bbbbdbc32790, skipping ID generation
2026-03-29 20:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790 with scrape type 1
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5defd042-1631-5e0b-b1d9-bbbbdbc32790 sending to next pipeline
2026-03-29 20:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5defd042-1631-5e0b-b1d9-bbbbdbc32790, identifier: 20486113
2026-03-29 20:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5defd042-1631-5e0b-b1d9-bbbbdbc32790 with identifier: 20486113
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Pink HTTP/1.1" 200 None
2026-03-29 20:12:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5defd042-1631-5e0b-b1d9-bbbbdbc32790 with identifier: 20486113
2026-03-29 20:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5defd042-1631-5e0b-b1d9-bbbbdbc32790 with identifier: 20486113 to the API
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_front_driver-1774720112777.jpg>
{'auction_title': '',
'category': None,
'color': 'Pink',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '5defd042-1631-5e0b-b1d9-bbbbdbc32790',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AF63 EEY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20486113',
'listing': 'auction',
'location': 'Nottinghamshire Mansfield',
'make': 'Suzuki',
'model': 'Alto',
'odometer': 55227,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1165231,
'Height': 2495,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_front_driver-1774720112777.jpg',
'Width': 3326},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 790447,
'Height': 2426,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_rear_driver-1774720046005.jpg',
'Width': 3235},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866171,
'Height': 2018,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_front_passenger-1774720113812.jpg',
'Width': 2691},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 927052,
'Height': 2159,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6113/20486113/exterior_rear_passenger-1774720080385.jpg',
'Width': 2879},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3138644,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6113/20486113/interior_front_seats-1774720719658.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2968351,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6113/20486113/interior_rear_seats-1774720825194.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3145129,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6113/20486113/interior_dashboard-1774720809954.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3164301,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6113/20486113/interior_boot-1774720795767.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2577297,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6113/20486113/damage_scratches-1774720222532.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5defd042-1631-5e0b-b1d9-bbbbdbc32790/5defd042-1631-5e0b-b1d9-bbbbdbc32790_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 511861,
'Height': 2395,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6113/20486113/wheels_front_driver-1774721988547.jpg',
'Width': 3193}],
'price': 1508,
'price_includes_vat': False,
'registration_date': '2013-09-27',
'seats_number': None,
'seller_name': None,
'title': 'Suzuki Alto SZ',
'transmission': 'manual',
'trim': 'SZ',
'vin': 'MA3GFC31S00591805',
'year': 2013}
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486113%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [motorway.uk] INFO: Saving data for 20486113: {'created_time': 1774815142.097537, 'last_price_update_time': 1774815142.09755, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20486113') HTTP/1.1" 204 0
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5774/18005774/instrument_cluster-1774611145511.jpg> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1387/20471387/docs_service_history-1774617075335.jpg?ixlib=js-3.8.0&auto=format&s=9900143c3111c0e615d44314a769c8f2> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_rear_driver-1774700695960.jpg> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3654/20353654/interior_dashboard-1774696270694.jpg> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_rear_passenger-1774695987163.jpg> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_front_passenger-1774700721616.jpg> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1387/20471387/instrument_cluster-1774616303259.jpg> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3654/20353654/interior_rear_seats-1774696181916.jpg> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1387/20471387/interior_boot-1774616448031.jpg> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5774/18005774/interior_dashboard-1774611080047.jpg> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5774/18005774/interior_front_seats-1774611037534.jpg> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5774/18005774/interior_rear_seats-1774611051861.jpg> (referer: None)
2026-03-29 20:12:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d594210>
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5774%252F18005774%252Finstrument_cluster-1774611145511.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5774/18005774/instrument_cluster-1774611145511.jpg saved to cache
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_rear_passenger-1774610625907.jpg> (referer: None)
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc299d0>
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1387%252F20471387%252Fdocs_service_history-1774617075335.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9900143c3111c0e615d44314a769c8f2') HTTP/1.1" 204 0
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1387/20471387/docs_service_history-1774617075335.jpg?ixlib=js-3.8.0&auto=format&s=9900143c3111c0e615d44314a769c8f2 saved to cache
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f37da565-4324-5ee8-854b-cd4571417849
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da9afd0>
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5784%252F20475784%252Fexterior_rear_driver-1774700695960.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_rear_driver-1774700695960.jpg saved to cache
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7dfd24de-554f-56b0-a360-b09f017358bc
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6e4210>
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3654%252F20353654%252Finterior_dashboard-1774696270694.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3654/20353654/interior_dashboard-1774696270694.jpg saved to cache
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c80decf3-d69e-52fc-b22b-3b28f59c1e71
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f63dd90>
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3654%252F20353654%252Fexterior_rear_passenger-1774695987163.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_rear_passenger-1774695987163.jpg saved to cache
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c80decf3-d69e-52fc-b22b-3b28f59c1e71
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2deb1dd0>
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5784%252F20475784%252Fexterior_front_passenger-1774700721616.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_front_passenger-1774700721616.jpg saved to cache
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7dfd24de-554f-56b0-a360-b09f017358bc
2026-03-29 20:12:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7dfd24de-554f-56b0-a360-b09f017358bc, skipping ID generation
2026-03-29 20:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dfd24de-554f-56b0-a360-b09f017358bc with scrape type 1
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7dfd24de-554f-56b0-a360-b09f017358bc sending to next pipeline
2026-03-29 20:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7dfd24de-554f-56b0-a360-b09f017358bc, identifier: 20475784
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d181150>
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1387%252F20471387%252Finstrument_cluster-1774616303259.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1387/20471387/instrument_cluster-1774616303259.jpg saved to cache
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f37da565-4324-5ee8-854b-cd4571417849
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6e4b10>
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3654%252F20353654%252Finterior_rear_seats-1774696181916.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3654/20353654/interior_rear_seats-1774696181916.jpg saved to cache
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c80decf3-d69e-52fc-b22b-3b28f59c1e71
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5951d0>
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1387%252F20471387%252Finterior_boot-1774616448031.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1387/20471387/interior_boot-1774616448031.jpg saved to cache
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f37da565-4324-5ee8-854b-cd4571417849
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4dbd10>
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5774%252F18005774%252Finterior_dashboard-1774611080047.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5774/18005774/interior_dashboard-1774611080047.jpg saved to cache
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc11710>
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5774%252F18005774%252Finterior_front_seats-1774611037534.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5774/18005774/interior_front_seats-1774611037534.jpg saved to cache
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6e78d0>
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5774%252F18005774%252Finterior_rear_seats-1774611051861.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5774/18005774/interior_rear_seats-1774611051861.jpg saved to cache
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c
2026-03-29 20:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7dfd24de-554f-56b0-a360-b09f017358bc with identifier: 20475784
2026-03-29 20:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7dfd24de-554f-56b0-a360-b09f017358bc with identifier: 20475784
2026-03-29 20:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7dfd24de-554f-56b0-a360-b09f017358bc with identifier: 20475784 to the API
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_front_passenger-1774700721616.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7dfd24de-554f-56b0-a360-b09f017358bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'S21 XSK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20475784',
'listing': 'auction',
'location': 'West Midlands Solihull',
'make': 'MINI',
'model': 'Cooper',
'odometer': 57000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1607309,
'Height': 2804,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_front_driver-1774700687389.jpg',
'Width': 3739},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1484844,
'Height': 2489,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_rear_driver-1774700695960.jpg',
'Width': 3318},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2189930,
'Height': 2982,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_front_passenger-1774700721616.jpg',
'Width': 3976},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1535863,
'Height': 2636,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5784/20475784/exterior_rear_passenger-1774700704381.jpg',
'Width': 3515},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3067849,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5784/20475784/interior_front_seats-1774693925460.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2607806,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5784/20475784/interior_rear_seats-1774693962323.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1497851,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5784/20475784/interior_dashboard-1774694016481.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2694614,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5784/20475784/instrument_cluster-1774694022317.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3547188,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5784/20475784/interior_boot-1774700971403.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfd24de-554f-56b0-a360-b09f017358bc/7dfd24de-554f-56b0-a360-b09f017358bc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 9562922,
'Height': 4284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5784/20475784/docs_service_history-1774701039171.jpg?ixlib=js-3.8.0&auto=format&s=744e9ea6173ab76fafb2d7c58df19ba6',
'Width': 5712}],
'price': 6113,
'price_includes_vat': False,
'registration_date': '2016-09-26',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'vin': 'WMWXM520X02E56511',
'year': 2016}
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475784%27 HTTP/1.1" 200 None
2026-03-29 20:12:24 [motorway.uk] INFO: Saving data for 20475784: {'created_time': 1774815144.108752, 'last_price_update_time': 1774815144.108765, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20475784') HTTP/1.1" 204 0
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7292d0>
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5774%252F18005774%252Fexterior_rear_passenger-1774610625907.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_rear_passenger-1774610625907.jpg saved to cache
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c
2026-03-29 20:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_front_passenger-1774695996373.jpg> (referer: None)
2026-03-29 20:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_front_passenger-1774610653108.jpg> (referer: None)
2026-03-29 20:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_rear_driver-1774695972754.jpg> (referer: None)
2026-03-29 20:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_rear_driver-1774610676224.jpg> (referer: None)
2026-03-29 20:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1387/20471387/interior_rear_seats-1774616208363.jpg> (referer: None)
2026-03-29 20:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1651/20461651/damage_scratches-1774611746573.jpg> (referer: None)
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f46dbd0>
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3654%252F20353654%252Fexterior_front_passenger-1774695996373.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_front_passenger-1774695996373.jpg saved to cache
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c80decf3-d69e-52fc-b22b-3b28f59c1e71
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc95250>
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5774%252F18005774%252Fexterior_front_passenger-1774610653108.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_front_passenger-1774610653108.jpg saved to cache
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f48a250>
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3654%252F20353654%252Fexterior_rear_driver-1774695972754.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_rear_driver-1774695972754.jpg saved to cache
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c80decf3-d69e-52fc-b22b-3b28f59c1e71
2026-03-29 20:12:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c80decf3-d69e-52fc-b22b-3b28f59c1e71, skipping ID generation
2026-03-29 20:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80decf3-d69e-52fc-b22b-3b28f59c1e71 with scrape type 1
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c80decf3-d69e-52fc-b22b-3b28f59c1e71 sending to next pipeline
2026-03-29 20:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c80decf3-d69e-52fc-b22b-3b28f59c1e71, identifier: 20353654
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f359a1cd0>
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5774%252F18005774%252Fexterior_rear_driver-1774610676224.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_rear_driver-1774610676224.jpg saved to cache
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e00c7d0>
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1387%252F20471387%252Finterior_rear_seats-1774616208363.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1387/20471387/interior_rear_seats-1774616208363.jpg saved to cache
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f37da565-4324-5ee8-854b-cd4571417849
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0be150>
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1651%252F20461651%252Fdamage_scratches-1774611746573.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1651/20461651/damage_scratches-1774611746573.jpg saved to cache
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d1b1050-007c-5085-bba6-0509b1c10077
2026-03-29 20:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c80decf3-d69e-52fc-b22b-3b28f59c1e71 with identifier: 20353654
2026-03-29 20:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c80decf3-d69e-52fc-b22b-3b28f59c1e71 with identifier: 20353654
2026-03-29 20:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c80decf3-d69e-52fc-b22b-3b28f59c1e71 with identifier: 20353654 to the API
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_rear_driver-1774695972754.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c80decf3-d69e-52fc-b22b-3b28f59c1e71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN16 JCZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20353654',
'listing': 'auction',
'location': 'Greater London Hornchurch',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 72000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1668269,
'Height': 2971,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_front_driver-1774695957678.jpg',
'Width': 3961},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1601107,
'Height': 3020,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_rear_driver-1774695972754.jpg',
'Width': 4026},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1401978,
'Height': 2780,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_front_passenger-1774695996373.jpg',
'Width': 3707},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1502321,
'Height': 2980,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3654/20353654/exterior_rear_passenger-1774695987163.jpg',
'Width': 3973},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3986266,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3654/20353654/interior_front_seats-1774696160715.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3088321,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3654/20353654/interior_rear_seats-1774696181916.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1720307,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3654/20353654/interior_dashboard-1774696270694.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2631712,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3654/20353654/instrument_cluster-1774696268899.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3940602,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3654/20353654/interior_boot-1774696232975.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80decf3-d69e-52fc-b22b-3b28f59c1e71/c80decf3-d69e-52fc-b22b-3b28f59c1e71_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1302687,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3654/20353654/docs_service_history-1774696542959.jpg?ixlib=js-3.8.0&auto=format&s=d3c431a313de6afdf9277e4ad5049bb8',
'Width': 4032}],
'price': 4118,
'price_includes_vat': False,
'registration_date': '2016-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai Acenta Premium DiG-T',
'transmission': 'manual',
'trim': 'Acenta Premium DiG-T',
'vin': 'SJNFEAJ11U1645735',
'year': 2016}
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720353654%27 HTTP/1.1" 200 None
2026-03-29 20:12:25 [motorway.uk] INFO: Saving data for 20353654: {'created_time': 1774815145.622, 'last_price_update_time': 1774815145.622013, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20353654') HTTP/1.1" 204 0
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1651/20461651/docs_service_history-1774624542712.png?ixlib=js-3.8.0&auto=format&s=509705f78a8cd43db5d6990b26289fe6> (referer: None)
2026-03-29 20:12:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_front_passenger-1774615012329.jpg> (referer: None)
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_rear_driver-1774614960881.jpg> (referer: None)
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_rear_passenger-1774614980486.jpg> (referer: None)
2026-03-29 20:12:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_front_driver-1774610692918.jpg> (referer: None)
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6941/20436941/interior_dashboard-1774702455688.jpg> (referer: None)
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1651/20461651/interior_rear_seats-1774613273983.jpg> (referer: None)
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1651/20461651/interior_dashboard-1774612212329.jpg> (referer: None)
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1651/20461651/interior_boot-1774613267368.jpg> (referer: None)
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1651/20461651/interior_front_seats-1774613279281.jpg> (referer: None)
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1387/20471387/interior_front_seats-1774616188258.jpg> (referer: None)
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5362/16325362/interior_dashboard-1774700807611.jpg> (referer: None)
2026-03-29 20:12:25 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:12:25 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 294
2026-03-29 20:12:25 [PIL.PngImagePlugin] DEBUG: STREAM b'sBIT' 347 3
2026-03-29 20:12:25 [PIL.PngImagePlugin] DEBUG: b'sBIT' 347 3 (unknown)
2026-03-29 20:12:25 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 362 1
2026-03-29 20:12:25 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 375 8192
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d013090>
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_8.png HTTP/1.1" 201 0
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1651%252F20461651%252Fdocs_service_history-1774624542712.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D509705f78a8cd43db5d6990b26289fe6') HTTP/1.1" 204 0
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1651/20461651/docs_service_history-1774624542712.png?ixlib=js-3.8.0&auto=format&s=509705f78a8cd43db5d6990b26289fe6 saved to cache
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d1b1050-007c-5085-bba6-0509b1c10077
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6d6450>
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1387%252F20471387%252Fexterior_front_passenger-1774615012329.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_front_passenger-1774615012329.jpg saved to cache
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f37da565-4324-5ee8-854b-cd4571417849
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c717f50>
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1387%252F20471387%252Fexterior_rear_driver-1774614960881.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_rear_driver-1774614960881.jpg saved to cache
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f37da565-4324-5ee8-854b-cd4571417849
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de0d1d0>
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1387%252F20471387%252Fexterior_rear_passenger-1774614980486.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_rear_passenger-1774614980486.jpg saved to cache
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f37da565-4324-5ee8-854b-cd4571417849
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce95b50>
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5774%252F18005774%252Fexterior_front_driver-1774610692918.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_front_driver-1774610692918.jpg saved to cache
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c
2026-03-29 20:12:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c, skipping ID generation
2026-03-29 20:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c with scrape type 1
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c sending to next pipeline
2026-03-29 20:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c, identifier: 18005774
2026-03-29 20:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c with identifier: 18005774
2026-03-29 20:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c with identifier: 18005774
2026-03-29 20:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4ac1d7d6-5855-5f80-9e0a-9948bce3e20c with identifier: 18005774 to the API
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_front_driver-1774610692918.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '4ac1d7d6-5855-5f80-9e0a-9948bce3e20c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'M14 BJJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18005774',
'listing': 'auction',
'location': 'East Riding of Yorkshire Bridlington',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 61422,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1399785,
'Height': 2365,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_front_driver-1774610692918.jpg',
'Width': 3153},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1587594,
'Height': 2447,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_rear_driver-1774610676224.jpg',
'Width': 3263},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1455057,
'Height': 2353,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_front_passenger-1774610653108.jpg',
'Width': 3137},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1594220,
'Height': 2585,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5774/18005774/exterior_rear_passenger-1774610625907.jpg',
'Width': 3447},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3770231,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5774/18005774/interior_front_seats-1774611037534.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4155925,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5774/18005774/interior_rear_seats-1774611051861.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3560737,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5774/18005774/interior_dashboard-1774611080047.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2418874,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5774/18005774/instrument_cluster-1774611145511.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3940497,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5774/18005774/interior_boot-1774611267717.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ac1d7d6-5855-5f80-9e0a-9948bce3e20c/4ac1d7d6-5855-5f80-9e0a-9948bce3e20c_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 82464,
'Height': 355,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5774/18005774/docs_service_history-1774612296496.png?ixlib=js-3.8.0&auto=format&s=766148e2c1544b4bc378078aa7acc6df',
'Width': 720}],
'price': 10515,
'price_includes_vat': False,
'registration_date': '2018-07-02',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery Sport Black HSE SD4A',
'transmission': 'automatic',
'trim': 'Sport Black HSE SD4A',
'vin': 'SALCA2AN9JH735605',
'year': 2018}
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718005774%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [motorway.uk] INFO: Saving data for 18005774: {'created_time': 1774815146.650103, 'last_price_update_time': 1774815146.650113, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18005774') HTTP/1.1" 204 0
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c755a50>
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6941%252F20436941%252Finterior_dashboard-1774702455688.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6941/20436941/interior_dashboard-1774702455688.jpg saved to cache
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca54dd0>
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1651%252F20461651%252Finterior_rear_seats-1774613273983.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1651/20461651/interior_rear_seats-1774613273983.jpg saved to cache
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d1b1050-007c-5085-bba6-0509b1c10077
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d24d190>
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1651%252F20461651%252Finterior_dashboard-1774612212329.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1651/20461651/interior_dashboard-1774612212329.jpg saved to cache
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d1b1050-007c-5085-bba6-0509b1c10077
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c735290>
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1651%252F20461651%252Finterior_boot-1774613267368.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1651/20461651/interior_boot-1774613267368.jpg saved to cache
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d1b1050-007c-5085-bba6-0509b1c10077
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d24c710>
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1651%252F20461651%252Finterior_front_seats-1774613279281.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1651/20461651/interior_front_seats-1774613279281.jpg saved to cache
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d1b1050-007c-5085-bba6-0509b1c10077
2026-03-29 20:12:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d1b1050-007c-5085-bba6-0509b1c10077, skipping ID generation
2026-03-29 20:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d1b1050-007c-5085-bba6-0509b1c10077 with scrape type 1
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d1b1050-007c-5085-bba6-0509b1c10077 sending to next pipeline
2026-03-29 20:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4d1b1050-007c-5085-bba6-0509b1c10077, identifier: 20461651
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4e8d50>
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1387%252F20471387%252Finterior_front_seats-1774616188258.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1387/20471387/interior_front_seats-1774616188258.jpg saved to cache
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f37da565-4324-5ee8-854b-cd4571417849
2026-03-29 20:12:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f37da565-4324-5ee8-854b-cd4571417849, skipping ID generation
2026-03-29 20:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f37da565-4324-5ee8-854b-cd4571417849 with scrape type 1
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f37da565-4324-5ee8-854b-cd4571417849 sending to next pipeline
2026-03-29 20:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f37da565-4324-5ee8-854b-cd4571417849, identifier: 20471387
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d56ca90>
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5362%252F16325362%252Finterior_dashboard-1774700807611.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5362/16325362/interior_dashboard-1774700807611.jpg saved to cache
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d138d72b-be0c-5866-9dc0-3181506dbb10
2026-03-29 20:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4d1b1050-007c-5085-bba6-0509b1c10077 with identifier: 20461651
2026-03-29 20:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4d1b1050-007c-5085-bba6-0509b1c10077 with identifier: 20461651
2026-03-29 20:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4d1b1050-007c-5085-bba6-0509b1c10077 with identifier: 20461651 to the API
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/1651/20461651/interior_front_seats-1774613279281.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '4d1b1050-007c-5085-bba6-0509b1c10077',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BP23 ULS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20461651',
'listing': 'auction',
'location': 'Nottinghamshire Nottingham',
'make': 'Audi',
'model': 'A4',
'odometer': 20600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2143389,
'Height': 2766,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_front_driver-1774611713501.jpg',
'Width': 3688},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1992134,
'Height': 2704,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_rear_driver-1774611738219.jpg',
'Width': 3605},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1350497,
'Height': 2379,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_front_passenger-1774611750519.jpg',
'Width': 3172},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1870668,
'Height': 2803,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1651/20461651/exterior_rear_passenger-1774611694289.jpg',
'Width': 3737},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2188109,
'Height': 2833,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1651/20461651/interior_front_seats-1774613279281.jpg',
'Width': 3778},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1873466,
'Height': 2722,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1651/20461651/interior_rear_seats-1774613273983.jpg',
'Width': 3629},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2126885,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1651/20461651/interior_dashboard-1774612212329.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2201859,
'Height': 2461,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1651/20461651/interior_boot-1774613267368.jpg',
'Width': 3281},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 95386,
'Height': 2142,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1651/20461651/docs_service_history-1774624542712.png?ixlib=js-3.8.0&auto=format&s=509705f78a8cd43db5d6990b26289fe6',
'Width': 960},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d1b1050-007c-5085-bba6-0509b1c10077/4d1b1050-007c-5085-bba6-0509b1c10077_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2947862,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/1651/20461651/damage_scratches-1774611746573.jpg',
'Width': 3840}],
'price': 21253,
'price_includes_vat': False,
'registration_date': '2023-06-23',
'seats_number': None,
'seller_name': None,
'title': 'Audi A4 S LN BLK ED 35 TFSI MHEV SA',
'transmission': 'automatic',
'trim': 'S LN BLK ED 35 TFSI MHEV SA',
'vin': 'WAUZZZF49PN019765',
'year': 2023}
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720461651%27 HTTP/1.1" 200 None
2026-03-29 20:12:28 [motorway.uk] INFO: Saving data for 20461651: {'created_time': 1774815148.366895, 'last_price_update_time': 1774815148.366905, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20461651') HTTP/1.1" 204 0
2026-03-29 20:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f37da565-4324-5ee8-854b-cd4571417849 with identifier: 20471387
2026-03-29 20:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f37da565-4324-5ee8-854b-cd4571417849 with identifier: 20471387
2026-03-29 20:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f37da565-4324-5ee8-854b-cd4571417849 with identifier: 20471387 to the API
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/1387/20471387/interior_front_seats-1774616188258.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f37da565-4324-5ee8-854b-cd4571417849',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YD66 GFK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20471387',
'listing': 'auction',
'location': 'Wiltshire Warminster',
'make': 'Ford',
'model': 'Focus',
'odometer': 54000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1516436,
'Height': 2536,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_front_driver-1774614947096.jpg',
'Width': 3381},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1375901,
'Height': 2396,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_rear_driver-1774614960881.jpg',
'Width': 3194},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1106744,
'Height': 2172,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_front_passenger-1774615012329.jpg',
'Width': 2896},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1361854,
'Height': 2360,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1387/20471387/exterior_rear_passenger-1774614980486.jpg',
'Width': 3146},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2775451,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1387/20471387/interior_front_seats-1774616188258.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2738192,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1387/20471387/interior_rear_seats-1774616208363.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1413422,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1387/20471387/interior_dashboard-1774616463110.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2150227,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1387/20471387/instrument_cluster-1774616303259.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3236821,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1387/20471387/interior_boot-1774616448031.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f37da565-4324-5ee8-854b-cd4571417849/f37da565-4324-5ee8-854b-cd4571417849_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 854802,
'Height': 3440,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1387/20471387/docs_service_history-1774617075335.jpg?ixlib=js-3.8.0&auto=format&s=9900143c3111c0e615d44314a769c8f2',
'Width': 2691}],
'price': 4923,
'price_includes_vat': False,
'registration_date': '2016-10-31',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus Titanium X',
'transmission': 'manual',
'trim': 'Titanium X',
'vin': 'WF05XXGCC5GY18626',
'year': 2016}
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471387%27 HTTP/1.1" 200 None
2026-03-29 20:12:29 [motorway.uk] INFO: Saving data for 20471387: {'created_time': 1774815149.132045, 'last_price_update_time': 1774815149.132057, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20471387') HTTP/1.1" 204 0
2026-03-29 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1404&page=39&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_front_passenger-1774694816407.jpg> (referer: None)
2026-03-29 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_front_passenger-1774700084306.jpg> (referer: None)
2026-03-29 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5362/16325362/interior_rear_seats-1774700694383.jpg> (referer: None)
2026-03-29 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5362/16325362/interior_front_seats-1774700756924.jpg> (referer: None)
2026-03-29 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6941/20436941/interior_rear_seats-1774695458129.jpg> (referer: None)
2026-03-29 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6941/20436941/interior_front_seats-1774695439248.jpg> (referer: None)
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20113566
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 16171790
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716171790%27 HTTP/1.1" 200 None
2026-03-29 20:12:29 [motorway.uk] INFO: Scrape type for 16171790: 1
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20376331
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20386083
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 15325780
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715325780%27 HTTP/1.1" 200 None
2026-03-29 20:12:29 [motorway.uk] INFO: Scrape type for 15325780: 1
2026-03-29 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8218/10398218/interior_boot-1774634198703.jpg> (referer: None)
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20473412
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20404965
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20498910
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20439436
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20476073
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20496195
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20337643
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720337643%27 HTTP/1.1" 200 None
2026-03-29 20:12:29 [motorway.uk] INFO: Scrape type for 20337643: 1
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d3f1a10>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6941%252F20436941%252Fexterior_front_passenger-1774694816407.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_front_passenger-1774694816407.jpg saved to cache
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9c7290>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5362%252F16325362%252Fexterior_front_passenger-1774700084306.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_front_passenger-1774700084306.jpg saved to cache
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d138d72b-be0c-5866-9dc0-3181506dbb10
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20098206
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20475098
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 16172967
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 16857916
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20462733
2026-03-29 20:12:29 [motorway.uk] INFO: Found listing with ID: 20490112
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490112%27 HTTP/1.1" 200 None
2026-03-29 20:12:29 [motorway.uk] INFO: Scrape type for 20490112: 1
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1f49d0>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5362%252F16325362%252Finterior_rear_seats-1774700694383.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5362/16325362/interior_rear_seats-1774700694383.jpg saved to cache
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d138d72b-be0c-5866-9dc0-3181506dbb10
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e088090>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5362%252F16325362%252Finterior_front_seats-1774700756924.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5362/16325362/interior_front_seats-1774700756924.jpg saved to cache
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d138d72b-be0c-5866-9dc0-3181506dbb10
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1f49d0>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6941%252F20436941%252Finterior_rear_seats-1774695458129.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6941/20436941/interior_rear_seats-1774695458129.jpg saved to cache
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f389610>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6941%252F20436941%252Finterior_front_seats-1774695439248.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6941/20436941/interior_front_seats-1774695439248.jpg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 20402109
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 20374667
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 19899009
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719899009%27 HTTP/1.1" 200 None
2026-03-29 20:12:30 [motorway.uk] INFO: Scrape type for 19899009: 1
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4fb9d0>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0947bb9f-266e-5ff1-b2a9-8900fcaf00c2/0947bb9f-266e-5ff1-b2a9-8900fcaf00c2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8218%252F10398218%252Finterior_boot-1774634198703.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8218/10398218/interior_boot-1774634198703.jpg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0947bb9f-266e-5ff1-b2a9-8900fcaf00c2
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8218/10398218/interior_rear_seats-1774634130254.jpg> (referer: None)
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 20432177
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 11842898
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711842898%27 HTTP/1.1" 200 None
2026-03-29 20:12:30 [motorway.uk] INFO: Scrape type for 11842898: 1
2026-03-29 20:12:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 20046055
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 20386977
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 20277874
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720277874%27 HTTP/1.1" 200 None
2026-03-29 20:12:30 [motorway.uk] INFO: Scrape type for 20277874: 1
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 14979819
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 20474482
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 20415120
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 20214345
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 19182202
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 20334323
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 20417464
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 18237118
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 20502332
2026-03-29 20:12:30 [motorway.uk] INFO: Found listing with ID: 16476900
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8218/10398218/interior_front_seats-1774634068185.jpg> (referer: None)
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_front_driver-1774699975834.jpg> (referer: None)
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_front_driver-1774694772113.jpg> (referer: None)
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8218/10398218/10398218-interior_dashboard-modified-1774680255610.jpeg> (referer: None)
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_rear_driver-1774694796149.jpg> (referer: None)
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8218/10398218/docs_service_history-1774634467776.jpg?ixlib=js-3.8.0&auto=format&s=762c278a54e4f5aae00d37fafc744b9c> (referer: None)
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d71b090>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0947bb9f-266e-5ff1-b2a9-8900fcaf00c2/0947bb9f-266e-5ff1-b2a9-8900fcaf00c2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8218%252F10398218%252Finterior_rear_seats-1774634130254.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8218/10398218/interior_rear_seats-1774634130254.jpg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0947bb9f-266e-5ff1-b2a9-8900fcaf00c2
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d231890>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0947bb9f-266e-5ff1-b2a9-8900fcaf00c2/0947bb9f-266e-5ff1-b2a9-8900fcaf00c2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8218%252F10398218%252Finterior_front_seats-1774634068185.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8218/10398218/interior_front_seats-1774634068185.jpg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0947bb9f-266e-5ff1-b2a9-8900fcaf00c2
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de0dc90>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5362%252F16325362%252Fexterior_front_driver-1774699975834.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_front_driver-1774699975834.jpg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d138d72b-be0c-5866-9dc0-3181506dbb10
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f290090>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6941%252F20436941%252Fexterior_front_driver-1774694772113.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_front_driver-1774694772113.jpg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9a90d0>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0947bb9f-266e-5ff1-b2a9-8900fcaf00c2/0947bb9f-266e-5ff1-b2a9-8900fcaf00c2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8218%252F10398218%252F10398218-interior_dashboard-modified-1774680255610.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8218/10398218/10398218-interior_dashboard-modified-1774680255610.jpeg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0947bb9f-266e-5ff1-b2a9-8900fcaf00c2
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f290510>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6941%252F20436941%252Fexterior_rear_driver-1774694796149.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_rear_driver-1774694796149.jpg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c
2026-03-29 20:12:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f5a2878-ce22-5ad5-8c39-822bc163db6c, skipping ID generation
2026-03-29 20:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c with scrape type 1
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f5a2878-ce22-5ad5-8c39-822bc163db6c sending to next pipeline
2026-03-29 20:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3f5a2878-ce22-5ad5-8c39-822bc163db6c, identifier: 20436941
2026-03-29 20:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce8c750>
2026-03-29 20:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0947bb9f-266e-5ff1-b2a9-8900fcaf00c2/0947bb9f-266e-5ff1-b2a9-8900fcaf00c2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8218%252F10398218%252Fdocs_service_history-1774634467776.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D762c278a54e4f5aae00d37fafc744b9c') HTTP/1.1" 204 0
2026-03-29 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8218/10398218/docs_service_history-1774634467776.jpg?ixlib=js-3.8.0&auto=format&s=762c278a54e4f5aae00d37fafc744b9c saved to cache
2026-03-29 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0947bb9f-266e-5ff1-b2a9-8900fcaf00c2
2026-03-29 20:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3f5a2878-ce22-5ad5-8c39-822bc163db6c with identifier: 20436941
2026-03-29 20:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3f5a2878-ce22-5ad5-8c39-822bc163db6c with identifier: 20436941
2026-03-29 20:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3f5a2878-ce22-5ad5-8c39-822bc163db6c with identifier: 20436941 to the API
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_rear_driver-1774694796149.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '3f5a2878-ce22-5ad5-8c39-822bc163db6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GD18 NFX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20436941',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 70000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1817870,
'Height': 2608,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_front_driver-1774694772113.jpg',
'Width': 3477},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1700984,
'Height': 2510,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_rear_driver-1774694796149.jpg',
'Width': 3346},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1252452,
'Height': 2173,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_front_passenger-1774694816407.jpg',
'Width': 2897},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1562910,
'Height': 2429,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6941/20436941/exterior_rear_passenger-1774694805337.jpg',
'Width': 3239},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3837360,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6941/20436941/interior_front_seats-1774695439248.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3757723,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6941/20436941/interior_rear_seats-1774695458129.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2347187,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6941/20436941/interior_dashboard-1774702455688.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3954322,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6941/20436941/interior_boot-1774695518045.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3869970,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6941/20436941/damage_scratches-1774694856392.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f5a2878-ce22-5ad5-8c39-822bc163db6c/3f5a2878-ce22-5ad5-8c39-822bc163db6c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3622105,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6941/20436941/damage_scratches-1774694877815.jpg',
'Width': 4032}],
'price': 8623,
'price_includes_vat': False,
'registration_date': '2018-06-05',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf SE TSI BMT S-A',
'transmission': 'automatic',
'trim': 'SE TSI BMT S-A',
'vin': 'WVWZZZAUZJP143249',
'year': 2018}
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720436941%27 HTTP/1.1" 200 None
2026-03-29 20:12:32 [motorway.uk] INFO: Saving data for 20436941: {'created_time': 1774815152.340549, 'last_price_update_time': 1774815152.340559, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20436941') HTTP/1.1" 204 0
2026-03-29 20:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18180278.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_rear_driver-1774700010124.jpg> (referer: None)
2026-03-29 20:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc47d1d9-6cca-5e2c-8e16-c12956d766ab with identifier: 18180278
2026-03-29 20:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab with scrape type 1
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0278%252F18180278%252Fexterior_front_driver-1774618181960.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_front_driver-1774618181960.jpg not downloaded yet
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0278%252F18180278%252Fexterior_rear_driver-1774618203803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_rear_driver-1774618203803.jpg not downloaded yet
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0278%252F18180278%252Fexterior_front_passenger-1774618251311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_front_passenger-1774618251311.jpg not downloaded yet
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd2ba90>
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5362%252F16325362%252Fexterior_rear_driver-1774700010124.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_rear_driver-1774700010124.jpg saved to cache
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d138d72b-be0c-5866-9dc0-3181506dbb10
2026-03-29 20:12:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d138d72b-be0c-5866-9dc0-3181506dbb10, skipping ID generation
2026-03-29 20:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d138d72b-be0c-5866-9dc0-3181506dbb10 with scrape type 1
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d138d72b-be0c-5866-9dc0-3181506dbb10 sending to next pipeline
2026-03-29 20:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d138d72b-be0c-5866-9dc0-3181506dbb10, identifier: 16325362
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0278%252F18180278%252Fexterior_rear_passenger-1774618226906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_rear_passenger-1774618226906.jpg not downloaded yet
2026-03-29 20:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d138d72b-be0c-5866-9dc0-3181506dbb10 with identifier: 16325362
2026-03-29 20:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d138d72b-be0c-5866-9dc0-3181506dbb10 with identifier: 16325362
2026-03-29 20:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d138d72b-be0c-5866-9dc0-3181506dbb10 with identifier: 16325362 to the API
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_rear_driver-1774700010124.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd138d72b-be0c-5866-9dc0-3181506dbb10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PL14 CNO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16325362',
'listing': 'auction',
'location': 'Reading Reading',
'make': 'Nissan',
'model': 'Juke',
'odometer': 86000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2014028,
'Height': 2833,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_front_driver-1774699975834.jpg',
'Width': 3777},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2657305,
'Height': 3001,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_rear_driver-1774700010124.jpg',
'Width': 4001},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2115473,
'Height': 2636,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_front_passenger-1774700084306.jpg',
'Width': 3515},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1984229,
'Height': 2771,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5362/16325362/exterior_rear_passenger-1774700033305.jpg',
'Width': 3694},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3457076,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5362/16325362/interior_front_seats-1774700756924.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2619329,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5362/16325362/interior_rear_seats-1774700694383.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3802708,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5362/16325362/interior_dashboard-1774700807611.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4076449,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5362/16325362/interior_boot-1774700738692.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3091475,
'Height': 3334,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5362/16325362/docs_service_history-1774701273445.jpg?ixlib=js-3.8.0&auto=format&s=592f37b50ad9b7423ec0d46802b17fe4',
'Width': 2291},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d138d72b-be0c-5866-9dc0-3181506dbb10/d138d72b-be0c-5866-9dc0-3181506dbb10_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1085993,
'Height': 2610,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5362/16325362/docs_service_history-1774701274209.jpg?ixlib=js-3.8.0&auto=format&s=90b5fc3d0e98689d174c34c789019cee',
'Width': 3671}],
'price': 3890,
'price_includes_vat': False,
'registration_date': '2014-08-29',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke Acenta Premium CVT',
'transmission': 'automatic',
'trim': 'Acenta Premium CVT',
'vin': 'SJNFBAF15U7006591',
'year': 2014}
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716325362%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [motorway.uk] INFO: Saving data for 16325362: {'created_time': 1774815153.3001, 'last_price_update_time': 1774815153.30011, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16325362') HTTP/1.1" 204 0
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0278%252F18180278%252Finterior_front_seats-1774618756545.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0278/18180278/interior_front_seats-1774618756545.jpg not downloaded yet
2026-03-29 20:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19895213.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0278%252F18180278%252Finterior_rear_seats-1774618774778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0278/18180278/interior_rear_seats-1774618774778.jpg not downloaded yet
2026-03-29 20:12:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0278%252F18180278%252Finterior_dashboard-1774618808491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0278/18180278/interior_dashboard-1774618808491.jpg not downloaded yet
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0278%252F18180278%252Finstrument_cluster-1774618848593.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0278/18180278/instrument_cluster-1774618848593.jpg not downloaded yet
2026-03-29 20:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8218/10398218/exterior_rear_passenger-1774633813485.jpg> (referer: None)
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0278%252F18180278%252Finterior_boot-1774618814607.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0278/18180278/interior_boot-1774618814607.jpg not downloaded yet
2026-03-29 20:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8218/10398218/exterior_rear_driver-1774633828127.jpg> (referer: None)
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0278%252F18180278%252Fdocs_service_history-1774695266883.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De27b85ae592558a8b307607d75eec120%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0278/18180278/docs_service_history-1774695266883.jpg?ixlib=js-3.8.0&auto=format&s=e27b85ae592558a8b307607d75eec120 not downloaded yet
2026-03-29 20:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8218/10398218/exterior_front_passenger-1774633792825.jpg> (referer: None)
2026-03-29 20:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d2d765-277a-5467-95a3-0c19b23fe6e7 with identifier: 19895213
2026-03-29 20:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d2d765-277a-5467-95a3-0c19b23fe6e7 with scrape type 1
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6d2d765-277a-5467-95a3-0c19b23fe6e7
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5213%252F19895213%252Fexterior_front_driver-1771936987396.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5213/19895213/exterior_front_driver-1771936987396.jpg already downloaded
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5213%252F19895213%252Fexterior_rear_driver-1771937083905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5213/19895213/exterior_rear_driver-1771937083905.jpg already downloaded
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5213%252F19895213%252Fexterior_front_passenger-1771937052713.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5213/19895213/exterior_front_passenger-1771937052713.jpg already downloaded
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5213%252F19895213%252Fexterior_rear_passenger-1771937040340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5213/19895213/exterior_rear_passenger-1771937040340.jpg already downloaded
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5213%252F19895213%252Finterior_front_seats-1771937396396.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5213/19895213/interior_front_seats-1771937396396.jpg already downloaded
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5213%252F19895213%252Finterior_rear_seats-1771937397474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5213/19895213/interior_rear_seats-1771937397474.jpg already downloaded
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5213%252F19895213%252Finterior_dashboard-1771937414714.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5213/19895213/interior_dashboard-1771937414714.jpg already downloaded
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5213%252F19895213%252Finstrument_cluster-1771937336846.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5213/19895213/instrument_cluster-1771937336846.jpg already downloaded
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5213%252F19895213%252Finterior_boot-1771937404810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5213/19895213/interior_boot-1771937404810.jpg already downloaded
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5213%252F19895213%252Fdocs_service_history-1772018807258.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De8c642d81e620e77fd8855258294ca63%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5213/19895213/docs_service_history-1772018807258.jpg?ixlib=js-3.8.0&auto=format&s=e8c642d81e620e77fd8855258294ca63 already downloaded
2026-03-29 20:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e6d2d765-277a-5467-95a3-0c19b23fe6e7, identifier: 19895213
2026-03-29 20:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e6d2d765-277a-5467-95a3-0c19b23fe6e7 with identifier: 19895213
2026-03-29 20:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e6d2d765-277a-5467-95a3-0c19b23fe6e7 with identifier: 19895213
2026-03-29 20:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e6d2d765-277a-5467-95a3-0c19b23fe6e7 with identifier: 19895213 to the API
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19895213.json>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e6d2d765-277a-5467-95a3-0c19b23fe6e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SG18 CVN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19895213',
'listing': 'auction',
'location': 'Aberdeenshire Westhill',
'make': 'Vauxhall',
'model': 'Mokka',
'odometer': 43965,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/5213/19895213/exterior_front_driver-1771936987396.jpg',
'https://motorway-photos-redacted.imgix.net/5213/19895213/exterior_rear_driver-1771937083905.jpg',
'https://motorway-photos-redacted.imgix.net/5213/19895213/exterior_front_passenger-1771937052713.jpg',
'https://motorway-photos-redacted.imgix.net/5213/19895213/exterior_rear_passenger-1771937040340.jpg',
'https://motorway-photos.imgix.net/5213/19895213/interior_front_seats-1771937396396.jpg',
'https://motorway-photos.imgix.net/5213/19895213/interior_rear_seats-1771937397474.jpg',
'https://motorway-photos-redacted.imgix.net/5213/19895213/interior_dashboard-1771937414714.jpg',
'https://motorway-photos.imgix.net/5213/19895213/instrument_cluster-1771937336846.jpg',
'https://motorway-photos.imgix.net/5213/19895213/interior_boot-1771937404810.jpg',
'https://motorway-service-history-photos.imgix.net/modified/5213/19895213/docs_service_history-1772018807258.jpg?ixlib=js-3.8.0&auto=format&s=e8c642d81e620e77fd8855258294ca63'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76882513-2bc1-5d73-a6ae-cfc613164064/76882513-2bc1-5d73-a6ae-cfc613164064_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1774153,
'Height': 2462,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5213/19895213/exterior_front_driver-1771936987396.jpg',
'Width': 3282},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76882513-2bc1-5d73-a6ae-cfc613164064/76882513-2bc1-5d73-a6ae-cfc613164064_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2002093,
'Height': 2490,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5213/19895213/exterior_rear_driver-1771937083905.jpg',
'Width': 3320},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76882513-2bc1-5d73-a6ae-cfc613164064/76882513-2bc1-5d73-a6ae-cfc613164064_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2120922,
'Height': 2757,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5213/19895213/exterior_front_passenger-1771937052713.jpg',
'Width': 3676},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76882513-2bc1-5d73-a6ae-cfc613164064/76882513-2bc1-5d73-a6ae-cfc613164064_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1754310,
'Height': 2352,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5213/19895213/exterior_rear_passenger-1771937040340.jpg',
'Width': 3136},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76882513-2bc1-5d73-a6ae-cfc613164064/76882513-2bc1-5d73-a6ae-cfc613164064_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5284506,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5213/19895213/interior_front_seats-1771937396396.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76882513-2bc1-5d73-a6ae-cfc613164064/76882513-2bc1-5d73-a6ae-cfc613164064_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3911683,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5213/19895213/interior_rear_seats-1771937397474.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76882513-2bc1-5d73-a6ae-cfc613164064/76882513-2bc1-5d73-a6ae-cfc613164064_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1941546,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5213/19895213/interior_dashboard-1771937414714.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76882513-2bc1-5d73-a6ae-cfc613164064/76882513-2bc1-5d73-a6ae-cfc613164064_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2734463,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5213/19895213/instrument_cluster-1771937336846.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76882513-2bc1-5d73-a6ae-cfc613164064/76882513-2bc1-5d73-a6ae-cfc613164064_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3713499,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5213/19895213/interior_boot-1771937404810.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76882513-2bc1-5d73-a6ae-cfc613164064/76882513-2bc1-5d73-a6ae-cfc613164064_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3411059,
'Height': 2932,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/5213/19895213/docs_service_history-1772018807258.jpg?ixlib=js-3.8.0&auto=format&s=e8c642d81e620e77fd8855258294ca63',
'Width': 3910}],
'price': 8086,
'price_includes_vat': False,
'registration_date': '2018-03-05',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Mokka X Design NAV Turbo Auto',
'transmission': 'automatic',
'trim': 'X Design NAV Turbo Auto',
'vin': 'W0VJC7E86JB607695',
'year': 2018}
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719895213%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [motorway.uk] INFO: Saving data for 19895213: {'created_time': 1774815154.19424, 'last_price_update_time': 1774815154.194252, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19895213') HTTP/1.1" 204 0
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d973950>
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0947bb9f-266e-5ff1-b2a9-8900fcaf00c2/0947bb9f-266e-5ff1-b2a9-8900fcaf00c2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8218%252F10398218%252Fexterior_rear_passenger-1774633813485.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8218/10398218/exterior_rear_passenger-1774633813485.jpg saved to cache
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0947bb9f-266e-5ff1-b2a9-8900fcaf00c2
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d972150>
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0947bb9f-266e-5ff1-b2a9-8900fcaf00c2/0947bb9f-266e-5ff1-b2a9-8900fcaf00c2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8218%252F10398218%252Fexterior_rear_driver-1774633828127.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8218/10398218/exterior_rear_driver-1774633828127.jpg saved to cache
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0947bb9f-266e-5ff1-b2a9-8900fcaf00c2
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d05a4d0>
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0947bb9f-266e-5ff1-b2a9-8900fcaf00c2/0947bb9f-266e-5ff1-b2a9-8900fcaf00c2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8218%252F10398218%252Fexterior_front_passenger-1774633792825.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8218/10398218/exterior_front_passenger-1774633792825.jpg saved to cache
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0947bb9f-266e-5ff1-b2a9-8900fcaf00c2
2026-03-29 20:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0278/18180278/instrument_cluster-1774618848593.jpg> (referer: None)
2026-03-29 20:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0278/18180278/interior_front_seats-1774618756545.jpg> (referer: None)
2026-03-29 20:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0278/18180278/interior_dashboard-1774618808491.jpg> (referer: None)
2026-03-29 20:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0278/18180278/interior_boot-1774618814607.jpg> (referer: None)
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d973790>
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0278%252F18180278%252Finstrument_cluster-1774618848593.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0278/18180278/instrument_cluster-1774618848593.jpg saved to cache
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc6cb10>
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0278%252F18180278%252Finterior_front_seats-1774618756545.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0278/18180278/interior_front_seats-1774618756545.jpg saved to cache
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9baf90>
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0278%252F18180278%252Finterior_dashboard-1774618808491.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0278/18180278/interior_dashboard-1774618808491.jpg saved to cache
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d062c10>
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0278%252F18180278%252Finterior_boot-1774618814607.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0278/18180278/interior_boot-1774618814607.jpg saved to cache
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab
2026-03-29 20:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0278/18180278/docs_service_history-1774695266883.jpg?ixlib=js-3.8.0&auto=format&s=e27b85ae592558a8b307607d75eec120> (referer: None)
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d027410>
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0278%252F18180278%252Fdocs_service_history-1774695266883.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De27b85ae592558a8b307607d75eec120') HTTP/1.1" 204 0
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0278/18180278/docs_service_history-1774695266883.jpg?ixlib=js-3.8.0&auto=format&s=e27b85ae592558a8b307607d75eec120 saved to cache
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab
2026-03-29 20:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1440&page=40&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490112.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 13194088
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20307939
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720307939%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [motorway.uk] INFO: Scrape type for 20307939: 2
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 14034746
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20338819
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 12525227
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 15408464
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 19652736
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719652736%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [motorway.uk] INFO: Scrape type for 19652736: 1
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 19998992
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 16324421
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20402579
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 15712620
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 19937895
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719937895%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [motorway.uk] INFO: Scrape type for 19937895: 1
2026-03-29 20:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d with identifier: 20490112
2026-03-29 20:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d with scrape type 1
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0112%252F20490112%252Fexterior_front_driver-1774710187995.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0112/20490112/exterior_front_driver-1774710187995.jpg not downloaded yet
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20343893
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 19863425
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20374139
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20447541
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720447541%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [motorway.uk] INFO: Scrape type for 20447541: 1
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0112%252F20490112%252Fexterior_rear_driver-1774717025996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0112/20490112/exterior_rear_driver-1774717025996.jpg not downloaded yet
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20096245
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 8969713
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20187846
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720187846%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [motorway.uk] INFO: Scrape type for 20187846: 1
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0112%252F20490112%252Fexterior_front_passenger-1774710184114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0112/20490112/exterior_front_passenger-1774710184114.jpg not downloaded yet
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 15023759
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20483861
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483861%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [motorway.uk] INFO: Scrape type for 20483861: 1
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0112%252F20490112%252Fexterior_rear_passenger-1774710180568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0112/20490112/exterior_rear_passenger-1774710180568.jpg not downloaded yet
2026-03-29 20:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_rear_passenger-1774618226906.jpg> (referer: None)
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20488363
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 18488723
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 19333728
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20373131
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 15015635
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 19288107
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20487830
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20064722
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720064722%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [motorway.uk] INFO: Scrape type for 20064722: 1
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0112%252F20490112%252Finterior_front_seats-1774713382685.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0112/20490112/interior_front_seats-1774713382685.jpg not downloaded yet
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 17810245
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717810245%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [motorway.uk] INFO: Scrape type for 17810245: 1
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0112%252F20490112%252Finterior_rear_seats-1774714808921.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0112/20490112/interior_rear_seats-1774714808921.jpg not downloaded yet
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 17844342
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20159342
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720159342%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [motorway.uk] INFO: Scrape type for 20159342: 1
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0112%252F20490112%252Finterior_dashboard-1774715598144.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0112/20490112/interior_dashboard-1774715598144.jpg not downloaded yet
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20367432
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 19709380
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 18256517
2026-03-29 20:12:35 [motorway.uk] INFO: Found listing with ID: 20246067
2026-03-29 20:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_rear_driver-1774618203803.jpg> (referer: None)
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0112%252F20490112%252Finstrument_cluster-1774715429908.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0112/20490112/instrument_cluster-1774715429908.jpg not downloaded yet
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4e62d0>
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0278%252F18180278%252Fexterior_rear_passenger-1774618226906.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_rear_passenger-1774618226906.jpg saved to cache
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0112%252F20490112%252Finterior_boot-1774715189647.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0112/20490112/interior_boot-1774715189647.jpg not downloaded yet
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0112%252F20490112%252Fdocs_service_history-1774714211721.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7b81c0c69100ccd9242d7eb3be2adff3%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0112/20490112/docs_service_history-1774714211721.jpg?ixlib=js-3.8.0&auto=format&s=7b81c0c69100ccd9242d7eb3be2adff3 not downloaded yet
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d24de50>
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0278%252F18180278%252Fexterior_rear_driver-1774618203803.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_rear_driver-1774618203803.jpg saved to cache
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0278/18180278/interior_rear_seats-1774618774778.jpg> (referer: None)
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_front_driver-1774618181960.jpg> (referer: None)
2026-03-29 20:12:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f293810>
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0278%252F18180278%252Finterior_rear_seats-1774618774778.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0278/18180278/interior_rear_seats-1774618774778.jpg saved to cache
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d67eb50>
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0278%252F18180278%252Fexterior_front_driver-1774618181960.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_front_driver-1774618181960.jpg saved to cache
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19899009.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0112/20490112/docs_service_history-1774714211721.jpg?ixlib=js-3.8.0&auto=format&s=7b81c0c69100ccd9242d7eb3be2adff3> (referer: None)
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20440778.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbaa1ff9-b35c-559f-956b-59616239e7c1 with identifier: 19899009
2026-03-29 20:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbaa1ff9-b35c-559f-956b-59616239e7c1 with scrape type 1
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cbaa1ff9-b35c-559f-956b-59616239e7c1
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9009%252F19899009%252Fexterior_front_driver-1774696162490.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9009/19899009/exterior_front_driver-1774696162490.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9009%252F19899009%252Fexterior_rear_driver-1774696166604.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9009/19899009/exterior_rear_driver-1774696166604.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9009%252F19899009%252Fexterior_front_passenger-1774696160593.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9009/19899009/exterior_front_passenger-1774696160593.jpg not downloaded yet
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de0ff50>
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d/38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0112%252F20490112%252Fdocs_service_history-1774714211721.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7b81c0c69100ccd9242d7eb3be2adff3') HTTP/1.1" 204 0
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0112/20490112/docs_service_history-1774714211721.jpg?ixlib=js-3.8.0&auto=format&s=7b81c0c69100ccd9242d7eb3be2adff3 saved to cache
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d
2026-03-29 20:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcaa3f4a-6886-57e1-9eaf-608a938d0d16 with identifier: 20440778
2026-03-29 20:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcaa3f4a-6886-57e1-9eaf-608a938d0d16 with scrape type 1
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcaa3f4a-6886-57e1-9eaf-608a938d0d16
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0778%252F20440778%252Fexterior_front_driver-1774707481194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0778/20440778/exterior_front_driver-1774707481194.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9009%252F19899009%252Fexterior_rear_passenger-1774696164198.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9009/19899009/exterior_rear_passenger-1774696164198.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0778%252F20440778%252Fexterior_rear_driver-1774708111206.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0778/20440778/exterior_rear_driver-1774708111206.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9009%252F19899009%252Finterior_front_seats-1774696553843.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9009/19899009/interior_front_seats-1774696553843.jpg not downloaded yet
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16171790.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15325780.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0778%252F20440778%252Fexterior_front_passenger-1774707492823.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0778/20440778/exterior_front_passenger-1774707492823.jpg not downloaded yet
2026-03-29 20:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9009%252F19899009%252Finterior_rear_seats-1774696559026.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9009/19899009/interior_rear_seats-1774696559026.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0778%252F20440778%252Fexterior_rear_passenger-1774707485824.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0778/20440778/exterior_rear_passenger-1774707485824.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9009%252F19899009%252Finterior_dashboard-1774696705872.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9009/19899009/interior_dashboard-1774696705872.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0778%252F20440778%252Finterior_front_seats-1774708243230.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0778/20440778/interior_front_seats-1774708243230.jpg not downloaded yet
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9009%252F19899009%252Finstrument_cluster-1774696561138.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9009/19899009/instrument_cluster-1774696561138.jpg not downloaded yet
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_front_passenger-1774618251311.jpg> (referer: None)
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0778%252F20440778%252Finterior_rear_seats-1774707835213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0778/20440778/interior_rear_seats-1774707835213.jpg not downloaded yet
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9009%252F19899009%252Finterior_boot-1774696557323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9009/19899009/interior_boot-1774696557323.jpg not downloaded yet
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0112/20490112/instrument_cluster-1774715429908.jpg> (referer: None)
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0778%252F20440778%252Finterior_dashboard-1774710842824.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0778/20440778/interior_dashboard-1774710842824.jpg not downloaded yet
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9009%252F19899009%252Fdocs_service_history-1774696623214.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8d13ad9200afe4500d445eb055d32f46%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9009/19899009/docs_service_history-1774696623214.jpg?ixlib=js-3.8.0&auto=format&s=8d13ad9200afe4500d445eb055d32f46 not downloaded yet
2026-03-29 20:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0945568e-b87a-5089-88f4-996eedbcfcca with identifier: 16171790
2026-03-29 20:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0945568e-b87a-5089-88f4-996eedbcfcca with scrape type 1
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0945568e-b87a-5089-88f4-996eedbcfcca
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1790%252F16171790%252Fexterior_front_driver-1774710693454.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1790/16171790/exterior_front_driver-1774710693454.jpg not downloaded yet
2026-03-29 20:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93b05671-d102-54d7-bdb7-a3b10fde4b28 with identifier: 15325780
2026-03-29 20:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93b05671-d102-54d7-bdb7-a3b10fde4b28 with scrape type 1
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93b05671-d102-54d7-bdb7-a3b10fde4b28
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5780%252F15325780%252Fexterior_front_driver-1774791223341.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5780/15325780/exterior_front_driver-1774791223341.jpeg not downloaded yet
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0778%252F20440778%252Finstrument_cluster-1774710869358.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0778/20440778/instrument_cluster-1774710869358.jpg not downloaded yet
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20337643.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1790%252F16171790%252Fexterior_rear_driver-1774710782070.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1790/16171790/exterior_rear_driver-1774710782070.jpg not downloaded yet
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5780%252F15325780%252Fexterior_rear_driver-1774791414544.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5780/15325780/exterior_rear_driver-1774791414544.jpeg not downloaded yet
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0778%252F20440778%252Finterior_boot-1774707830282.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0778/20440778/interior_boot-1774707830282.jpg not downloaded yet
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d099650>
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0278%252F18180278%252Fexterior_front_passenger-1774618251311.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_front_passenger-1774618251311.jpg saved to cache
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab
2026-03-29 20:12:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc47d1d9-6cca-5e2c-8e16-c12956d766ab, skipping ID generation
2026-03-29 20:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab with scrape type 1
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc47d1d9-6cca-5e2c-8e16-c12956d766ab sending to next pipeline
2026-03-29 20:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cc47d1d9-6cca-5e2c-8e16-c12956d766ab, identifier: 18180278
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d09b750>
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d/38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0112%252F20490112%252Finstrument_cluster-1774715429908.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0112/20490112/instrument_cluster-1774715429908.jpg saved to cache
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1790%252F16171790%252Fexterior_front_passenger-1774710780747.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1790/16171790/exterior_front_passenger-1774710780747.jpg not downloaded yet
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5780%252F15325780%252Fexterior_front_passenger-1774791204182.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5780/15325780/exterior_front_passenger-1774791204182.jpeg not downloaded yet
2026-03-29 20:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cc47d1d9-6cca-5e2c-8e16-c12956d766ab with identifier: 18180278
2026-03-29 20:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cc47d1d9-6cca-5e2c-8e16-c12956d766ab with identifier: 18180278
2026-03-29 20:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cc47d1d9-6cca-5e2c-8e16-c12956d766ab with identifier: 18180278 to the API
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_front_passenger-1774618251311.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'cc47d1d9-6cca-5e2c-8e16-c12956d766ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY14 DAV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18180278',
'listing': 'auction',
'location': 'Rhondda Cynon Taff Ferndale',
'make': 'Ford',
'model': 'Focus',
'odometer': 50366,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1795719,
'Height': 2321,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_front_driver-1774618181960.jpg',
'Width': 3094},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1739266,
'Height': 2428,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_rear_driver-1774618203803.jpg',
'Width': 3237},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2072613,
'Height': 2679,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_front_passenger-1774618251311.jpg',
'Width': 3572},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1873211,
'Height': 2555,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0278/18180278/exterior_rear_passenger-1774618226906.jpg',
'Width': 3407},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3291742,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0278/18180278/interior_front_seats-1774618756545.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3313647,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0278/18180278/interior_rear_seats-1774618774778.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3655664,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0278/18180278/interior_dashboard-1774618808491.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2201757,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0278/18180278/instrument_cluster-1774618848593.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3956729,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0278/18180278/interior_boot-1774618814607.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc47d1d9-6cca-5e2c-8e16-c12956d766ab/cc47d1d9-6cca-5e2c-8e16-c12956d766ab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1017463,
'Height': 3351,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0278/18180278/docs_service_history-1774695266883.jpg?ixlib=js-3.8.0&auto=format&s=e27b85ae592558a8b307607d75eec120',
'Width': 2280}],
'price': 6407,
'price_includes_vat': False,
'registration_date': '2018-03-23',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus ST-LINE',
'transmission': 'manual',
'trim': 'ST-LINE',
'vin': 'WF05XXGCC5JY42821',
'year': 2018}
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718180278%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [motorway.uk] INFO: Saving data for 18180278: {'created_time': 1774815158.125482, 'last_price_update_time': 1774815158.125495, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18180278') HTTP/1.1" 204 0
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0778%252F20440778%252Fdocs_service_history-1774707898531.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5cedc841d2f8f66fcec6fa3f8c3a8df8%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0778/20440778/docs_service_history-1774707898531.jpg?ixlib=js-3.8.0&auto=format&s=5cedc841d2f8f66fcec6fa3f8c3a8df8 not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1790%252F16171790%252Fexterior_rear_passenger-1774710761990.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1790/16171790/exterior_rear_passenger-1774710761990.jpg not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5780%252F15325780%252Fexterior_rear_passenger-1774791191003.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5780/15325780/exterior_rear_passenger-1774791191003.jpeg not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1790%252F16171790%252Finterior_front_seats-1774711049674.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1790/16171790/interior_front_seats-1774711049674.jpg not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5780%252F15325780%252Finterior_front_seats-1774791280891.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5780/15325780/interior_front_seats-1774791280891.jpeg not downloaded yet
2026-03-29 20:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcf9fd8c-c735-5185-ad67-570269719e53 with identifier: 20337643
2026-03-29 20:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcf9fd8c-c735-5185-ad67-570269719e53 with scrape type 1
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcf9fd8c-c735-5185-ad67-570269719e53
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7643%252F20337643%252Fexterior_front_driver-1774715484508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7643/20337643/exterior_front_driver-1774715484508.jpg not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1790%252F16171790%252Finterior_rear_seats-1774711072631.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1790/16171790/interior_rear_seats-1774711072631.jpg not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5780%252F15325780%252Finterior_rear_seats-1774791256311.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5780/15325780/interior_rear_seats-1774791256311.jpeg not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7643%252F20337643%252Fexterior_rear_driver-1774715464175.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7643/20337643/exterior_rear_driver-1774715464175.jpg not downloaded yet
2026-03-29 20:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0112/20490112/interior_dashboard-1774715598144.jpg> (referer: None)
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1790%252F16171790%252Finterior_dashboard-1774711089810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1790/16171790/interior_dashboard-1774711089810.jpg not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5780%252F15325780%252F15325780-interior_dashboard-modified-1774793061513.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5780/15325780/15325780-interior_dashboard-modified-1774793061513.jpeg not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7643%252F20337643%252Fexterior_front_passenger-1774715417519.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7643/20337643/exterior_front_passenger-1774715417519.jpg not downloaded yet
2026-03-29 20:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0778/20440778/exterior_rear_driver-1774708111206.jpg> (referer: None)
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1790%252F16171790%252Finstrument_cluster-1774711168209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1790/16171790/instrument_cluster-1774711168209.jpg not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5780%252F15325780%252Finterior_boot-1774791373214.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5780/15325780/interior_boot-1774791373214.jpeg not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7643%252F20337643%252Fexterior_rear_passenger-1774715445674.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7643/20337643/exterior_rear_passenger-1774715445674.jpg not downloaded yet
2026-03-29 20:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0112/20490112/interior_boot-1774715189647.jpg> (referer: None)
2026-03-29 20:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20277874.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1790%252F16171790%252Finterior_boot-1774711098985.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1790/16171790/interior_boot-1774711098985.jpg not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5780%252F15325780%252Fdocs_service_history-1774792478297.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db04cd784e8574fc6781481d413967b33%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5780/15325780/docs_service_history-1774792478297.jpeg?ixlib=js-3.8.0&auto=format&s=b04cd784e8574fc6781481d413967b33 not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7643%252F20337643%252Finterior_front_seats-1774716410067.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7643/20337643/interior_front_seats-1774716410067.jpg not downloaded yet
2026-03-29 20:12:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11842898.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da82090>
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d/38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0112%252F20490112%252Finterior_dashboard-1774715598144.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0112/20490112/interior_dashboard-1774715598144.jpg saved to cache
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1790%252F16171790%252Fdocs_service_history-1774712139989.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df9b8226d45ceec9d5f3981a2a8114d25%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1790/16171790/docs_service_history-1774712139989.png?ixlib=js-3.8.0&auto=format&s=f9b8226d45ceec9d5f3981a2a8114d25 not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5780%252F15325780%252Fdocs_service_history-1774792524176.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6ec5a8a5d13e83511750fcbe073298c0%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5780/15325780/docs_service_history-1774792524176.jpeg?ixlib=js-3.8.0&auto=format&s=6ec5a8a5d13e83511750fcbe073298c0 not downloaded yet
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7643%252F20337643%252Finterior_rear_seats-1774716263013.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7643/20337643/interior_rear_seats-1774716263013.jpg not downloaded yet
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c72bc90>
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcaa3f4a-6886-57e1-9eaf-608a938d0d16/dcaa3f4a-6886-57e1-9eaf-608a938d0d16_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0778%252F20440778%252Fexterior_rear_driver-1774708111206.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0778/20440778/exterior_rear_driver-1774708111206.jpg saved to cache
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcaa3f4a-6886-57e1-9eaf-608a938d0d16
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7643%252F20337643%252Finterior_dashboard-1774716287858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7643/20337643/interior_dashboard-1774716287858.jpg not downloaded yet
2026-03-29 20:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0778/20440778/interior_front_seats-1774708243230.jpg> (referer: None)
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7643%252F20337643%252Finstrument_cluster-1774716514533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7643/20337643/instrument_cluster-1774716514533.jpg not downloaded yet
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce2d290>
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d/38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0112%252F20490112%252Finterior_boot-1774715189647.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0112/20490112/interior_boot-1774715189647.jpg saved to cache
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38d6bfdc-3162-5cd4-881d-a1d7fc6e2d5d
2026-03-29 20:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd55fa4-4a83-5a8c-b370-74668c9d5ab0 with identifier: 20277874
2026-03-29 20:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd55fa4-4a83-5a8c-b370-74668c9d5ab0 with scrape type 1
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3fd55fa4-4a83-5a8c-b370-74668c9d5ab0
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7874%252F20277874%252Fexterior_front_driver-1774694848190.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7874/20277874/exterior_front_driver-1774694848190.jpg not downloaded yet
2026-03-29 20:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90689757-c2c8-5526-818d-6f00dfc1698f with identifier: 11842898
2026-03-29 20:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90689757-c2c8-5526-818d-6f00dfc1698f with scrape type 1
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90689757-c2c8-5526-818d-6f00dfc1698f
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2898%252F11842898%252Fexterior_front_driver-1774706712396.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2898/11842898/exterior_front_driver-1774706712396.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7643%252F20337643%252Finterior_boot-1774716181373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7643/20337643/interior_boot-1774716181373.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7874%252F20277874%252Fexterior_rear_driver-1774698222021.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7874/20277874/exterior_rear_driver-1774698222021.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2898%252F11842898%252Fexterior_rear_driver-1774706769962.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2898/11842898/exterior_rear_driver-1774706769962.jpg not downloaded yet
2026-03-29 20:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0778/20440778/interior_boot-1774707830282.jpg> (referer: None)
2026-03-29 20:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20483861.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c52d0>
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcaa3f4a-6886-57e1-9eaf-608a938d0d16/dcaa3f4a-6886-57e1-9eaf-608a938d0d16_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0778%252F20440778%252Finterior_front_seats-1774708243230.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0778/20440778/interior_front_seats-1774708243230.jpg saved to cache
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcaa3f4a-6886-57e1-9eaf-608a938d0d16
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7643%252F20337643%252Fdocs_service_history-1774716739087.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D34c7e8b85bf005631418104db3abf6ac%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7643/20337643/docs_service_history-1774716739087.jpg?ixlib=js-3.8.0&auto=format&s=34c7e8b85bf005631418104db3abf6ac not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7874%252F20277874%252Fexterior_front_passenger-1774694840968.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7874/20277874/exterior_front_passenger-1774694840968.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2898%252F11842898%252Fexterior_front_passenger-1774706734457.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2898/11842898/exterior_front_passenger-1774706734457.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7874%252F20277874%252Fexterior_rear_passenger-1774698240878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7874/20277874/exterior_rear_passenger-1774698240878.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2898%252F11842898%252Fexterior_rear_passenger-1774706755391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2898/11842898/exterior_rear_passenger-1774706755391.jpg not downloaded yet
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0e2810>
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcaa3f4a-6886-57e1-9eaf-608a938d0d16/dcaa3f4a-6886-57e1-9eaf-608a938d0d16_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0778%252F20440778%252Finterior_boot-1774707830282.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0778/20440778/interior_boot-1774707830282.jpg saved to cache
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dcaa3f4a-6886-57e1-9eaf-608a938d0d16
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7874%252F20277874%252Finterior_front_seats-1774695611829.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7874/20277874/interior_front_seats-1774695611829.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2898%252F11842898%252Finterior_front_seats-1774706825159.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2898/11842898/interior_front_seats-1774706825159.jpg not downloaded yet
2026-03-29 20:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6443cad9-a098-5282-beec-ddd4026de379 with identifier: 20483861
2026-03-29 20:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6443cad9-a098-5282-beec-ddd4026de379 with scrape type 1
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6443cad9-a098-5282-beec-ddd4026de379
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3861%252F20483861%252Fexterior_front_driver-1774695335820.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3861/20483861/exterior_front_driver-1774695335820.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7874%252F20277874%252Finterior_rear_seats-1774695241434.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7874/20277874/interior_rear_seats-1774695241434.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2898%252F11842898%252Finterior_rear_seats-1774706883580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2898/11842898/interior_rear_seats-1774706883580.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3861%252F20483861%252Fexterior_rear_driver-1774698623861.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3861/20483861/exterior_rear_driver-1774698623861.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7874%252F20277874%252Finterior_dashboard-1774698259831.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7874/20277874/interior_dashboard-1774698259831.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2898%252F11842898%252Finterior_dashboard-1774706925432.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2898/11842898/interior_dashboard-1774706925432.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3861%252F20483861%252Fexterior_front_passenger-1774695331320.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3861/20483861/exterior_front_passenger-1774695331320.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7874%252F20277874%252Finstrument_cluster-1774695202612.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7874/20277874/instrument_cluster-1774695202612.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2898%252F11842898%252Finstrument_cluster-1774706989305.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2898/11842898/instrument_cluster-1774706989305.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3861%252F20483861%252Fexterior_rear_passenger-1774695332352.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3861/20483861/exterior_rear_passenger-1774695332352.jpg not downloaded yet
2026-03-29 20:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7643/20337643/exterior_rear_driver-1774715464175.jpg> (referer: None)
2026-03-29 20:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2898/11842898/exterior_front_driver-1774706712396.jpg> (referer: None)
2026-03-29 20:12:39 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (17631591) larger than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1790/16171790/docs_service_history-1774712139989.png?ixlib=js-3.8.0&auto=format&s=f9b8226d45ceec9d5f3981a2a8114d25>.
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7874%252F20277874%252Finterior_boot-1774695184795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7874/20277874/interior_boot-1774695184795.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2898%252F11842898%252Finterior_boot-1774706938542.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2898/11842898/interior_boot-1774706938542.jpg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3861%252F20483861%252Finterior_front_seats-1774696234745.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3861/20483861/interior_front_seats-1774696234745.jpg not downloaded yet
2026-03-29 20:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17411348.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9009/19899009/interior_boot-1774696557323.jpg> (referer: None)
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7874%252F20277874%252Fdocs_service_history-1774700254407.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc84ef6e34db25923af0c63274099624a%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7874/20277874/docs_service_history-1774700254407.jpg?ixlib=js-3.8.0&auto=format&s=c84ef6e34db25923af0c63274099624a not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2898%252F11842898%252Fdocs_service_history-1774707288900.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0ca56aa29c947669284dc2cef147a2db%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2898/11842898/docs_service_history-1774707288900.jpg?ixlib=js-3.8.0&auto=format&s=0ca56aa29c947669284dc2cef147a2db not downloaded yet
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3861%252F20483861%252Finterior_rear_seats-1774696229476.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3861/20483861/interior_rear_seats-1774696229476.jpg not downloaded yet
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9009/19899009/interior_front_seats-1774696553843.jpg> (referer: None)
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3861%252F20483861%252Finterior_dashboard-1774696242028.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3861/20483861/interior_dashboard-1774696242028.jpg not downloaded yet
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0e2990>
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf9fd8c-c735-5185-ad67-570269719e53/dcf9fd8c-c735-5185-ad67-570269719e53_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7643%252F20337643%252Fexterior_rear_driver-1774715464175.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7643/20337643/exterior_rear_driver-1774715464175.jpg saved to cache
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcf9fd8c-c735-5185-ad67-570269719e53
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f30f0d0>
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90689757-c2c8-5526-818d-6f00dfc1698f/90689757-c2c8-5526-818d-6f00dfc1698f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2898%252F11842898%252Fexterior_front_driver-1774706712396.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2898/11842898/exterior_front_driver-1774706712396.jpg saved to cache
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90689757-c2c8-5526-818d-6f00dfc1698f
2026-03-29 20:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68562d22-5449-5fe2-9b33-ad1173a6da9d with identifier: 17411348
2026-03-29 20:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68562d22-5449-5fe2-9b33-ad1173a6da9d with scrape type 1
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68562d22-5449-5fe2-9b33-ad1173a6da9d
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1348%252F17411348%252Fexterior_front_driver-1774775278392.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1348/17411348/exterior_front_driver-1774775278392.jpeg not downloaded yet
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd1d690>
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbaa1ff9-b35c-559f-956b-59616239e7c1/cbaa1ff9-b35c-559f-956b-59616239e7c1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9009%252F19899009%252Finterior_boot-1774696557323.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9009/19899009/interior_boot-1774696557323.jpg saved to cache
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cbaa1ff9-b35c-559f-956b-59616239e7c1
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2898/11842898/exterior_rear_driver-1774706769962.jpg> (referer: None)
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3861%252F20483861%252Finterior_boot-1774696232954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3861/20483861/interior_boot-1774696232954.jpg not downloaded yet
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1348%252F17411348%252Fexterior_rear_driver-1774775219858.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1348/17411348/exterior_rear_driver-1774775219858.jpeg not downloaded yet
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3861%252F20483861%252Fdocs_service_history-1774696378202.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da7b554e4763120a61334a288a668c8a7%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3861/20483861/docs_service_history-1774696378202.jpg?ixlib=js-3.8.0&auto=format&s=a7b554e4763120a61334a288a668c8a7 not downloaded yet
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20208609.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5780/15325780/docs_service_history-1774792524176.jpeg?ixlib=js-3.8.0&auto=format&s=6ec5a8a5d13e83511750fcbe073298c0> (referer: None)
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1348%252F17411348%252F17411348-exterior_front_passenger-modified-1774778226206.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1348/17411348/17411348-exterior_front_passenger-modified-1774778226206.jpeg not downloaded yet
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dde7410>
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbaa1ff9-b35c-559f-956b-59616239e7c1/cbaa1ff9-b35c-559f-956b-59616239e7c1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9009%252F19899009%252Finterior_front_seats-1774696553843.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9009/19899009/interior_front_seats-1774696553843.jpg saved to cache
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cbaa1ff9-b35c-559f-956b-59616239e7c1
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3861%252F20483861%252Fdocs_service_history-1774696389414.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D51bb501b86f63aec2f87da28c353ef2e%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3861/20483861/docs_service_history-1774696389414.jpg?ixlib=js-3.8.0&auto=format&s=51bb501b86f63aec2f87da28c353ef2e not downloaded yet
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1348%252F17411348%252Fexterior_rear_passenger-1774775153705.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1348/17411348/exterior_rear_passenger-1774775153705.jpeg not downloaded yet
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1348%252F17411348%252Finterior_front_seats-1774775754048.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1348/17411348/interior_front_seats-1774775754048.jpeg not downloaded yet
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da03c90>
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90689757-c2c8-5526-818d-6f00dfc1698f/90689757-c2c8-5526-818d-6f00dfc1698f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2898%252F11842898%252Fexterior_rear_driver-1774706769962.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2898/11842898/exterior_rear_driver-1774706769962.jpg saved to cache
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90689757-c2c8-5526-818d-6f00dfc1698f
2026-03-29 20:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34bac2f7-6741-5a40-bd55-afeb67f86864 with identifier: 20208609
2026-03-29 20:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34bac2f7-6741-5a40-bd55-afeb67f86864 with scrape type 1
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34bac2f7-6741-5a40-bd55-afeb67f86864
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8609%252F20208609%252Fexterior_front_driver-1774619755116.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8609/20208609/exterior_front_driver-1774619755116.jpg not downloaded yet
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6a3cd0>
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93b05671-d102-54d7-bdb7-a3b10fde4b28/93b05671-d102-54d7-bdb7-a3b10fde4b28_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5780%252F15325780%252Fdocs_service_history-1774792524176.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6ec5a8a5d13e83511750fcbe073298c0') HTTP/1.1" 204 0
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5780/15325780/docs_service_history-1774792524176.jpeg?ixlib=js-3.8.0&auto=format&s=6ec5a8a5d13e83511750fcbe073298c0 saved to cache
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 93b05671-d102-54d7-bdb7-a3b10fde4b28
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1348%252F17411348%252Finterior_rear_seats-1774775878754.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1348/17411348/interior_rear_seats-1774775878754.jpeg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8609%252F20208609%252Fexterior_rear_driver-1774619754582.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8609/20208609/exterior_rear_driver-1774619754582.jpg not downloaded yet
2026-03-29 20:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20159342.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20352821.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1348%252F17411348%252F17411348-interior_dashboard-modified-1774778300168.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1348/17411348/17411348-interior_dashboard-modified-1774778300168.jpeg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8609%252F20208609%252Fexterior_front_passenger-1774619758987.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8609/20208609/exterior_front_passenger-1774619758987.jpg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1348%252F17411348%252Finterior_boot-1774775776705.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1348/17411348/interior_boot-1774775776705.jpeg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8609%252F20208609%252Fexterior_rear_passenger-1774619758426.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8609/20208609/exterior_rear_passenger-1774619758426.jpg not downloaded yet
2026-03-29 20:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3861/20483861/exterior_front_passenger-1774695331320.jpg> (referer: None)
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1348%252F17411348%252Fdocs_service_history-1774778209327.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6f0ca0417f40fda8f7bceca3aaecd220%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1348/17411348/docs_service_history-1774778209327.jpeg?ixlib=js-3.8.0&auto=format&s=6f0ca0417f40fda8f7bceca3aaecd220 not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8609%252F20208609%252Finterior_front_seats-1774621442338.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8609/20208609/interior_front_seats-1774621442338.jpg not downloaded yet
2026-03-29 20:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7643/20337643/interior_front_seats-1774716410067.jpg> (referer: None)
2026-03-29 20:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7643/20337643/interior_rear_seats-1774716263013.jpg> (referer: None)
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1348%252F17411348%252Fdamage_windscreen-1774775462076.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1348/17411348/damage_windscreen-1774775462076.jpeg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8609%252F20208609%252Finterior_rear_seats-1774621431850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8609/20208609/interior_rear_seats-1774621431850.jpg not downloaded yet
2026-03-29 20:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3861/20483861/exterior_rear_passenger-1774695332352.jpg> (referer: None)
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8609%252F20208609%252Finterior_dashboard-1774621447244.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8609/20208609/interior_dashboard-1774621447244.jpg not downloaded yet
2026-03-29 20:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 135fa639-ed35-5477-9beb-7b5c043227b0 with identifier: 20159342
2026-03-29 20:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 135fa639-ed35-5477-9beb-7b5c043227b0 with scrape type 1
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 135fa639-ed35-5477-9beb-7b5c043227b0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9342%252F20159342%252Fexterior_front_driver-1774712771757.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9342/20159342/exterior_front_driver-1774712771757.jpg not downloaded yet
2026-03-29 20:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6a6b0be-1227-5c50-a744-7f01e3608d40 with identifier: 20352821
2026-03-29 20:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6a6b0be-1227-5c50-a744-7f01e3608d40 with scrape type 1
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6a6b0be-1227-5c50-a744-7f01e3608d40
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2821%252F20352821%252Fexterior_front_driver-1774778497364.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2821/20352821/exterior_front_driver-1774778497364.jpg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8609%252F20208609%252Finstrument_cluster-1774621427635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8609/20208609/instrument_cluster-1774621427635.jpg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9342%252F20159342%252Fexterior_rear_driver-1774716855393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9342/20159342/exterior_rear_driver-1774716855393.jpg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2821%252F20352821%252Fexterior_rear_driver-1774780427625.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2821/20352821/exterior_rear_driver-1774780427625.jpg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8609%252F20208609%252Finterior_boot-1774621446242.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8609/20208609/interior_boot-1774621446242.jpg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9342%252F20159342%252Fexterior_front_passenger-1774712766427.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9342/20159342/exterior_front_passenger-1774712766427.jpg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2821%252F20352821%252Fexterior_front_passenger-1774778578422.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2821/20352821/exterior_front_passenger-1774778578422.jpg not downloaded yet
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6eedd0>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6443cad9-a098-5282-beec-ddd4026de379/6443cad9-a098-5282-beec-ddd4026de379_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3861%252F20483861%252Fexterior_front_passenger-1774695331320.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3861/20483861/exterior_front_passenger-1774695331320.jpg saved to cache
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6443cad9-a098-5282-beec-ddd4026de379
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c830250>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf9fd8c-c735-5185-ad67-570269719e53/dcf9fd8c-c735-5185-ad67-570269719e53_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7643%252F20337643%252Finterior_front_seats-1774716410067.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7643/20337643/interior_front_seats-1774716410067.jpg saved to cache
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcf9fd8c-c735-5185-ad67-570269719e53
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c832610>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf9fd8c-c735-5185-ad67-570269719e53/dcf9fd8c-c735-5185-ad67-570269719e53_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7643%252F20337643%252Finterior_rear_seats-1774716263013.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7643/20337643/interior_rear_seats-1774716263013.jpg saved to cache
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dcf9fd8c-c735-5185-ad67-570269719e53
2026-03-29 20:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3861/20483861/interior_rear_seats-1774696229476.jpg> (referer: None)
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8609%252F20208609%252Fdocs_service_history-1774623256469.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd56c8b3888f614f6d409e32db425886f%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8609/20208609/docs_service_history-1774623256469.jpg?ixlib=js-3.8.0&auto=format&s=d56c8b3888f614f6d409e32db425886f not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9342%252F20159342%252Fexterior_rear_passenger-1774716872137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9342/20159342/exterior_rear_passenger-1774716872137.jpg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2821%252F20352821%252Fexterior_rear_passenger-1774780000013.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2821/20352821/exterior_rear_passenger-1774780000013.jpg not downloaded yet
2026-03-29 20:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7643/20337643/interior_dashboard-1774716287858.jpg> (referer: None)
2026-03-29 20:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19619181.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd1e790>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6443cad9-a098-5282-beec-ddd4026de379/6443cad9-a098-5282-beec-ddd4026de379_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3861%252F20483861%252Fexterior_rear_passenger-1774695332352.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3861/20483861/exterior_rear_passenger-1774695332352.jpg saved to cache
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6443cad9-a098-5282-beec-ddd4026de379
2026-03-29 20:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8609/20208609/exterior_front_driver-1774619755116.jpg> (referer: None)
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9342%252F20159342%252Finterior_front_seats-1774712867331.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9342/20159342/interior_front_seats-1774712867331.jpg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2821%252F20352821%252Finterior_front_seats-1774779135439.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2821/20352821/interior_front_seats-1774779135439.jpg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9342%252F20159342%252Finterior_rear_seats-1774712856839.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9342/20159342/interior_rear_seats-1774712856839.jpg not downloaded yet
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2821%252F20352821%252Finterior_rear_seats-1774779145636.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2821/20352821/interior_rear_seats-1774779145636.jpg not downloaded yet
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d593c10>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6443cad9-a098-5282-beec-ddd4026de379/6443cad9-a098-5282-beec-ddd4026de379_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3861%252F20483861%252Finterior_rear_seats-1774696229476.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3861/20483861/interior_rear_seats-1774696229476.jpg saved to cache
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6443cad9-a098-5282-beec-ddd4026de379
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1348/17411348/exterior_front_driver-1774775278392.jpeg> (referer: None)
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3861/20483861/docs_service_history-1774696389414.jpg?ixlib=js-3.8.0&auto=format&s=51bb501b86f63aec2f87da28c353ef2e> (referer: None)
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9342%252F20159342%252Finterior_dashboard-1774712888936.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9342/20159342/interior_dashboard-1774712888936.jpg not downloaded yet
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2821%252F20352821%252Finterior_dashboard-1774780024811.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2821/20352821/interior_dashboard-1774780024811.jpg not downloaded yet
2026-03-29 20:12:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d591b90>
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf9fd8c-c735-5185-ad67-570269719e53/dcf9fd8c-c735-5185-ad67-570269719e53_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7643%252F20337643%252Finterior_dashboard-1774716287858.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7643/20337643/interior_dashboard-1774716287858.jpg saved to cache
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dcf9fd8c-c735-5185-ad67-570269719e53
2026-03-29 20:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395 with identifier: 19619181
2026-03-29 20:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395 with scrape type 1
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9181%252F19619181%252Fexterior_front_driver-1774709779808.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9181/19619181/exterior_front_driver-1774709779808.jpg not downloaded yet
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3861/20483861/interior_dashboard-1774696242028.jpg> (referer: None)
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9342%252F20159342%252Finstrument_cluster-1774713027886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9342/20159342/instrument_cluster-1774713027886.jpg not downloaded yet
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2821%252F20352821%252Finstrument_cluster-1774779231698.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2821/20352821/instrument_cluster-1774779231698.jpg not downloaded yet
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9181%252F19619181%252Fexterior_rear_driver-1774713274500.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9181/19619181/exterior_rear_driver-1774713274500.jpg not downloaded yet
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddbdf90>
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bac2f7-6741-5a40-bd55-afeb67f86864/34bac2f7-6741-5a40-bd55-afeb67f86864_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8609%252F20208609%252Fexterior_front_driver-1774619755116.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8609/20208609/exterior_front_driver-1774619755116.jpg saved to cache
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34bac2f7-6741-5a40-bd55-afeb67f86864
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d06e810>
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68562d22-5449-5fe2-9b33-ad1173a6da9d/68562d22-5449-5fe2-9b33-ad1173a6da9d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1348%252F17411348%252Fexterior_front_driver-1774775278392.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1348/17411348/exterior_front_driver-1774775278392.jpeg saved to cache
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68562d22-5449-5fe2-9b33-ad1173a6da9d
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d053850>
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6443cad9-a098-5282-beec-ddd4026de379/6443cad9-a098-5282-beec-ddd4026de379_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3861%252F20483861%252Fdocs_service_history-1774696389414.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D51bb501b86f63aec2f87da28c353ef2e') HTTP/1.1" 204 0
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3861/20483861/docs_service_history-1774696389414.jpg?ixlib=js-3.8.0&auto=format&s=51bb501b86f63aec2f87da28c353ef2e saved to cache
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6443cad9-a098-5282-beec-ddd4026de379
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9342%252F20159342%252Finterior_boot-1774712911539.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9342/20159342/interior_boot-1774712911539.jpg not downloaded yet
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2821%252F20352821%252Finterior_boot-1774779191789.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2821/20352821/interior_boot-1774779191789.jpg not downloaded yet
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9181%252F19619181%252Fexterior_front_passenger-1774709796026.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9181/19619181/exterior_front_passenger-1774709796026.jpg not downloaded yet
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8609/20208609/exterior_rear_driver-1774619754582.jpg> (referer: None)
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9342%252F20159342%252Fdocs_service_history-1772957770147.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df4e2e1ba344c73adec94fe48e9c158f4%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9342/20159342/docs_service_history-1772957770147.jpg?ixlib=js-3.8.0&auto=format&s=f4e2e1ba344c73adec94fe48e9c158f4 already downloaded
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2821%252F20352821%252Fdocs_service_history-1774779265301.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D41173475624612db8c238914856a4ecb%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2821/20352821/docs_service_history-1774779265301.jpg?ixlib=js-3.8.0&auto=format&s=41173475624612db8c238914856a4ecb not downloaded yet
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9181%252F19619181%252Fexterior_rear_passenger-1774713288052.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9181/19619181/exterior_rear_passenger-1774713288052.jpg not downloaded yet
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca41e10>
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6443cad9-a098-5282-beec-ddd4026de379/6443cad9-a098-5282-beec-ddd4026de379_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3861%252F20483861%252Finterior_dashboard-1774696242028.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3861/20483861/interior_dashboard-1774696242028.jpg saved to cache
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6443cad9-a098-5282-beec-ddd4026de379
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3861/20483861/interior_boot-1774696232954.jpg> (referer: None)
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8609/20208609/exterior_front_passenger-1774619758987.jpg> (referer: None)
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9181%252F19619181%252Finterior_front_seats-1774710323188.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9181/19619181/interior_front_seats-1774710323188.jpg not downloaded yet
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f62c1d0>
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bac2f7-6741-5a40-bd55-afeb67f86864/34bac2f7-6741-5a40-bd55-afeb67f86864_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8609%252F20208609%252Fexterior_rear_driver-1774619754582.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8609/20208609/exterior_rear_driver-1774619754582.jpg saved to cache
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34bac2f7-6741-5a40-bd55-afeb67f86864
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9181%252F19619181%252Finterior_rear_seats-1774710324073.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9181/19619181/interior_rear_seats-1774710324073.jpg not downloaded yet
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9181%252F19619181%252Finterior_dashboard-1774711252201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9181/19619181/interior_dashboard-1774711252201.jpg not downloaded yet
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dde6dd0>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6443cad9-a098-5282-beec-ddd4026de379/6443cad9-a098-5282-beec-ddd4026de379_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3861%252F20483861%252Finterior_boot-1774696232954.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3861/20483861/interior_boot-1774696232954.jpg saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6443cad9-a098-5282-beec-ddd4026de379
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f389590>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bac2f7-6741-5a40-bd55-afeb67f86864/34bac2f7-6741-5a40-bd55-afeb67f86864_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8609%252F20208609%252Fexterior_front_passenger-1774619758987.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8609/20208609/exterior_front_passenger-1774619758987.jpg saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34bac2f7-6741-5a40-bd55-afeb67f86864
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9181%252F19619181%252Finstrument_cluster-1774710374734.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9181/19619181/instrument_cluster-1774710374734.jpg not downloaded yet
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9181%252F19619181%252Finterior_boot-1774713306781.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9181/19619181/interior_boot-1774713306781.jpg not downloaded yet
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9181/19619181/exterior_front_driver-1774709779808.jpg> (referer: None)
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9181%252F19619181%252Fdocs_service_history-1774713351220.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De15ed6fa52e60e62c90a4a0cf61bdd84%27 HTTP/1.1" 200 None
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9181/19619181/docs_service_history-1774713351220.jpg?ixlib=js-3.8.0&auto=format&s=e15ed6fa52e60e62c90a4a0cf61bdd84 not downloaded yet
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9181/19619181/exterior_front_passenger-1774709796026.jpg> (referer: None)
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9181/19619181/exterior_rear_driver-1774713274500.jpg> (referer: None)
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9181/19619181/exterior_rear_passenger-1774713288052.jpg> (referer: None)
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1348/17411348/17411348-exterior_front_passenger-modified-1774778226206.jpeg> (referer: None)
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9181/19619181/interior_front_seats-1774710323188.jpg> (referer: None)
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4499d0>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9181%252F19619181%252Fexterior_front_driver-1774709779808.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9181/19619181/exterior_front_driver-1774709779808.jpg saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2821/20352821/instrument_cluster-1774779231698.jpg> (referer: None)
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c2b50>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9181%252F19619181%252Fexterior_front_passenger-1774709796026.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9181/19619181/exterior_front_passenger-1774709796026.jpg saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c2910>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9181%252F19619181%252Fexterior_rear_driver-1774713274500.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9181/19619181/exterior_rear_driver-1774713274500.jpg saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5bd090>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9181%252F19619181%252Fexterior_rear_passenger-1774713288052.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9181/19619181/exterior_rear_passenger-1774713288052.jpg saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca731d0>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68562d22-5449-5fe2-9b33-ad1173a6da9d/68562d22-5449-5fe2-9b33-ad1173a6da9d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1348%252F17411348%252F17411348-exterior_front_passenger-modified-1774778226206.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1348/17411348/17411348-exterior_front_passenger-modified-1774778226206.jpeg saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68562d22-5449-5fe2-9b33-ad1173a6da9d
2026-03-29 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1476&page=41&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c1bd0>
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9181%252F19619181%252Finterior_front_seats-1774710323188.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9181/19619181/interior_front_seats-1774710323188.jpg saved to cache
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395
2026-03-29 20:12:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5bfb50>
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a6b0be-1227-5c50-a744-7f01e3608d40/c6a6b0be-1227-5c50-a744-7f01e3608d40_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2821%252F20352821%252Finstrument_cluster-1774779231698.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2821/20352821/instrument_cluster-1774779231698.jpg saved to cache
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6a6b0be-1227-5c50-a744-7f01e3608d40
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20486464
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486464%27 HTTP/1.1" 200 None
2026-03-29 20:12:44 [motorway.uk] INFO: Scrape type for 20486464: 1
2026-03-29 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2821/20352821/interior_dashboard-1774780024811.jpg> (referer: None)
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20440188
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 19993213
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719993213%27 HTTP/1.1" 200 None
2026-03-29 20:12:44 [motorway.uk] INFO: Scrape type for 19993213: 1
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20487855
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20286408
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20343631
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720343631%27 HTTP/1.1" 200 None
2026-03-29 20:12:44 [motorway.uk] INFO: Scrape type for 20343631: 1
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 18279854
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718279854%27 HTTP/1.1" 200 None
2026-03-29 20:12:44 [motorway.uk] INFO: Scrape type for 18279854: 1
2026-03-29 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2821/20352821/interior_boot-1774779191789.jpg> (referer: None)
2026-03-29 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9181/19619181/docs_service_history-1774713351220.jpg?ixlib=js-3.8.0&auto=format&s=e15ed6fa52e60e62c90a4a0cf61bdd84> (referer: None)
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20486910
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20396662
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20497111
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720497111%27 HTTP/1.1" 200 None
2026-03-29 20:12:44 [motorway.uk] INFO: Scrape type for 20497111: 1
2026-03-29 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9181/19619181/instrument_cluster-1774710374734.jpg> (referer: None)
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 18991251
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 19358574
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 19916190
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20386914
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20473571
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473571%27 HTTP/1.1" 200 None
2026-03-29 20:12:44 [motorway.uk] INFO: Scrape type for 20473571: 1
2026-03-29 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9342/20159342/instrument_cluster-1774713027886.jpg> (referer: None)
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20372718
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 19803994
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719803994%27 HTTP/1.1" 200 None
2026-03-29 20:12:44 [motorway.uk] INFO: Scrape type for 19803994: 1
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c756b10>
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a6b0be-1227-5c50-a744-7f01e3608d40/c6a6b0be-1227-5c50-a744-7f01e3608d40_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2821%252F20352821%252Finterior_dashboard-1774780024811.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2821/20352821/interior_dashboard-1774780024811.jpg saved to cache
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6a6b0be-1227-5c50-a744-7f01e3608d40
2026-03-29 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9181/19619181/interior_dashboard-1774711252201.jpg> (referer: None)
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 6427001
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 18641808
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20288623
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20475034
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 18052166
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718052166%27 HTTP/1.1" 200 None
2026-03-29 20:12:44 [motorway.uk] INFO: Scrape type for 18052166: 1
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20487961
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487961%27 HTTP/1.1" 200 None
2026-03-29 20:12:44 [motorway.uk] INFO: Scrape type for 20487961: 1
2026-03-29 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9181/19619181/interior_boot-1774713306781.jpg> (referer: None)
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 19939510
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20461256
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 19966592
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 18928323
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718928323%27 HTTP/1.1" 200 None
2026-03-29 20:12:44 [motorway.uk] INFO: Scrape type for 18928323: 1
2026-03-29 20:12:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5bd910>
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a6b0be-1227-5c50-a744-7f01e3608d40/c6a6b0be-1227-5c50-a744-7f01e3608d40_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2821%252F20352821%252Finterior_boot-1774779191789.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2821/20352821/interior_boot-1774779191789.jpg saved to cache
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6a6b0be-1227-5c50-a744-7f01e3608d40
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6be750>
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9181%252F19619181%252Fdocs_service_history-1774713351220.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De15ed6fa52e60e62c90a4a0cf61bdd84') HTTP/1.1" 204 0
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9181/19619181/docs_service_history-1774713351220.jpg?ixlib=js-3.8.0&auto=format&s=e15ed6fa52e60e62c90a4a0cf61bdd84 saved to cache
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da845d0>
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9181%252F19619181%252Finstrument_cluster-1774710374734.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9181/19619181/instrument_cluster-1774710374734.jpg saved to cache
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395
2026-03-29 20:12:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x004\x11\x94\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xc0 \x003\xea\x82\x00\x00\x00\x00'
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc83050>
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135fa639-ed35-5477-9beb-7b5c043227b0/135fa639-ed35-5477-9beb-7b5c043227b0_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9342%252F20159342%252Finstrument_cluster-1774713027886.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9342/20159342/instrument_cluster-1774713027886.jpg saved to cache
2026-03-29 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 135fa639-ed35-5477-9beb-7b5c043227b0
2026-03-29 20:12:45 [motorway.uk] INFO: Found listing with ID: 20009911
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720009911%27 HTTP/1.1" 200 None
2026-03-29 20:12:45 [motorway.uk] INFO: Scrape type for 20009911: 1
2026-03-29 20:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:45 [motorway.uk] INFO: Found listing with ID: 20350681
2026-03-29 20:12:45 [motorway.uk] INFO: Found listing with ID: 20480204
2026-03-29 20:12:45 [motorway.uk] INFO: Found listing with ID: 17069635
2026-03-29 20:12:45 [motorway.uk] INFO: Found listing with ID: 19856222
2026-03-29 20:12:45 [motorway.uk] INFO: Found listing with ID: 19751356
2026-03-29 20:12:45 [motorway.uk] INFO: Found listing with ID: 6251802
2026-03-29 20:12:45 [motorway.uk] INFO: Found listing with ID: 16994244
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716994244%27 HTTP/1.1" 200 None
2026-03-29 20:12:45 [motorway.uk] INFO: Scrape type for 16994244: 1
2026-03-29 20:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2821/20352821/interior_rear_seats-1774779145636.jpg> (referer: None)
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d478d50>
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9181%252F19619181%252Finterior_dashboard-1774711252201.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9181/19619181/interior_dashboard-1774711252201.jpg saved to cache
2026-03-29 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f424650>
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9181%252F19619181%252Finterior_boot-1774713306781.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9181/19619181/interior_boot-1774713306781.jpg saved to cache
2026-03-29 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395
2026-03-29 20:12:45 [motorway.uk] INFO: Found listing with ID: 20200314
2026-03-29 20:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d562850>
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a6b0be-1227-5c50-a744-7f01e3608d40/c6a6b0be-1227-5c50-a744-7f01e3608d40_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2821%252F20352821%252Finterior_rear_seats-1774779145636.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2821/20352821/interior_rear_seats-1774779145636.jpg saved to cache
2026-03-29 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6a6b0be-1227-5c50-a744-7f01e3608d40
2026-03-29 20:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9342/20159342/interior_rear_seats-1774712856839.jpg> (referer: None)
2026-03-29 20:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9181/19619181/interior_rear_seats-1774710324073.jpg> (referer: None)
2026-03-29 20:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9342/20159342/interior_dashboard-1774712888936.jpg> (referer: None)
2026-03-29 20:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9342/20159342/interior_boot-1774712911539.jpg> (referer: None)
2026-03-29 20:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2821/20352821/docs_service_history-1774779265301.jpg?ixlib=js-3.8.0&auto=format&s=41173475624612db8c238914856a4ecb> (referer: None)
2026-03-29 20:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2821/20352821/exterior_rear_passenger-1774780000013.jpg> (referer: None)
2026-03-29 20:12:45 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1790/16171790/docs_service_history-1774712139989.png?ixlib=js-3.8.0&auto=format&s=f9b8226d45ceec9d5f3981a2a8114d25>.
2026-03-29 20:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2821/20352821/interior_front_seats-1774779135439.jpg> (referer: None)
2026-03-29 20:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9342/20159342/interior_front_seats-1774712867331.jpg> (referer: None)
2026-03-29 20:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1790/16171790/docs_service_history-1774712139989.png?ixlib=js-3.8.0&auto=format&s=f9b8226d45ceec9d5f3981a2a8114d25> (referer: None)
2026-03-29 20:12:45 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:45 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:45 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00E\xad\xdc\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\t\xa8\n\x00Ew\x85\x00\x00\x00\x00'
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6dfb50>
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135fa639-ed35-5477-9beb-7b5c043227b0/135fa639-ed35-5477-9beb-7b5c043227b0_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9342%252F20159342%252Finterior_rear_seats-1774712856839.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9342/20159342/interior_rear_seats-1774712856839.jpg saved to cache
2026-03-29 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 135fa639-ed35-5477-9beb-7b5c043227b0
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc80e90>
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9181%252F19619181%252Finterior_rear_seats-1774710324073.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9181/19619181/interior_rear_seats-1774710324073.jpg saved to cache
2026-03-29 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395
2026-03-29 20:12:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395, skipping ID generation
2026-03-29 20:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395 with scrape type 1
2026-03-29 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395 sending to next pipeline
2026-03-29 20:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395, identifier: 19619181
2026-03-29 20:12:46 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:46 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:46 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00=\xc6\xd1\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\t\xa1\x9e\x00=\x9c+\x00\x00\x00\x00'
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5fa450>
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135fa639-ed35-5477-9beb-7b5c043227b0/135fa639-ed35-5477-9beb-7b5c043227b0_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9342%252F20159342%252Finterior_dashboard-1774712888936.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9342/20159342/interior_dashboard-1774712888936.jpg saved to cache
2026-03-29 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 135fa639-ed35-5477-9beb-7b5c043227b0
2026-03-29 20:12:46 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:46 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:46 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00R!/\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\nG\x07\x00Q\xf6\x04\x00\x00\x00\x00'
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d13d910>
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135fa639-ed35-5477-9beb-7b5c043227b0/135fa639-ed35-5477-9beb-7b5c043227b0_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9342%252F20159342%252Finterior_boot-1774712911539.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9342/20159342/interior_boot-1774712911539.jpg saved to cache
2026-03-29 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 135fa639-ed35-5477-9beb-7b5c043227b0
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c737210>
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a6b0be-1227-5c50-a744-7f01e3608d40/c6a6b0be-1227-5c50-a744-7f01e3608d40_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2821%252F20352821%252Fdocs_service_history-1774779265301.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D41173475624612db8c238914856a4ecb') HTTP/1.1" 204 0
2026-03-29 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2821/20352821/docs_service_history-1774779265301.jpg?ixlib=js-3.8.0&auto=format&s=41173475624612db8c238914856a4ecb saved to cache
2026-03-29 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6a6b0be-1227-5c50-a744-7f01e3608d40
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddd4510>
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a6b0be-1227-5c50-a744-7f01e3608d40/c6a6b0be-1227-5c50-a744-7f01e3608d40_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2821%252F20352821%252Fexterior_rear_passenger-1774780000013.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2821/20352821/exterior_rear_passenger-1774780000013.jpg saved to cache
2026-03-29 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6a6b0be-1227-5c50-a744-7f01e3608d40
2026-03-29 20:12:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca70e90>
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a6b0be-1227-5c50-a744-7f01e3608d40/c6a6b0be-1227-5c50-a744-7f01e3608d40_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2821%252F20352821%252Finterior_front_seats-1774779135439.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2821/20352821/interior_front_seats-1774779135439.jpg saved to cache
2026-03-29 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6a6b0be-1227-5c50-a744-7f01e3608d40
2026-03-29 20:12:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00ID\xc4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07c\xd2\x00I\x15\xff\x00\x00\x00\x00'
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5fa450>
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135fa639-ed35-5477-9beb-7b5c043227b0/135fa639-ed35-5477-9beb-7b5c043227b0_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9342%252F20159342%252Finterior_front_seats-1774712867331.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9342/20159342/interior_front_seats-1774712867331.jpg saved to cache
2026-03-29 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 135fa639-ed35-5477-9beb-7b5c043227b0
2026-03-29 20:12:47 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:12:47 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-29 20:12:47 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d13d8d0>
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0945568e-b87a-5089-88f4-996eedbcfcca/0945568e-b87a-5089-88f4-996eedbcfcca_image_9.png HTTP/1.1" 201 0
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1790%252F16171790%252Fdocs_service_history-1774712139989.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df9b8226d45ceec9d5f3981a2a8114d25') HTTP/1.1" 204 0
2026-03-29 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1790/16171790/docs_service_history-1774712139989.png?ixlib=js-3.8.0&auto=format&s=f9b8226d45ceec9d5f3981a2a8114d25 saved to cache
2026-03-29 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0945568e-b87a-5089-88f4-996eedbcfcca
2026-03-29 20:12:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395 with identifier: 19619181
2026-03-29 20:12:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395 with identifier: 19619181
2026-03-29 20:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5e1bbc4f-05b8-5cb2-a101-2aebf48cb395 with identifier: 19619181 to the API
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9181/19619181/interior_rear_seats-1774710324073.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '5e1bbc4f-05b8-5cb2-a101-2aebf48cb395',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VA65 VWX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19619181',
'listing': 'auction',
'location': 'Bristol City Bristol',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 67708,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516407,
'Height': 2225,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9181/19619181/exterior_front_driver-1774709779808.jpg',
'Width': 2967},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1234700,
'Height': 2583,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9181/19619181/exterior_rear_driver-1774713274500.jpg',
'Width': 3444},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 756237,
'Height': 2120,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9181/19619181/exterior_front_passenger-1774709796026.jpg',
'Width': 2827},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 950663,
'Height': 2246,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9181/19619181/exterior_rear_passenger-1774713288052.jpg',
'Width': 2995},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1788846,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9181/19619181/interior_front_seats-1774710323188.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1155643,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9181/19619181/interior_rear_seats-1774710324073.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1265913,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9181/19619181/interior_dashboard-1774711252201.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1027033,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9181/19619181/instrument_cluster-1774710374734.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1509284,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9181/19619181/interior_boot-1774713306781.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e1bbc4f-05b8-5cb2-a101-2aebf48cb395/5e1bbc4f-05b8-5cb2-a101-2aebf48cb395_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 870075,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9181/19619181/docs_service_history-1774713351220.jpg?ixlib=js-3.8.0&auto=format&s=e15ed6fa52e60e62c90a4a0cf61bdd84',
'Width': 3840}],
'price': 6027,
'price_includes_vat': False,
'registration_date': '2016-01-27',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai Tekna DCI 4X4',
'transmission': 'manual',
'trim': 'Tekna DCI 4X4',
'vin': 'SJNFDNJ11U1609670',
'year': 2016}
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719619181%27 HTTP/1.1" 200 None
2026-03-29 20:12:48 [motorway.uk] INFO: Saving data for 19619181: {'created_time': 1774815168.372876, 'last_price_update_time': 1774815168.372887, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19619181') HTTP/1.1" 204 0
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1512&page=42&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 19943403
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20465481
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720465481%27 HTTP/1.1" 200 None
2026-03-29 20:12:48 [motorway.uk] INFO: Scrape type for 20465481: 1
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 19602701
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 19736042
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719736042%27 HTTP/1.1" 200 None
2026-03-29 20:12:48 [motorway.uk] INFO: Scrape type for 19736042: 1
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20475976
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475976%27 HTTP/1.1" 200 None
2026-03-29 20:12:48 [motorway.uk] INFO: Scrape type for 20475976: 1
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 8134023
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 18661288
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 4637064
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 9361295
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279361295%27 HTTP/1.1" 200 None
2026-03-29 20:12:48 [motorway.uk] INFO: Scrape type for 9361295: 1
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20320814
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20076402
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20391441
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20455567
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 12337686
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 16283042
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20488544
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 7801463
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277801463%27 HTTP/1.1" 200 None
2026-03-29 20:12:48 [motorway.uk] INFO: Scrape type for 7801463: 1
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 19420355
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 19358892
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20427982
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 19234910
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20380457
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 5025216
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 3991169
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 9765536
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 13033676
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20499852
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 18764881
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718764881%27 HTTP/1.1" 200 None
2026-03-29 20:12:48 [motorway.uk] INFO: Scrape type for 18764881: 1
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20490232
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490232%27 HTTP/1.1" 200 None
2026-03-29 20:12:48 [motorway.uk] INFO: Scrape type for 20490232: 1
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20084784
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 14381280
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20489994
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20471821
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 19513424
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20467422
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20191328
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18928323.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487961.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19803994.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20473571.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8609/20208609/docs_service_history-1774623256469.jpg?ixlib=js-3.8.0&auto=format&s=d56c8b3888f614f6d409e32db425886f> (referer: None)
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2821/20352821/exterior_front_passenger-1774778578422.jpg> (referer: None)
2026-03-29 20:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f1c31e-2b4c-5c29-bcd3-129bd305b003 with identifier: 18928323
2026-03-29 20:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81f1c31e-2b4c-5c29-bcd3-129bd305b003 with scrape type 1
2026-03-29 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81f1c31e-2b4c-5c29-bcd3-129bd305b003
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F18928323%252Fexterior_front_driver-1774014355008.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/18928323/exterior_front_driver-1774014355008.jpg not downloaded yet
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F18928323%252Fexterior_rear_driver-1774014387267.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/18928323/exterior_rear_driver-1774014387267.jpg not downloaded yet
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F18928323%252Fexterior_front_passenger-1774014438640.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/18928323/exterior_front_passenger-1774014438640.jpg not downloaded yet
2026-03-29 20:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23534d54-b89d-5f06-849e-113069d9b36b with identifier: 20487961
2026-03-29 20:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23534d54-b89d-5f06-849e-113069d9b36b with scrape type 1
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23534d54-b89d-5f06-849e-113069d9b36b
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7961%252F20487961%252Fexterior_front_driver-1774702732267.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7961/20487961/exterior_front_driver-1774702732267.jpg not downloaded yet
2026-03-29 20:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c91a75f-dd58-52f6-850c-e5ea0725cd12 with identifier: 19803994
2026-03-29 20:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c91a75f-dd58-52f6-850c-e5ea0725cd12 with scrape type 1
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c91a75f-dd58-52f6-850c-e5ea0725cd12
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3994%252F19803994%252Fexterior_front_driver-1772634300582.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3994/19803994/exterior_front_driver-1772634300582.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F18928323%252Fexterior_rear_passenger-1774014423953.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/18928323/exterior_rear_passenger-1774014423953.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7961%252F20487961%252Fexterior_rear_driver-1774702735118.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7961/20487961/exterior_rear_driver-1774702735118.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3994%252F19803994%252Fexterior_rear_driver-1772634318462.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3994/19803994/exterior_rear_driver-1772634318462.jpg not downloaded yet
2026-03-29 20:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20497111.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e44dc507-334f-5a4a-a07c-abe5df9e5bfc with identifier: 20473571
2026-03-29 20:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e44dc507-334f-5a4a-a07c-abe5df9e5bfc with scrape type 1
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e44dc507-334f-5a4a-a07c-abe5df9e5bfc
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20473571%252Fexterior_front_driver-1774709219380.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20473571/exterior_front_driver-1774709219380.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8323%252F18928323%252Finterior_front_seats-1774014867405.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8323/18928323/interior_front_seats-1774014867405.jpg not downloaded yet
2026-03-29 20:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18052166.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7961%252F20487961%252Fexterior_front_passenger-1774702740387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7961/20487961/exterior_front_passenger-1774702740387.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3994%252F19803994%252Fexterior_front_passenger-1772634338870.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3994/19803994/exterior_front_passenger-1772634338870.jpg not downloaded yet
2026-03-29 20:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20473571%252Fexterior_rear_driver-1774709220674.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20473571/exterior_rear_driver-1774709220674.jpg not downloaded yet
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1f5c50>
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bac2f7-6741-5a40-bd55-afeb67f86864/34bac2f7-6741-5a40-bd55-afeb67f86864_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8609%252F20208609%252Fdocs_service_history-1774623256469.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd56c8b3888f614f6d409e32db425886f') HTTP/1.1" 204 0
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8609/20208609/docs_service_history-1774623256469.jpg?ixlib=js-3.8.0&auto=format&s=d56c8b3888f614f6d409e32db425886f saved to cache
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34bac2f7-6741-5a40-bd55-afeb67f86864
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c813650>
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a6b0be-1227-5c50-a744-7f01e3608d40/c6a6b0be-1227-5c50-a744-7f01e3608d40_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2821%252F20352821%252Fexterior_front_passenger-1774778578422.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2821/20352821/exterior_front_passenger-1774778578422.jpg saved to cache
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6a6b0be-1227-5c50-a744-7f01e3608d40
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8323%252F18928323%252Finterior_rear_seats-1774014892452.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8323/18928323/interior_rear_seats-1774014892452.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7961%252F20487961%252Fexterior_rear_passenger-1774702738397.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7961/20487961/exterior_rear_passenger-1774702738397.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3994%252F19803994%252Fexterior_rear_passenger-1772634329005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3994/19803994/exterior_rear_passenger-1772634329005.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20473571%252Fexterior_front_passenger-1774709216373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20473571/exterior_front_passenger-1774709216373.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8323%252F18928323%252Finterior_dashboard-1774697042319.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8323/18928323/interior_dashboard-1774697042319.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7961%252F20487961%252Finterior_front_seats-1774703983468.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7961/20487961/interior_front_seats-1774703983468.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3994%252F19803994%252Finterior_front_seats-1773042952563.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3994/19803994/interior_front_seats-1773042952563.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20473571%252Fexterior_rear_passenger-1774709226032.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20473571/exterior_rear_passenger-1774709226032.jpg not downloaded yet
2026-03-29 20:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a06908e6-d471-5211-9a3d-c5ce49f9d2b7 with identifier: 20497111
2026-03-29 20:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a06908e6-d471-5211-9a3d-c5ce49f9d2b7 with scrape type 1
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a06908e6-d471-5211-9a3d-c5ce49f9d2b7
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7111%252F20497111%252Fexterior_front_driver-1774778179262.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7111/20497111/exterior_front_driver-1774778179262.jpg not downloaded yet
2026-03-29 20:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfd08257-3969-5167-948e-8be6c5f3c4cd with identifier: 18052166
2026-03-29 20:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfd08257-3969-5167-948e-8be6c5f3c4cd with scrape type 1
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cfd08257-3969-5167-948e-8be6c5f3c4cd
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2166%252F18052166%252F18052166-exterior_front_driver-modified-1774715507422.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2166/18052166/18052166-exterior_front_driver-modified-1774715507422.jpeg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8323%252F18928323%252Finterior_boot-1774015011441.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8323/18928323/interior_boot-1774015011441.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7961%252F20487961%252Finterior_rear_seats-1774703916937.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7961/20487961/interior_rear_seats-1774703916937.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3994%252F19803994%252Finterior_rear_seats-1773042966130.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3994/19803994/interior_rear_seats-1773042966130.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3571%252F20473571%252Finterior_front_seats-1774712241176.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3571/20473571/interior_front_seats-1774712241176.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7111%252F20497111%252Fexterior_rear_driver-1774778194893.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7111/20497111/exterior_rear_driver-1774778194893.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2166%252F18052166%252F18052166-exterior_rear_driver-modified-1774715524961.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2166/18052166/18052166-exterior_rear_driver-modified-1774715524961.jpeg not downloaded yet
2026-03-29 20:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9342/20159342/exterior_rear_passenger-1774716872137.jpg> (referer: None)
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8323%252F18928323%252Fdocs_service_history-1774528963849.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1a99fac42b925bfd43de2c1e11617efe%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8323/18928323/docs_service_history-1774528963849.jpg?ixlib=js-3.8.0&auto=format&s=1a99fac42b925bfd43de2c1e11617efe not downloaded yet
2026-03-29 20:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3571/20473571/exterior_rear_driver-1774709220674.jpg> (referer: None)
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7961%252F20487961%252Finterior_dashboard-1774705818539.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7961/20487961/interior_dashboard-1774705818539.jpg not downloaded yet
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3994%252F19803994%252Finterior_dashboard-1773043008433.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3994/19803994/interior_dashboard-1773043008433.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20473571%252Finterior_dashboard-1774709263927.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20473571/interior_dashboard-1774709263927.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7111%252F20497111%252Fexterior_front_passenger-1774779718618.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7111/20497111/exterior_front_passenger-1774779718618.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2166%252F18052166%252F18052166-exterior_front_passenger-modified-1774715541533.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2166/18052166/18052166-exterior_front_passenger-modified-1774715541533.jpeg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8323%252F18928323%252Fdamage_scratches-1774014515908.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8323/18928323/damage_scratches-1774014515908.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7961%252F20487961%252Finstrument_cluster-1774703722905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7961/20487961/instrument_cluster-1774703722905.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3994%252F19803994%252Finstrument_cluster-1773043060692.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3994/19803994/instrument_cluster-1773043060692.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20473571%252Finstrument_cluster-1774709428475.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20473571/instrument_cluster-1774709428475.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7111%252F20497111%252Fexterior_rear_passenger-1774778228839.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7111/20497111/exterior_rear_passenger-1774778228839.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2166%252F18052166%252F18052166-exterior_rear_passenger-modified-1774715551878.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2166/18052166/18052166-exterior_rear_passenger-modified-1774715551878.jpeg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7961%252F20487961%252Finterior_boot-1774703915248.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7961/20487961/interior_boot-1774703915248.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3994%252F19803994%252Finterior_boot-1773043040224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3994/19803994/interior_boot-1773043040224.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3571%252F20473571%252Finterior_boot-1774709260893.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3571/20473571/interior_boot-1774709260893.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7111%252F20497111%252Finterior_front_seats-1774778606285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7111/20497111/interior_front_seats-1774778606285.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2166%252F18052166%252Finterior_front_seats-1774712614735.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2166/18052166/interior_front_seats-1774712614735.jpeg not downloaded yet
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c791b10>
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135fa639-ed35-5477-9beb-7b5c043227b0/135fa639-ed35-5477-9beb-7b5c043227b0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9342%252F20159342%252Fexterior_rear_passenger-1774716872137.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9342/20159342/exterior_rear_passenger-1774716872137.jpg saved to cache
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 135fa639-ed35-5477-9beb-7b5c043227b0
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d302190>
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44dc507-334f-5a4a-a07c-abe5df9e5bfc/e44dc507-334f-5a4a-a07c-abe5df9e5bfc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20473571%252Fexterior_rear_driver-1774709220674.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20473571/exterior_rear_driver-1774709220674.jpg saved to cache
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e44dc507-334f-5a4a-a07c-abe5df9e5bfc
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7961%252F20487961%252Fdamage_scratches-1774703021280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7961/20487961/damage_scratches-1774703021280.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3994%252F19803994%252Fdocs_service_history-1773043595085.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4842ef72fa6771782826a2e92ecd5d47%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3994/19803994/docs_service_history-1773043595085.jpg?ixlib=js-3.8.0&auto=format&s=4842ef72fa6771782826a2e92ecd5d47 not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3571%252F20473571%252Fdocs_service_history-1774712300381.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8e53fa9a6c04002db3cef3169a6ef95b%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3571/20473571/docs_service_history-1774712300381.jpg?ixlib=js-3.8.0&auto=format&s=8e53fa9a6c04002db3cef3169a6ef95b not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7111%252F20497111%252Finterior_rear_seats-1774778712709.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7111/20497111/interior_rear_seats-1774778712709.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2166%252F18052166%252Finterior_rear_seats-1774712644988.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2166/18052166/interior_rear_seats-1774712644988.jpeg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3571%252F20473571%252Fdocs_service_history-1774709286625.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0354db2483271c64476f1faffdebca70%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3571/20473571/docs_service_history-1774709286625.jpg?ixlib=js-3.8.0&auto=format&s=0354db2483271c64476f1faffdebca70 not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7111%252F20497111%252Finterior_dashboard-1774779482624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7111/20497111/interior_dashboard-1774779482624.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F18052166%252Finterior_dashboard-1774712770797.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/18052166/interior_dashboard-1774712770797.jpeg not downloaded yet
2026-03-29 20:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9342/20159342/exterior_front_passenger-1774712766427.jpg> (referer: None)
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7111%252F20497111%252Finterior_boot-1774778653748.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7111/20497111/interior_boot-1774778653748.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F18052166%252Finstrument_cluster-1774712787320.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/18052166/instrument_cluster-1774712787320.jpeg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7111%252F20497111%252Fdocs_service_history-1774779208654.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8f0f9c349b58dd76428367477f0e13b3%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7111/20497111/docs_service_history-1774779208654.jpg?ixlib=js-3.8.0&auto=format&s=8f0f9c349b58dd76428367477f0e13b3 not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2166%252F18052166%252Finterior_boot-1774712697432.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2166/18052166/interior_boot-1774712697432.jpeg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7111%252F20497111%252Fdamage_scratches-1774778273644.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7111/20497111/damage_scratches-1774778273644.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2166%252F18052166%252Fdocs_service_history-1774713142004.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8cf059d91051dbf067a8878ee939fd47%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2166/18052166/docs_service_history-1774713142004.jpeg?ixlib=js-3.8.0&auto=format&s=8cf059d91051dbf067a8878ee939fd47 not downloaded yet
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca61590>
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135fa639-ed35-5477-9beb-7b5c043227b0/135fa639-ed35-5477-9beb-7b5c043227b0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9342%252F20159342%252Fexterior_front_passenger-1774712766427.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9342/20159342/exterior_front_passenger-1774712766427.jpg saved to cache
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 135fa639-ed35-5477-9beb-7b5c043227b0
2026-03-29 20:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3994/19803994/exterior_front_passenger-1772634338870.jpg> (referer: None)
2026-03-29 20:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8323/18928323/interior_rear_seats-1774014892452.jpg> (referer: None)
2026-03-29 20:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2166/18052166/interior_dashboard-1774712770797.jpeg> (referer: None)
2026-03-29 20:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2166/18052166/interior_front_seats-1774712614735.jpeg> (referer: None)
2026-03-29 20:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7111/20497111/interior_front_seats-1774778606285.jpg> (referer: None)
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7db290>
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c91a75f-dd58-52f6-850c-e5ea0725cd12/7c91a75f-dd58-52f6-850c-e5ea0725cd12_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3994%252F19803994%252Fexterior_front_passenger-1772634338870.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3994/19803994/exterior_front_passenger-1772634338870.jpg saved to cache
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c91a75f-dd58-52f6-850c-e5ea0725cd12
2026-03-29 20:12:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c80f490>
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f1c31e-2b4c-5c29-bcd3-129bd305b003/81f1c31e-2b4c-5c29-bcd3-129bd305b003_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8323%252F18928323%252Finterior_rear_seats-1774014892452.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8323/18928323/interior_rear_seats-1774014892452.jpg saved to cache
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81f1c31e-2b4c-5c29-bcd3-129bd305b003
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0dc1d0>
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd08257-3969-5167-948e-8be6c5f3c4cd/cfd08257-3969-5167-948e-8be6c5f3c4cd_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F18052166%252Finterior_dashboard-1774712770797.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/18052166/interior_dashboard-1774712770797.jpeg saved to cache
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cfd08257-3969-5167-948e-8be6c5f3c4cd
2026-03-29 20:12:51 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:51 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:51 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00(g\xf9\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\re\x00(]g\x00\x00\x00\x00'
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d19f3d0>
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd08257-3969-5167-948e-8be6c5f3c4cd/cfd08257-3969-5167-948e-8be6c5f3c4cd_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2166%252F18052166%252Finterior_front_seats-1774712614735.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2166/18052166/interior_front_seats-1774712614735.jpeg saved to cache
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cfd08257-3969-5167-948e-8be6c5f3c4cd
2026-03-29 20:12:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f38cc90>
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06908e6-d471-5211-9a3d-c5ce49f9d2b7/a06908e6-d471-5211-9a3d-c5ce49f9d2b7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7111%252F20497111%252Finterior_front_seats-1774778606285.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7111/20497111/interior_front_seats-1774778606285.jpg saved to cache
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a06908e6-d471-5211-9a3d-c5ce49f9d2b7
2026-03-29 20:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20343631.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1548&page=43&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2166/18052166/docs_service_history-1774713142004.jpeg?ixlib=js-3.8.0&auto=format&s=8cf059d91051dbf067a8878ee939fd47> (referer: None)
2026-03-29 20:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f81403c-056b-58e2-b719-f9c0bb4d05b3 with identifier: 20343631
2026-03-29 20:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f81403c-056b-58e2-b719-f9c0bb4d05b3 with scrape type 1
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f81403c-056b-58e2-b719-f9c0bb4d05b3
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3631%252F20343631%252Fexterior_front_driver-1774701850121.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3631/20343631/exterior_front_driver-1774701850121.jpg not downloaded yet
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3631%252F20343631%252Fexterior_rear_driver-1774704589200.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3631/20343631/exterior_rear_driver-1774704589200.jpg not downloaded yet
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3631%252F20343631%252Fexterior_front_passenger-1774701855551.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3631/20343631/exterior_front_passenger-1774701855551.jpg not downloaded yet
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20440595
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20484011
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20329533
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 19798498
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719798498%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [motorway.uk] INFO: Scrape type for 19798498: 1
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d19e850>
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd08257-3969-5167-948e-8be6c5f3c4cd/cfd08257-3969-5167-948e-8be6c5f3c4cd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2166%252F18052166%252Fdocs_service_history-1774713142004.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8cf059d91051dbf067a8878ee939fd47') HTTP/1.1" 204 0
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2166/18052166/docs_service_history-1774713142004.jpeg?ixlib=js-3.8.0&auto=format&s=8cf059d91051dbf067a8878ee939fd47 saved to cache
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cfd08257-3969-5167-948e-8be6c5f3c4cd
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3571/20473571/docs_service_history-1774709286625.jpg?ixlib=js-3.8.0&auto=format&s=0354db2483271c64476f1faffdebca70> (referer: None)
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3631%252F20343631%252Fexterior_rear_passenger-1774701852888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3631/20343631/exterior_rear_passenger-1774701852888.jpg not downloaded yet
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20066226
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720066226%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [motorway.uk] INFO: Scrape type for 20066226: 1
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7111/20497111/docs_service_history-1774779208654.jpg?ixlib=js-3.8.0&auto=format&s=8f0f9c349b58dd76428367477f0e13b3> (referer: None)
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3631%252F20343631%252Finterior_front_seats-1774704602540.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3631/20343631/interior_front_seats-1774704602540.jpg not downloaded yet
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 18421687
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718421687%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [motorway.uk] INFO: Scrape type for 18421687: 1
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3631%252F20343631%252Finterior_rear_seats-1774702092427.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3631/20343631/interior_rear_seats-1774702092427.jpg not downloaded yet
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20199197
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 19475567
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719475567%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [motorway.uk] INFO: Scrape type for 19475567: 1
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3631%252F20343631%252Finterior_dashboard-1774704616583.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3631/20343631/interior_dashboard-1774704616583.jpg not downloaded yet
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 19580249
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 9018744
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20414685
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 14657011
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 19911856
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 10143250
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20267897
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 19688766
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719688766%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [motorway.uk] INFO: Scrape type for 19688766: 1
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f41bc90>
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44dc507-334f-5a4a-a07c-abe5df9e5bfc/e44dc507-334f-5a4a-a07c-abe5df9e5bfc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3571%252F20473571%252Fdocs_service_history-1774709286625.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0354db2483271c64476f1faffdebca70') HTTP/1.1" 204 0
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3571/20473571/docs_service_history-1774709286625.jpg?ixlib=js-3.8.0&auto=format&s=0354db2483271c64476f1faffdebca70 saved to cache
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e44dc507-334f-5a4a-a07c-abe5df9e5bfc
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3631%252F20343631%252Finstrument_cluster-1774702173518.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3631/20343631/instrument_cluster-1774702173518.jpg not downloaded yet
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20489770
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 16571680
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20430888
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20485034
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 3044789
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20138195
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720138195%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [motorway.uk] INFO: Scrape type for 20138195: 1
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3631%252F20343631%252Finterior_boot-1774702094964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3631/20343631/interior_boot-1774702094964.jpg not downloaded yet
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20392438
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720392438%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [motorway.uk] INFO: Scrape type for 20392438: 1
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3631%252F20343631%252Fdocs_service_history-1774703081642-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dca5b60e183caf18e7c8fa1bad0893840%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3631/20343631/docs_service_history-1774703081642-2.jpeg?ixlib=js-3.8.0&auto=format&s=ca5b60e183caf18e7c8fa1bad0893840 not downloaded yet
2026-03-29 20:12:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c76d0>
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06908e6-d471-5211-9a3d-c5ce49f9d2b7/a06908e6-d471-5211-9a3d-c5ce49f9d2b7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7111%252F20497111%252Fdocs_service_history-1774779208654.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8f0f9c349b58dd76428367477f0e13b3') HTTP/1.1" 204 0
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7111/20497111/docs_service_history-1774779208654.jpg?ixlib=js-3.8.0&auto=format&s=8f0f9c349b58dd76428367477f0e13b3 saved to cache
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a06908e6-d471-5211-9a3d-c5ce49f9d2b7
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 16417496
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 18624558
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 19258894
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 13525953
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 17208307
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 17537906
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 15848839
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20122744
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20442189
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 19052068
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20414776
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720414776%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [motorway.uk] INFO: Scrape type for 20414776: 1
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 10974269
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20354803
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7111/20497111/interior_dashboard-1774779482624.jpg> (referer: None)
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3631/20343631/exterior_rear_passenger-1774701852888.jpg> (referer: None)
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2166/18052166/instrument_cluster-1774712787320.jpeg> (referer: None)
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7111/20497111/damage_scratches-1774778273644.jpg> (referer: None)
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7111/20497111/interior_boot-1774778653748.jpg> (referer: None)
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2166/18052166/interior_boot-1774712697432.jpeg> (referer: None)
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18279854.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d126510>
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06908e6-d471-5211-9a3d-c5ce49f9d2b7/a06908e6-d471-5211-9a3d-c5ce49f9d2b7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7111%252F20497111%252Finterior_dashboard-1774779482624.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7111/20497111/interior_dashboard-1774779482624.jpg saved to cache
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a06908e6-d471-5211-9a3d-c5ce49f9d2b7
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2deb22d0>
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f81403c-056b-58e2-b719-f9c0bb4d05b3/6f81403c-056b-58e2-b719-f9c0bb4d05b3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3631%252F20343631%252Fexterior_rear_passenger-1774701852888.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3631/20343631/exterior_rear_passenger-1774701852888.jpg saved to cache
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f81403c-056b-58e2-b719-f9c0bb4d05b3
2026-03-29 20:12:52 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:52 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:52 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00#\xcft\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xf8\x10\x00#\xc4\xe2\x00\x00\x00\x00'
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d006550>
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd08257-3969-5167-948e-8be6c5f3c4cd/cfd08257-3969-5167-948e-8be6c5f3c4cd_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F18052166%252Finstrument_cluster-1774712787320.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/18052166/instrument_cluster-1774712787320.jpeg saved to cache
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cfd08257-3969-5167-948e-8be6c5f3c4cd
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c69f610>
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06908e6-d471-5211-9a3d-c5ce49f9d2b7/a06908e6-d471-5211-9a3d-c5ce49f9d2b7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7111%252F20497111%252Fdamage_scratches-1774778273644.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7111/20497111/damage_scratches-1774778273644.jpg saved to cache
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a06908e6-d471-5211-9a3d-c5ce49f9d2b7
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c69e410>
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06908e6-d471-5211-9a3d-c5ce49f9d2b7/a06908e6-d471-5211-9a3d-c5ce49f9d2b7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7111%252F20497111%252Finterior_boot-1774778653748.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7111/20497111/interior_boot-1774778653748.jpg saved to cache
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a06908e6-d471-5211-9a3d-c5ce49f9d2b7
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x009\x948\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xb4/\x009\x89\xa6\x00\x00\x00\x00'
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d23a0d0>
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd08257-3969-5167-948e-8be6c5f3c4cd/cfd08257-3969-5167-948e-8be6c5f3c4cd_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2166%252F18052166%252Finterior_boot-1774712697432.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2166/18052166/interior_boot-1774712697432.jpeg saved to cache
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cfd08257-3969-5167-948e-8be6c5f3c4cd
2026-03-29 20:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae852c51-6b48-5b0f-8a1c-410c1d5113d8 with identifier: 18279854
2026-03-29 20:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae852c51-6b48-5b0f-8a1c-410c1d5113d8 with scrape type 1
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae852c51-6b48-5b0f-8a1c-410c1d5113d8
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9854%252F18279854%252F18279854-exterior_front_driver-modified-1774695491756.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9854/18279854/18279854-exterior_front_driver-modified-1774695491756.jpeg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9854%252F18279854%252Fexterior_rear_driver-1774694211897.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9854/18279854/exterior_rear_driver-1774694211897.jpeg not downloaded yet
2026-03-29 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490232.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9854%252F18279854%252Fexterior_front_passenger-1774694216902.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9854/18279854/exterior_front_passenger-1774694216902.jpeg not downloaded yet
2026-03-29 20:12:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9854%252F18279854%252Fexterior_rear_passenger-1774694202936.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9854/18279854/exterior_rear_passenger-1774694202936.jpeg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9854%252F18279854%252Finterior_front_seats-1774694242226.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9854/18279854/interior_front_seats-1774694242226.jpeg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9854%252F18279854%252Finterior_rear_seats-1774694286268.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9854/18279854/interior_rear_seats-1774694286268.jpeg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9854%252F18279854%252F18279854-interior_dashboard-modified-1774695560020.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9854/18279854/18279854-interior_dashboard-modified-1774695560020.jpeg not downloaded yet
2026-03-29 20:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc089465-2a49-5076-8398-f2c389a11035 with identifier: 20490232
2026-03-29 20:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc089465-2a49-5076-8398-f2c389a11035 with scrape type 1
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc089465-2a49-5076-8398-f2c389a11035
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0232%252F20490232%252Fexterior_front_driver-1774711785323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0232/20490232/exterior_front_driver-1774711785323.jpg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9854%252F18279854%252Finstrument_cluster-1774694395270.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9854/18279854/instrument_cluster-1774694395270.jpeg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0232%252F20490232%252Fexterior_rear_driver-1774710204617.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0232/20490232/exterior_rear_driver-1774710204617.jpg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9854%252F18279854%252F18279854-interior_boot-modified-1774695568089.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9854/18279854/18279854-interior_boot-modified-1774695568089.jpeg not downloaded yet
2026-03-29 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20009911.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0232%252F20490232%252Fexterior_front_passenger-1774710201654.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0232/20490232/exterior_front_passenger-1774710201654.jpg not downloaded yet
2026-03-29 20:12:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486464.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3631/20343631/docs_service_history-1774703081642-2.jpeg?ixlib=js-3.8.0&auto=format&s=ca5b60e183caf18e7c8fa1bad0893840> (referer: None)
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9854%252F18279854%252Fdocs_service_history-1774694814850.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D82819496df3478ae4240f2dba8fee398%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9854/18279854/docs_service_history-1774694814850.jpeg?ixlib=js-3.8.0&auto=format&s=82819496df3478ae4240f2dba8fee398 not downloaded yet
2026-03-29 20:12:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19993213.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0232%252F20490232%252Fexterior_rear_passenger-1774710202897.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0232/20490232/exterior_rear_passenger-1774710202897.jpg not downloaded yet
2026-03-29 20:12:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0232%252F20490232%252Finterior_front_seats-1774710771251.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0232/20490232/interior_front_seats-1774710771251.jpg not downloaded yet
2026-03-29 20:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea825f29-6f35-5a61-b9e8-60be9059a7e6 with identifier: 20009911
2026-03-29 20:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea825f29-6f35-5a61-b9e8-60be9059a7e6 with scrape type 1
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea825f29-6f35-5a61-b9e8-60be9059a7e6
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9911%252F20009911%252Fexterior_front_driver-1774531486115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9911/20009911/exterior_front_driver-1774531486115.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0232%252F20490232%252Finterior_rear_seats-1774710736339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0232/20490232/interior_rear_seats-1774710736339.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9911%252F20009911%252Fexterior_rear_driver-1774531713385.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9911/20009911/exterior_rear_driver-1774531713385.jpg not downloaded yet
2026-03-29 20:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18764881.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0232%252F20490232%252Finterior_dashboard-1774711428764.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0232/20490232/interior_dashboard-1774711428764.jpg not downloaded yet
2026-03-29 20:12:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7d1d76d-0a26-5bb8-81b7-46291014b91e with identifier: 20486464
2026-03-29 20:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7d1d76d-0a26-5bb8-81b7-46291014b91e with scrape type 1
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7d1d76d-0a26-5bb8-81b7-46291014b91e
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6464%252F20486464%252Fexterior_front_driver-1774699425067.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6464/20486464/exterior_front_driver-1774699425067.jpg not downloaded yet
2026-03-29 20:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d83dc50>
2026-03-29 20:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f81403c-056b-58e2-b719-f9c0bb4d05b3/6f81403c-056b-58e2-b719-f9c0bb4d05b3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3631%252F20343631%252Fdocs_service_history-1774703081642-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dca5b60e183caf18e7c8fa1bad0893840') HTTP/1.1" 204 0
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3631/20343631/docs_service_history-1774703081642-2.jpeg?ixlib=js-3.8.0&auto=format&s=ca5b60e183caf18e7c8fa1bad0893840 saved to cache
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f81403c-056b-58e2-b719-f9c0bb4d05b3
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9911%252F20009911%252Fexterior_front_passenger-1774531742521.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9911/20009911/exterior_front_passenger-1774531742521.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0232%252F20490232%252Finterior_boot-1774710734733.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0232/20490232/interior_boot-1774710734733.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6464%252F20486464%252Fexterior_rear_driver-1774699397463.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6464/20486464/exterior_rear_driver-1774699397463.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9911%252F20009911%252Fexterior_rear_passenger-1774531686815.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9911/20009911/exterior_rear_passenger-1774531686815.jpg not downloaded yet
2026-03-29 20:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 047fd503-f9f3-5cb5-8b3d-a80b0f447520 with identifier: 19993213
2026-03-29 20:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 047fd503-f9f3-5cb5-8b3d-a80b0f447520 with scrape type 1
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 047fd503-f9f3-5cb5-8b3d-a80b0f447520
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3213%252F19993213%252Fexterior_front_driver-1774702874504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3213/19993213/exterior_front_driver-1774702874504.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0232%252F20490232%252Fdocs_service_history-1774710937885.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4df92009e9762ea910f5a012c2f0f5ac%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0232/20490232/docs_service_history-1774710937885.jpg?ixlib=js-3.8.0&auto=format&s=4df92009e9762ea910f5a012c2f0f5ac not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6464%252F20486464%252Fexterior_front_passenger-1774699454876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6464/20486464/exterior_front_passenger-1774699454876.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9911%252F20009911%252Finterior_front_seats-1773239991836.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9911/20009911/interior_front_seats-1773239991836.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3213%252F19993213%252Fexterior_rear_driver-1774702890793.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3213/19993213/exterior_rear_driver-1774702890793.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0232%252F20490232%252Fdocs_service_history-1774710949715.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbefa680c5b596d1a8722bdb55a4b5405%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0232/20490232/docs_service_history-1774710949715.jpg?ixlib=js-3.8.0&auto=format&s=befa680c5b596d1a8722bdb55a4b5405 not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6464%252F20486464%252Fexterior_rear_passenger-1774699473325.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6464/20486464/exterior_rear_passenger-1774699473325.jpg not downloaded yet
2026-03-29 20:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70cb965b-3002-5c7b-9a98-8d840ff9bd0c with identifier: 18764881
2026-03-29 20:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70cb965b-3002-5c7b-9a98-8d840ff9bd0c with scrape type 1
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70cb965b-3002-5c7b-9a98-8d840ff9bd0c
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4881%252F18764881%252Fexterior_front_driver-1774690135222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4881/18764881/exterior_front_driver-1774690135222.jpg not downloaded yet
2026-03-29 20:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9854/18279854/exterior_rear_driver-1774694211897.jpeg> (referer: None)
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9911%252F20009911%252Finterior_dashboard-1774691997436.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9911/20009911/interior_dashboard-1774691997436.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3213%252F19993213%252Fexterior_front_passenger-1774702909539.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3213/19993213/exterior_front_passenger-1774702909539.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6464%252F20486464%252Finterior_front_seats-1774700382227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6464/20486464/interior_front_seats-1774700382227.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4881%252F18764881%252Fexterior_rear_driver-1774020284347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4881/18764881/exterior_rear_driver-1774020284347.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9911%252F20009911%252Finstrument_cluster-1773240099556.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9911/20009911/instrument_cluster-1773240099556.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3213%252F19993213%252Fexterior_rear_passenger-1774702902096.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3213/19993213/exterior_rear_passenger-1774702902096.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6464%252F20486464%252Finterior_rear_seats-1774700367816.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6464/20486464/interior_rear_seats-1774700367816.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4881%252F18764881%252Fexterior_front_passenger-1774690151302.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4881/18764881/exterior_front_passenger-1774690151302.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9911%252F20009911%252Finterior_boot-1774692108008.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9911/20009911/interior_boot-1774692108008.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3213%252F19993213%252Finterior_front_seats-1774704484240.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3213/19993213/interior_front_seats-1774704484240.jpg not downloaded yet
2026-03-29 20:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5f5250>
2026-03-29 20:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae852c51-6b48-5b0f-8a1c-410c1d5113d8/ae852c51-6b48-5b0f-8a1c-410c1d5113d8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9854%252F18279854%252Fexterior_rear_driver-1774694211897.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9854/18279854/exterior_rear_driver-1774694211897.jpeg saved to cache
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae852c51-6b48-5b0f-8a1c-410c1d5113d8
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6464%252F20486464%252Finterior_dashboard-1774700464766.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6464/20486464/interior_dashboard-1774700464766.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4881%252F18764881%252Fexterior_rear_passenger-1774020366054.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4881/18764881/exterior_rear_passenger-1774020366054.jpg not downloaded yet
2026-03-29 20:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9854/18279854/18279854-exterior_front_driver-modified-1774695491756.jpeg> (referer: None)
2026-03-29 20:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4881/18764881/exterior_front_driver-1774690135222.jpg> (referer: None)
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9911%252F20009911%252Fdamage_paintwork-1773239783821.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9911/20009911/damage_paintwork-1773239783821.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3213%252F19993213%252Finterior_rear_seats-1774704312785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3213/19993213/interior_rear_seats-1774704312785.jpg not downloaded yet
2026-03-29 20:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/7801463.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6464%252F20486464%252Finstrument_cluster-1774700126498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6464/20486464/instrument_cluster-1774700126498.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4881%252F18764881%252Finterior_front_seats-1774020998780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4881/18764881/interior_front_seats-1774020998780.jpg not downloaded yet
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9911%252F20009911%252Fdamage_paintwork-1774535862859.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9911/20009911/damage_paintwork-1774535862859.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3213%252F19993213%252Finterior_dashboard-1774716826903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3213/19993213/interior_dashboard-1774716826903.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6464%252F20486464%252Finterior_boot-1774700350782.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6464/20486464/interior_boot-1774700350782.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4881%252F18764881%252Finterior_rear_seats-1774020997904.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4881/18764881/interior_rear_seats-1774020997904.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3213%252F19993213%252Finstrument_cluster-1774704325294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3213/19993213/instrument_cluster-1774704325294.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6464%252F20486464%252Fdocs_service_history-1774700664497.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6931f2744ae937ab3ecc973d975b5691%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6464/20486464/docs_service_history-1774700664497.jpg?ixlib=js-3.8.0&auto=format&s=6931f2744ae937ab3ecc973d975b5691 not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4881%252F18764881%252Finterior_dashboard-1774021075463.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4881/18764881/interior_dashboard-1774021075463.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3213%252F19993213%252Finterior_boot-1774704744554.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3213/19993213/interior_boot-1774704744554.jpg not downloaded yet
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c824650>
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae852c51-6b48-5b0f-8a1c-410c1d5113d8/ae852c51-6b48-5b0f-8a1c-410c1d5113d8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9854%252F18279854%252F18279854-exterior_front_driver-modified-1774695491756.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9854/18279854/18279854-exterior_front_driver-modified-1774695491756.jpeg saved to cache
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae852c51-6b48-5b0f-8a1c-410c1d5113d8
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc61a10>
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70cb965b-3002-5c7b-9a98-8d840ff9bd0c/70cb965b-3002-5c7b-9a98-8d840ff9bd0c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4881%252F18764881%252Fexterior_front_driver-1774690135222.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4881/18764881/exterior_front_driver-1774690135222.jpg saved to cache
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70cb965b-3002-5c7b-9a98-8d840ff9bd0c
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4881%252F18764881%252Finstrument_cluster-1774021062125.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4881/18764881/instrument_cluster-1774021062125.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3213%252F19993213%252Fdocs_service_history-1774705401558.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5cda460c6c1e654e5ccfba63989113f6%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3213/19993213/docs_service_history-1774705401558.jpg?ixlib=js-3.8.0&auto=format&s=5cda460c6c1e654e5ccfba63989113f6 not downloaded yet
2026-03-29 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0232/20490232/exterior_rear_driver-1774710204617.jpg> (referer: None)
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4881%252F18764881%252Finterior_boot-1774020996920.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4881/18764881/interior_boot-1774020996920.jpg not downloaded yet
2026-03-29 20:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9714a82-d144-58b2-89d8-d23402b8ba9e with identifier: 7801463
2026-03-29 20:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9714a82-d144-58b2-89d8-d23402b8ba9e with scrape type 1
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9714a82-d144-58b2-89d8-d23402b8ba9e
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1463%252F7801463%252Fexterior_front_driver-1774699203954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1463/7801463/exterior_front_driver-1774699203954.jpg not downloaded yet
2026-03-29 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4881/18764881/exterior_rear_passenger-1774020366054.jpg> (referer: None)
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4881%252F18764881%252Fdamage_dents-1774020486936.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4881/18764881/damage_dents-1774020486936.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1463%252F7801463%252Fexterior_rear_driver-1774699230522.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1463/7801463/exterior_rear_driver-1774699230522.jpg not downloaded yet
2026-03-29 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1584&page=44&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3631/20343631/interior_boot-1774702094964.jpg> (referer: None)
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1463%252F7801463%252Fexterior_front_passenger-1774699258489.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1463/7801463/exterior_front_passenger-1774699258489.jpg not downloaded yet
2026-03-29 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0232/20490232/exterior_front_passenger-1774710201654.jpg> (referer: None)
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1463%252F7801463%252Fexterior_rear_passenger-1774699242176.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1463/7801463/exterior_rear_passenger-1774699242176.jpg not downloaded yet
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c9157d0>
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc089465-2a49-5076-8398-f2c389a11035/dc089465-2a49-5076-8398-f2c389a11035_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0232%252F20490232%252Fexterior_rear_driver-1774710204617.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0232/20490232/exterior_rear_driver-1774710204617.jpg saved to cache
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc089465-2a49-5076-8398-f2c389a11035
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1463%252F7801463%252Finterior_front_seats-1774699714408.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1463/7801463/interior_front_seats-1774699714408.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1463%252F7801463%252Finterior_rear_seats-1774699731435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1463/7801463/interior_rear_seats-1774699731435.jpg not downloaded yet
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2fa290>
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70cb965b-3002-5c7b-9a98-8d840ff9bd0c/70cb965b-3002-5c7b-9a98-8d840ff9bd0c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4881%252F18764881%252Fexterior_rear_passenger-1774020366054.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4881/18764881/exterior_rear_passenger-1774020366054.jpg saved to cache
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70cb965b-3002-5c7b-9a98-8d840ff9bd0c
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 20451003
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 14684218
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 20422948
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 20499385
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499385%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [motorway.uk] INFO: Scrape type for 20499385: 1
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2e62d0>
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f81403c-056b-58e2-b719-f9c0bb4d05b3/6f81403c-056b-58e2-b719-f9c0bb4d05b3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3631%252F20343631%252Finterior_boot-1774702094964.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3631/20343631/interior_boot-1774702094964.jpg saved to cache
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f81403c-056b-58e2-b719-f9c0bb4d05b3
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f671bd0>
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc089465-2a49-5076-8398-f2c389a11035/dc089465-2a49-5076-8398-f2c389a11035_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0232%252F20490232%252Fexterior_front_passenger-1774710201654.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0232/20490232/exterior_front_passenger-1774710201654.jpg saved to cache
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc089465-2a49-5076-8398-f2c389a11035
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1463%252F7801463%252Finterior_dashboard-1774699764998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1463/7801463/interior_dashboard-1774699764998.jpg not downloaded yet
2026-03-29 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4881/18764881/damage_dents-1774020486936.jpg> (referer: None)
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 16912620
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 20290355
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 20346452
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 20492694
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 20488759
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 19778290
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 20235127
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 20357385
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 5496276
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275496276%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [motorway.uk] INFO: Scrape type for 5496276: 1
2026-03-29 20:12:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4881/18764881/instrument_cluster-1774021062125.jpg> (referer: None)
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1463%252F7801463%252Finstrument_cluster-1774699814281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1463/7801463/instrument_cluster-1774699814281.jpg not downloaded yet
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 20398366
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720398366%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [motorway.uk] INFO: Scrape type for 20398366: 1
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1463%252F7801463%252Finterior_boot-1774699766462.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1463/7801463/interior_boot-1774699766462.jpg not downloaded yet
2026-03-29 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6464/20486464/interior_dashboard-1774700464766.jpg> (referer: None)
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 20488805
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488805%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [motorway.uk] INFO: Scrape type for 20488805: 1
2026-03-29 20:12:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1463%252F7801463%252Fdocs_service_history-1774700026467.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D82c64b7d53e5c3b7490ca5c749883c5c%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1463/7801463/docs_service_history-1774700026467.jpg?ixlib=js-3.8.0&auto=format&s=82c64b7d53e5c3b7490ca5c749883c5c not downloaded yet
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 19217492
2026-03-29 20:12:55 [motorway.uk] INFO: Found listing with ID: 20311195
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720311195%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [motorway.uk] INFO: Scrape type for 20311195: 1
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 20418338
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 16896697
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 20269930
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720269930%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [motorway.uk] INFO: Scrape type for 20269930: 1
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d002950>
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70cb965b-3002-5c7b-9a98-8d840ff9bd0c/70cb965b-3002-5c7b-9a98-8d840ff9bd0c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4881%252F18764881%252Fdamage_dents-1774020486936.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4881/18764881/damage_dents-1774020486936.jpg saved to cache
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70cb965b-3002-5c7b-9a98-8d840ff9bd0c
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e03b3d0>
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70cb965b-3002-5c7b-9a98-8d840ff9bd0c/70cb965b-3002-5c7b-9a98-8d840ff9bd0c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4881%252F18764881%252Finstrument_cluster-1774021062125.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4881/18764881/instrument_cluster-1774021062125.jpg saved to cache
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70cb965b-3002-5c7b-9a98-8d840ff9bd0c
2026-03-29 20:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0232/20490232/interior_rear_seats-1774710736339.jpg> (referer: None)
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 20489216
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489216%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [motorway.uk] INFO: Scrape type for 20489216: 1
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 19118754
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719118754%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [motorway.uk] INFO: Scrape type for 19118754: 1
2026-03-29 20:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9854/18279854/instrument_cluster-1774694395270.jpeg> (referer: None)
2026-03-29 20:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9854/18279854/18279854-interior_boot-modified-1774695568089.jpeg> (referer: None)
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd16e10>
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7d1d76d-0a26-5bb8-81b7-46291014b91e/e7d1d76d-0a26-5bb8-81b7-46291014b91e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6464%252F20486464%252Finterior_dashboard-1774700464766.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6464/20486464/interior_dashboard-1774700464766.jpg saved to cache
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7d1d76d-0a26-5bb8-81b7-46291014b91e
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 16543574
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 19621328
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 20409554
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720409554%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [motorway.uk] INFO: Scrape type for 20409554: 1
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 19689914
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 20145284
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720145284%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [motorway.uk] INFO: Scrape type for 20145284: 1
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 20286923
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 15579981
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 16616720
2026-03-29 20:12:56 [motorway.uk] INFO: Found listing with ID: 7172629
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277172629%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [motorway.uk] INFO: Scrape type for 7172629: 1
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f27dc50>
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc089465-2a49-5076-8398-f2c389a11035/dc089465-2a49-5076-8398-f2c389a11035_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0232%252F20490232%252Finterior_rear_seats-1774710736339.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0232/20490232/interior_rear_seats-1774710736339.jpg saved to cache
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc089465-2a49-5076-8398-f2c389a11035
2026-03-29 20:12:56 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:56 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:56 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*\x05t\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x029\xea\x00)\xfbb\x00\x00\x00\x00'
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d557fd0>
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae852c51-6b48-5b0f-8a1c-410c1d5113d8/ae852c51-6b48-5b0f-8a1c-410c1d5113d8_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9854%252F18279854%252Finstrument_cluster-1774694395270.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9854/18279854/instrument_cluster-1774694395270.jpeg saved to cache
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae852c51-6b48-5b0f-8a1c-410c1d5113d8
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4c3ad0>
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae852c51-6b48-5b0f-8a1c-410c1d5113d8/ae852c51-6b48-5b0f-8a1c-410c1d5113d8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9854%252F18279854%252F18279854-interior_boot-modified-1774695568089.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9854/18279854/18279854-interior_boot-modified-1774695568089.jpeg saved to cache
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae852c51-6b48-5b0f-8a1c-410c1d5113d8
2026-03-29 20:12:57 [motorway.uk] INFO: Found listing with ID: 7903453
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277903453%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [motorway.uk] INFO: Scrape type for 7903453: 1
2026-03-29 20:12:57 [motorway.uk] INFO: Found listing with ID: 19401646
2026-03-29 20:12:57 [motorway.uk] INFO: Found listing with ID: 20291009
2026-03-29 20:12:57 [motorway.uk] INFO: Found listing with ID: 19871725
2026-03-29 20:12:57 [motorway.uk] INFO: Found listing with ID: 19394258
2026-03-29 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1463/7801463/exterior_rear_driver-1774699230522.jpg> (referer: None)
2026-03-29 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3213/19993213/docs_service_history-1774705401558.jpg?ixlib=js-3.8.0&auto=format&s=5cda460c6c1e654e5ccfba63989113f6> (referer: None)
2026-03-29 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1463/7801463/interior_dashboard-1774699764998.jpg> (referer: None)
2026-03-29 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3213/19993213/interior_front_seats-1774704484240.jpg> (referer: None)
2026-03-29 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1463/7801463/interior_front_seats-1774699714408.jpg> (referer: None)
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5fb990>
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9714a82-d144-58b2-89d8-d23402b8ba9e/b9714a82-d144-58b2-89d8-d23402b8ba9e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1463%252F7801463%252Fexterior_rear_driver-1774699230522.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1463/7801463/exterior_rear_driver-1774699230522.jpg saved to cache
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9714a82-d144-58b2-89d8-d23402b8ba9e
2026-03-29 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20392438.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6e8a10>
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_047fd503-f9f3-5cb5-8b3d-a80b0f447520/047fd503-f9f3-5cb5-8b3d-a80b0f447520_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3213%252F19993213%252Fdocs_service_history-1774705401558.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5cda460c6c1e654e5ccfba63989113f6') HTTP/1.1" 204 0
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3213/19993213/docs_service_history-1774705401558.jpg?ixlib=js-3.8.0&auto=format&s=5cda460c6c1e654e5ccfba63989113f6 saved to cache
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 047fd503-f9f3-5cb5-8b3d-a80b0f447520
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dda4750>
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9714a82-d144-58b2-89d8-d23402b8ba9e/b9714a82-d144-58b2-89d8-d23402b8ba9e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1463%252F7801463%252Finterior_dashboard-1774699764998.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1463/7801463/interior_dashboard-1774699764998.jpg saved to cache
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9714a82-d144-58b2-89d8-d23402b8ba9e
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de389d0>
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_047fd503-f9f3-5cb5-8b3d-a80b0f447520/047fd503-f9f3-5cb5-8b3d-a80b0f447520_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3213%252F19993213%252Finterior_front_seats-1774704484240.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3213/19993213/interior_front_seats-1774704484240.jpg saved to cache
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 047fd503-f9f3-5cb5-8b3d-a80b0f447520
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd52290>
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9714a82-d144-58b2-89d8-d23402b8ba9e/b9714a82-d144-58b2-89d8-d23402b8ba9e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1463%252F7801463%252Finterior_front_seats-1774699714408.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1463/7801463/interior_front_seats-1774699714408.jpg saved to cache
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9714a82-d144-58b2-89d8-d23402b8ba9e
2026-03-29 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19798498.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d879ffc2-9fb8-5b2c-84be-aa67bd15abb8 with identifier: 20392438
2026-03-29 20:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d879ffc2-9fb8-5b2c-84be-aa67bd15abb8 with scrape type 1
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d879ffc2-9fb8-5b2c-84be-aa67bd15abb8
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2438%252F20392438%252Fexterior_front_driver-1774715050017.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2438/20392438/exterior_front_driver-1774715050017.jpg not downloaded yet
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2438%252F20392438%252Fexterior_rear_driver-1774715045785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2438/20392438/exterior_rear_driver-1774715045785.jpg not downloaded yet
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2438%252F20392438%252Fexterior_front_passenger-1774715022467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2438/20392438/exterior_front_passenger-1774715022467.jpg not downloaded yet
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2438%252F20392438%252Fexterior_rear_passenger-1774715886805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2438/20392438/exterior_rear_passenger-1774715886805.jpg not downloaded yet
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2438%252F20392438%252Finterior_front_seats-1774715935286.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2438/20392438/interior_front_seats-1774715935286.jpg not downloaded yet
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2438%252F20392438%252Finterior_rear_seats-1774715530259.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2438/20392438/interior_rear_seats-1774715530259.jpg not downloaded yet
2026-03-29 20:12:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e09871c4-85f3-5cc9-be46-473feb42b4ea with identifier: 19798498
2026-03-29 20:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e09871c4-85f3-5cc9-be46-473feb42b4ea with scrape type 1
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e09871c4-85f3-5cc9-be46-473feb42b4ea
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8498%252F19798498%252Fexterior_front_driver-1771520492523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8498/19798498/exterior_front_driver-1771520492523.jpg already downloaded
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8498%252F19798498%252Fexterior_rear_driver-1771520508300.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8498/19798498/exterior_rear_driver-1771520508300.jpg already downloaded
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8498%252F19798498%252Fexterior_front_passenger-1771520537215.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8498/19798498/exterior_front_passenger-1771520537215.jpg already downloaded
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8498%252F19798498%252Fexterior_rear_passenger-1771520522799.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8498/19798498/exterior_rear_passenger-1771520522799.jpg already downloaded
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8498%252F19798498%252Finterior_front_seats-1771520811620.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8498/19798498/interior_front_seats-1771520811620.jpg already downloaded
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8498%252F19798498%252Finterior_rear_seats-1771520821917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8498/19798498/interior_rear_seats-1771520821917.jpg already downloaded
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8498%252F19798498%252Finterior_dashboard-1771523638162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8498/19798498/interior_dashboard-1771523638162.jpg already downloaded
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8498%252F19798498%252Finstrument_cluster-1771520796200.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8498/19798498/instrument_cluster-1771520796200.jpg already downloaded
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8498%252F19798498%252Finterior_boot-1771520858492.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8498/19798498/interior_boot-1771520858492.jpg already downloaded
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F8498%252F19798498%252Fdocs_service_history-1771521619530.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D20a2264a4f98593bd90d88ace177f57b%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/8498/19798498/docs_service_history-1771521619530.jpg?ixlib=js-3.8.0&auto=format&s=20a2264a4f98593bd90d88ace177f57b already downloaded
2026-03-29 20:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e09871c4-85f3-5cc9-be46-473feb42b4ea, identifier: 19798498
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2438%252F20392438%252Finterior_dashboard-1774715560554.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2438/20392438/interior_dashboard-1774715560554.jpg not downloaded yet
2026-03-29 20:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e09871c4-85f3-5cc9-be46-473feb42b4ea with identifier: 19798498
2026-03-29 20:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e09871c4-85f3-5cc9-be46-473feb42b4ea with identifier: 19798498
2026-03-29 20:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e09871c4-85f3-5cc9-be46-473feb42b4ea with identifier: 19798498 to the API
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19798498.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'e09871c4-85f3-5cc9-be46-473feb42b4ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'IIB 542',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19798498',
'listing': 'auction',
'location': 'Essex Canvey Island',
'make': 'Mercedes',
'model': 'M Class',
'odometer': 98650,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/8498/19798498/exterior_front_driver-1771520492523.jpg',
'https://motorway-photos-redacted.imgix.net/8498/19798498/exterior_rear_driver-1771520508300.jpg',
'https://motorway-photos-redacted.imgix.net/8498/19798498/exterior_front_passenger-1771520537215.jpg',
'https://motorway-photos-redacted.imgix.net/8498/19798498/exterior_rear_passenger-1771520522799.jpg',
'https://motorway-photos.imgix.net/8498/19798498/interior_front_seats-1771520811620.jpg',
'https://motorway-photos.imgix.net/8498/19798498/interior_rear_seats-1771520821917.jpg',
'https://motorway-photos-modified.imgix.net/8498/19798498/interior_dashboard-1771523638162.jpg',
'https://motorway-photos.imgix.net/8498/19798498/instrument_cluster-1771520796200.jpg',
'https://motorway-photos.imgix.net/8498/19798498/interior_boot-1771520858492.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/8498/19798498/docs_service_history-1771521619530.jpg?ixlib=js-3.8.0&auto=format&s=20a2264a4f98593bd90d88ace177f57b'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be412688-7d2a-563a-849a-36a49a6dcdac/be412688-7d2a-563a-849a-36a49a6dcdac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2032704,
'Height': 2582,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8498/19798498/exterior_front_driver-1771520492523.jpg',
'Width': 3442},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be412688-7d2a-563a-849a-36a49a6dcdac/be412688-7d2a-563a-849a-36a49a6dcdac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1389356,
'Height': 2321,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8498/19798498/exterior_rear_driver-1771520508300.jpg',
'Width': 3095},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be412688-7d2a-563a-849a-36a49a6dcdac/be412688-7d2a-563a-849a-36a49a6dcdac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1385238,
'Height': 2195,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8498/19798498/exterior_front_passenger-1771520537215.jpg',
'Width': 2927},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be412688-7d2a-563a-849a-36a49a6dcdac/be412688-7d2a-563a-849a-36a49a6dcdac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1975334,
'Height': 2602,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8498/19798498/exterior_rear_passenger-1771520522799.jpg',
'Width': 3469},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be412688-7d2a-563a-849a-36a49a6dcdac/be412688-7d2a-563a-849a-36a49a6dcdac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3125386,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8498/19798498/interior_front_seats-1771520811620.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be412688-7d2a-563a-849a-36a49a6dcdac/be412688-7d2a-563a-849a-36a49a6dcdac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2590044,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8498/19798498/interior_rear_seats-1771520821917.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be412688-7d2a-563a-849a-36a49a6dcdac/be412688-7d2a-563a-849a-36a49a6dcdac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2139539,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8498/19798498/interior_dashboard-1771523638162.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be412688-7d2a-563a-849a-36a49a6dcdac/be412688-7d2a-563a-849a-36a49a6dcdac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1924215,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8498/19798498/instrument_cluster-1771520796200.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be412688-7d2a-563a-849a-36a49a6dcdac/be412688-7d2a-563a-849a-36a49a6dcdac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2717675,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8498/19798498/interior_boot-1771520858492.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be412688-7d2a-563a-849a-36a49a6dcdac/be412688-7d2a-563a-849a-36a49a6dcdac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4664815,
'Height': 4748,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/8498/19798498/docs_service_history-1771521619530.jpg?ixlib=js-3.8.0&auto=format&s=20a2264a4f98593bd90d88ace177f57b',
'Width': 2877}],
'price': 7868,
'price_includes_vat': False,
'registration_date': '2014-05-09',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes ML350 AMG Sport Bluetec Auto',
'transmission': 'automatic',
'trim': 'ML350 AMG Sport Bluetec Auto',
'vin': 'WDC1660242A388793',
'year': 2014}
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719798498%27 HTTP/1.1" 200 None
2026-03-29 20:12:58 [motorway.uk] INFO: Saving data for 19798498: {'created_time': 1774815178.942888, 'last_price_update_time': 1774815178.942898, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19798498') HTTP/1.1" 204 0
2026-03-29 20:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20138195.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2438%252F20392438%252Finstrument_cluster-1774715494014.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2438/20392438/instrument_cluster-1774715494014.jpg not downloaded yet
2026-03-29 20:12:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2438%252F20392438%252Finterior_boot-1774715572248.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2438/20392438/interior_boot-1774715572248.jpg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2438%252F20392438%252Fdocs_service_history-1774717568774.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daafa2ec6f9f8792e86af6e5b9ce04008%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2438/20392438/docs_service_history-1774717568774.jpg?ixlib=js-3.8.0&auto=format&s=aafa2ec6f9f8792e86af6e5b9ce04008 not downloaded yet
2026-03-29 20:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1463/7801463/docs_service_history-1774700026467.jpg?ixlib=js-3.8.0&auto=format&s=82c64b7d53e5c3b7490ca5c749883c5c> (referer: None)
2026-03-29 20:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4753e797-90d3-5007-967c-5e4faf8a2886 with identifier: 20138195
2026-03-29 20:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4753e797-90d3-5007-967c-5e4faf8a2886 with scrape type 1
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4753e797-90d3-5007-967c-5e4faf8a2886
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8195%252F20138195%252Fexterior_front_driver-1774784546630.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8195/20138195/exterior_front_driver-1774784546630.jpg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8195%252F20138195%252Fexterior_rear_driver-1774784573204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8195/20138195/exterior_rear_driver-1774784573204.jpg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8195%252F20138195%252Fexterior_front_passenger-1774784585065.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8195/20138195/exterior_front_passenger-1774784585065.jpg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8195%252F20138195%252Fexterior_rear_passenger-1774782300701.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8195/20138195/exterior_rear_passenger-1774782300701.jpg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8195%252F20138195%252Finterior_front_seats-1774782707274.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8195/20138195/interior_front_seats-1774782707274.jpg not downloaded yet
2026-03-29 20:12:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c761590>
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9714a82-d144-58b2-89d8-d23402b8ba9e/b9714a82-d144-58b2-89d8-d23402b8ba9e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1463%252F7801463%252Fdocs_service_history-1774700026467.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D82c64b7d53e5c3b7490ca5c749883c5c') HTTP/1.1" 204 0
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1463/7801463/docs_service_history-1774700026467.jpg?ixlib=js-3.8.0&auto=format&s=82c64b7d53e5c3b7490ca5c749883c5c saved to cache
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9714a82-d144-58b2-89d8-d23402b8ba9e
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8195%252F20138195%252Finterior_rear_seats-1774782723735.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8195/20138195/interior_rear_seats-1774782723735.jpg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8195%252F20138195%252Finterior_dashboard-1774782751800.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8195/20138195/interior_dashboard-1774782751800.jpg not downloaded yet
2026-03-29 20:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20499385.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8195%252F20138195%252Finstrument_cluster-1774782777399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8195/20138195/instrument_cluster-1774782777399.jpg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8195%252F20138195%252Finterior_boot-1774782770472.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8195/20138195/interior_boot-1774782770472.jpg not downloaded yet
2026-03-29 20:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2438/20392438/docs_service_history-1774717568774.jpg?ixlib=js-3.8.0&auto=format&s=aafa2ec6f9f8792e86af6e5b9ce04008> (referer: None)
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8195%252F20138195%252Fdocs_service_history-1774782839547.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5e7a590f22171f9a243f084c99cdae86%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8195/20138195/docs_service_history-1774782839547.jpg?ixlib=js-3.8.0&auto=format&s=5e7a590f22171f9a243f084c99cdae86 not downloaded yet
2026-03-29 20:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2438/20392438/interior_dashboard-1774715560554.jpg> (referer: None)
2026-03-29 20:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d8f4126-e139-5b85-bf95-298182491aac with identifier: 20499385
2026-03-29 20:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d8f4126-e139-5b85-bf95-298182491aac with scrape type 1
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d8f4126-e139-5b85-bf95-298182491aac
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9385%252F20499385%252Fexterior_front_driver-1774781811782.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_front_driver-1774781811782.jpg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9385%252F20499385%252Fexterior_rear_driver-1774781841187.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_rear_driver-1774781841187.jpg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9385%252F20499385%252Fexterior_front_passenger-1774781888958.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_front_passenger-1774781888958.jpg not downloaded yet
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4b9b50>
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d879ffc2-9fb8-5b2c-84be-aa67bd15abb8/d879ffc2-9fb8-5b2c-84be-aa67bd15abb8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2438%252F20392438%252Fdocs_service_history-1774717568774.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daafa2ec6f9f8792e86af6e5b9ce04008') HTTP/1.1" 204 0
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2438/20392438/docs_service_history-1774717568774.jpg?ixlib=js-3.8.0&auto=format&s=aafa2ec6f9f8792e86af6e5b9ce04008 saved to cache
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d879ffc2-9fb8-5b2c-84be-aa67bd15abb8
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9385%252F20499385%252Fexterior_rear_passenger-1774781859949.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_rear_passenger-1774781859949.jpg not downloaded yet
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c829610>
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d879ffc2-9fb8-5b2c-84be-aa67bd15abb8/d879ffc2-9fb8-5b2c-84be-aa67bd15abb8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2438%252F20392438%252Finterior_dashboard-1774715560554.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2438/20392438/interior_dashboard-1774715560554.jpg saved to cache
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d879ffc2-9fb8-5b2c-84be-aa67bd15abb8
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9385%252F20499385%252Finterior_front_seats-1774787301167.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9385/20499385/interior_front_seats-1774787301167.jpg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9385%252F20499385%252Finterior_rear_seats-1774782550312.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9385/20499385/interior_rear_seats-1774782550312.jpg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9385%252F20499385%252Finterior_dashboard-1774787352873.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9385/20499385/interior_dashboard-1774787352873.jpg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9385%252F20499385%252Finterior_boot-1774782645836.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9385/20499385/interior_boot-1774782645836.jpg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9385%252F20499385%252Fdocs_service_history-1774787752368.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd819d8a4836d8636e70d5e7582818023%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9385/20499385/docs_service_history-1774787752368.jpg?ixlib=js-3.8.0&auto=format&s=d819d8a4836d8636e70d5e7582818023 not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9385%252F20499385%252Fdocs_service_history-1774787754100.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9bae4015fdd4c35d6f9353bf22c70d7e%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9385/20499385/docs_service_history-1774787754100.jpg?ixlib=js-3.8.0&auto=format&s=9bae4015fdd4c35d6f9353bf22c70d7e not downloaded yet
2026-03-29 20:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8195/20138195/interior_dashboard-1774782751800.jpg> (referer: None)
2026-03-29 20:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8195/20138195/interior_boot-1774782770472.jpg> (referer: None)
2026-03-29 20:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8195/20138195/docs_service_history-1774782839547.jpg?ixlib=js-3.8.0&auto=format&s=5e7a590f22171f9a243f084c99cdae86> (referer: None)
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d885510>
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4753e797-90d3-5007-967c-5e4faf8a2886/4753e797-90d3-5007-967c-5e4faf8a2886_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8195%252F20138195%252Finterior_dashboard-1774782751800.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8195/20138195/interior_dashboard-1774782751800.jpg saved to cache
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4753e797-90d3-5007-967c-5e4faf8a2886
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20414776.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d27c0d0>
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4753e797-90d3-5007-967c-5e4faf8a2886/4753e797-90d3-5007-967c-5e4faf8a2886_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8195%252F20138195%252Finterior_boot-1774782770472.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8195/20138195/interior_boot-1774782770472.jpg saved to cache
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4753e797-90d3-5007-967c-5e4faf8a2886
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d986b10>
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4753e797-90d3-5007-967c-5e4faf8a2886/4753e797-90d3-5007-967c-5e4faf8a2886_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8195%252F20138195%252Fdocs_service_history-1774782839547.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5e7a590f22171f9a243f084c99cdae86') HTTP/1.1" 204 0
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8195/20138195/docs_service_history-1774782839547.jpg?ixlib=js-3.8.0&auto=format&s=5e7a590f22171f9a243f084c99cdae86 saved to cache
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4753e797-90d3-5007-967c-5e4faf8a2886
2026-03-29 20:13:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09 with identifier: 20414776
2026-03-29 20:13:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09 with scrape type 1
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4776%252F20414776%252Fexterior_front_driver-1774702591184.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_front_driver-1774702591184.jpg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4776%252F20414776%252Fexterior_rear_driver-1774702620849.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_rear_driver-1774702620849.jpg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4776%252F20414776%252Fexterior_front_passenger-1774702690219.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_front_passenger-1774702690219.jpg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4776%252F20414776%252Fexterior_rear_passenger-1774702660413.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_rear_passenger-1774702660413.jpg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4776%252F20414776%252Finterior_front_seats-1774703162232.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4776/20414776/interior_front_seats-1774703162232.jpg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4776%252F20414776%252Finterior_rear_seats-1774703132140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4776/20414776/interior_rear_seats-1774703132140.jpg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4776%252F20414776%252Finterior_dashboard-1774703102640.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4776/20414776/interior_dashboard-1774703102640.jpg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4776%252F20414776%252Finstrument_cluster-1774703170790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4776/20414776/instrument_cluster-1774703170790.jpg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4776%252F20414776%252Finterior_boot-1774703108644.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4776/20414776/interior_boot-1774703108644.jpg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4776%252F20414776%252Fdocs_service_history-1774706715759.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcdd847f44b32f412a2487ef249d3e0b9%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4776/20414776/docs_service_history-1774706715759.jpg?ixlib=js-3.8.0&auto=format&s=cdd847f44b32f412a2487ef249d3e0b9 not downloaded yet
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9385/20499385/docs_service_history-1774787754100.jpg?ixlib=js-3.8.0&auto=format&s=9bae4015fdd4c35d6f9353bf22c70d7e> (referer: None)
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f35cca450>
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9385%252F20499385%252Fdocs_service_history-1774787754100.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9bae4015fdd4c35d6f9353bf22c70d7e') HTTP/1.1" 204 0
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9385/20499385/docs_service_history-1774787754100.jpg?ixlib=js-3.8.0&auto=format&s=9bae4015fdd4c35d6f9353bf22c70d7e saved to cache
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d8f4126-e139-5b85-bf95-298182491aac
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4776/20414776/docs_service_history-1774706715759.jpg?ixlib=js-3.8.0&auto=format&s=cdd847f44b32f412a2487ef249d3e0b9> (referer: None)
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9385/20499385/docs_service_history-1774787752368.jpg?ixlib=js-3.8.0&auto=format&s=d819d8a4836d8636e70d5e7582818023> (referer: None)
2026-03-29 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16994244.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cab80d0>
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4776%252F20414776%252Fdocs_service_history-1774706715759.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcdd847f44b32f412a2487ef249d3e0b9') HTTP/1.1" 204 0
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4776/20414776/docs_service_history-1774706715759.jpg?ixlib=js-3.8.0&auto=format&s=cdd847f44b32f412a2487ef249d3e0b9 saved to cache
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09
2026-03-29 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9385/20499385/interior_boot-1774782645836.jpg> (referer: None)
2026-03-29 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9385/20499385/interior_dashboard-1774787352873.jpg> (referer: None)
2026-03-29 20:13:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc2a750>
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9385%252F20499385%252Fdocs_service_history-1774787752368.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd819d8a4836d8636e70d5e7582818023') HTTP/1.1" 204 0
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9385/20499385/docs_service_history-1774787752368.jpg?ixlib=js-3.8.0&auto=format&s=d819d8a4836d8636e70d5e7582818023 saved to cache
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d8f4126-e139-5b85-bf95-298182491aac
2026-03-29 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1620&page=45&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d1d8302-8f23-5767-9a2b-dd0b2283726c with identifier: 16994244
2026-03-29 20:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c with scrape type 1
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4244%252F16994244%252Fexterior_front_driver-1774718907637.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_front_driver-1774718907637.jpg not downloaded yet
2026-03-29 20:13:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f424b90>
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9385%252F20499385%252Finterior_boot-1774782645836.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9385/20499385/interior_boot-1774782645836.jpg saved to cache
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d8f4126-e139-5b85-bf95-298182491aac
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d959110>
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9385%252F20499385%252Finterior_dashboard-1774787352873.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9385/20499385/interior_dashboard-1774787352873.jpg saved to cache
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d8f4126-e139-5b85-bf95-298182491aac
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4244%252F16994244%252Fexterior_rear_driver-1774718951509.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_rear_driver-1774718951509.jpg not downloaded yet
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4244%252F16994244%252Fexterior_front_passenger-1774718926187.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_front_passenger-1774718926187.jpg not downloaded yet
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20392033
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 6855795
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 6221793
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 16311303
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20477312
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20286694
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20439535
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 19648962
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20475889
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 19395541
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20377618
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720377618%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [motorway.uk] INFO: Scrape type for 20377618: 1
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4244%252F16994244%252Fexterior_rear_passenger-1774718976989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_rear_passenger-1774718976989.jpg not downloaded yet
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 13609049
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20111098
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720111098%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [motorway.uk] INFO: Scrape type for 20111098: 1
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4244%252F16994244%252Finterior_front_seats-1774718867752.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4244/16994244/interior_front_seats-1774718867752.jpg not downloaded yet
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20158063
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20461954
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20411240
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20485932
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485932%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [motorway.uk] INFO: Scrape type for 20485932: 1
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4244%252F16994244%252Finterior_rear_seats-1774718795909.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4244/16994244/interior_rear_seats-1774718795909.jpg not downloaded yet
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20080126
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720080126%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [motorway.uk] INFO: Scrape type for 20080126: 1
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4244%252F16994244%252Finterior_dashboard-1774718827913.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4244/16994244/interior_dashboard-1774718827913.jpg not downloaded yet
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 10041890
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710041890%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [motorway.uk] INFO: Scrape type for 10041890: 1
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4244%252F16994244%252Finstrument_cluster-1774718901147.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4244/16994244/instrument_cluster-1774718901147.jpg not downloaded yet
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 19794671
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20498723
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 19811025
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 7025386
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20277132
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 17822067
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717822067%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [motorway.uk] INFO: Scrape type for 17822067: 1
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4244%252F16994244%252Finterior_boot-1774718841140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4244/16994244/interior_boot-1774718841140.jpg not downloaded yet
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 2720964
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20457137
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720457137%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [motorway.uk] INFO: Scrape type for 20457137: 1
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4244%252F16994244%252Fdocs_service_history-1774719965579.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D848ccaaeeace40e248e9fb96fa181750%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4244/16994244/docs_service_history-1774719965579.jpg?ixlib=js-3.8.0&auto=format&s=848ccaaeeace40e248e9fb96fa181750 not downloaded yet
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 19525497
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719525497%27 HTTP/1.1" 200 None
2026-03-29 20:13:01 [motorway.uk] INFO: Scrape type for 19525497: 1
2026-03-29 20:13:01 [motorway.uk] INFO: Found listing with ID: 20490195
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490195%27 HTTP/1.1" 200 None
2026-03-29 20:13:02 [motorway.uk] INFO: Scrape type for 20490195: 1
2026-03-29 20:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/7172629.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:02 [motorway.uk] INFO: Found listing with ID: 20487725
2026-03-29 20:13:02 [motorway.uk] INFO: Found listing with ID: 20076469
2026-03-29 20:13:02 [motorway.uk] INFO: Found listing with ID: 18151907
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718151907%27 HTTP/1.1" 200 None
2026-03-29 20:13:02 [motorway.uk] INFO: Scrape type for 18151907: 1
2026-03-29 20:13:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:02 [motorway.uk] INFO: Found listing with ID: 20441173
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720441173%27 HTTP/1.1" 200 None
2026-03-29 20:13:02 [motorway.uk] INFO: Scrape type for 20441173: 1
2026-03-29 20:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_front_driver-1774718907637.jpg> (referer: None)
2026-03-29 20:13:02 [motorway.uk] INFO: Found listing with ID: 20363657
2026-03-29 20:13:02 [motorway.uk] INFO: Found listing with ID: 20411608
2026-03-29 20:13:02 [motorway.uk] INFO: Found listing with ID: 19896790
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719896790%27 HTTP/1.1" 200 None
2026-03-29 20:13:02 [motorway.uk] INFO: Scrape type for 19896790: 1
2026-03-29 20:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4776/20414776/interior_dashboard-1774703102640.jpg> (referer: None)
2026-03-29 20:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4776/20414776/instrument_cluster-1774703170790.jpg> (referer: None)
2026-03-29 20:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4776/20414776/interior_boot-1774703108644.jpg> (referer: None)
2026-03-29 20:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4776/20414776/interior_rear_seats-1774703132140.jpg> (referer: None)
2026-03-29 20:13:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 717b2854-fa26-5bf6-ba62-96e380834d7e with identifier: 7172629
2026-03-29 20:13:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 717b2854-fa26-5bf6-ba62-96e380834d7e with scrape type 1
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 717b2854-fa26-5bf6-ba62-96e380834d7e
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2629%252F7172629%252Fexterior_front_driver-1774780101924.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_front_driver-1774780101924.jpg not downloaded yet
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2629%252F7172629%252Fexterior_rear_driver-1774780134098.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_rear_driver-1774780134098.jpg not downloaded yet
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2629%252F7172629%252Fexterior_front_passenger-1774780112648.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_front_passenger-1774780112648.jpg not downloaded yet
2026-03-29 20:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4776/20414776/interior_front_seats-1774703162232.jpg> (referer: None)
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d29f8d0>
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4244%252F16994244%252Fexterior_front_driver-1774718907637.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_front_driver-1774718907637.jpg saved to cache
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2629%252F7172629%252Fexterior_rear_passenger-1774780123500.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_rear_passenger-1774780123500.jpg not downloaded yet
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d04bd50>
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4776%252F20414776%252Finterior_dashboard-1774703102640.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4776/20414776/interior_dashboard-1774703102640.jpg saved to cache
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2629%252F7172629%252Finterior_front_seats-1774780159700.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2629/7172629/interior_front_seats-1774780159700.jpg not downloaded yet
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2629%252F7172629%252Finterior_rear_seats-1774780191020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2629/7172629/interior_rear_seats-1774780191020.jpg not downloaded yet
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4bbd10>
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4776%252F20414776%252Finstrument_cluster-1774703170790.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4776/20414776/instrument_cluster-1774703170790.jpg saved to cache
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dcfa950>
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4776%252F20414776%252Finterior_boot-1774703108644.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4776/20414776/interior_boot-1774703108644.jpg saved to cache
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4b9210>
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4776%252F20414776%252Finterior_rear_seats-1774703132140.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4776/20414776/interior_rear_seats-1774703132140.jpg saved to cache
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f36379c90>
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4776%252F20414776%252Finterior_front_seats-1774703162232.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4776/20414776/interior_front_seats-1774703162232.jpg saved to cache
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2629%252F7172629%252Finterior_dashboard-1774780220282.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2629/7172629/interior_dashboard-1774780220282.jpg not downloaded yet
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20145284.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2629%252F7172629%252Finstrument_cluster-1774783435778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2629/7172629/instrument_cluster-1774783435778.jpg not downloaded yet
2026-03-29 20:13:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2629%252F7172629%252Finterior_boot-1774780232871.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2629/7172629/interior_boot-1774780232871.jpg not downloaded yet
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2629%252F7172629%252Fdocs_service_history-1774782013045.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcb0e2885f9f0d3b20e91b91b177492c8%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2629/7172629/docs_service_history-1774782013045.jpg?ixlib=js-3.8.0&auto=format&s=cb0e2885f9f0d3b20e91b91b177492c8 not downloaded yet
2026-03-29 20:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5 with identifier: 20145284
2026-03-29 20:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5 with scrape type 1
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5284%252F20145284%252Fexterior_front_driver-1774534007006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_front_driver-1774534007006.jpg not downloaded yet
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5284%252F20145284%252Fexterior_rear_driver-1774534021988.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_rear_driver-1774534021988.jpg not downloaded yet
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5284%252F20145284%252Fexterior_front_passenger-1774534043075.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_front_passenger-1774534043075.jpg not downloaded yet
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5284%252F20145284%252Fexterior_rear_passenger-1774534032837.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_rear_passenger-1774534032837.jpg not downloaded yet
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5284%252F20145284%252Finterior_front_seats-1774534265948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5284/20145284/interior_front_seats-1774534265948.jpg not downloaded yet
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5284%252F20145284%252Finterior_rear_seats-1774534277134.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5284/20145284/interior_rear_seats-1774534277134.jpg not downloaded yet
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5284%252F20145284%252Finterior_dashboard-1774534310792.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5284/20145284/interior_dashboard-1774534310792.jpg not downloaded yet
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5284%252F20145284%252Finstrument_cluster-1774534374754.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5284/20145284/instrument_cluster-1774534374754.jpg not downloaded yet
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5284%252F20145284%252Finterior_boot-1774534312929.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5284/20145284/interior_boot-1774534312929.jpg not downloaded yet
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2629/7172629/interior_front_seats-1774780159700.jpg> (referer: None)
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5284%252F20145284%252Fdocs_service_history-1774535196048.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc7851b9ba77dc378d4c119ca9e575324%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5284/20145284/docs_service_history-1774535196048.jpg?ixlib=js-3.8.0&auto=format&s=c7851b9ba77dc378d4c119ca9e575324 not downloaded yet
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2629/7172629/interior_rear_seats-1774780191020.jpg> (referer: None)
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_rear_passenger-1774780123500.jpg> (referer: None)
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_front_passenger-1774780112648.jpg> (referer: None)
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db77650>
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2629%252F7172629%252Finterior_front_seats-1774780159700.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2629/7172629/interior_front_seats-1774780159700.jpg saved to cache
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 717b2854-fa26-5bf6-ba62-96e380834d7e
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c3b90>
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2629%252F7172629%252Finterior_rear_seats-1774780191020.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2629/7172629/interior_rear_seats-1774780191020.jpg saved to cache
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 717b2854-fa26-5bf6-ba62-96e380834d7e
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c801590>
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2629%252F7172629%252Fexterior_rear_passenger-1774780123500.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_rear_passenger-1774780123500.jpg saved to cache
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 717b2854-fa26-5bf6-ba62-96e380834d7e
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dee4290>
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2629%252F7172629%252Fexterior_front_passenger-1774780112648.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_front_passenger-1774780112648.jpg saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 717b2854-fa26-5bf6-ba62-96e380834d7e
2026-03-29 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2629/7172629/interior_dashboard-1774780220282.jpg> (referer: None)
2026-03-29 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5284/20145284/docs_service_history-1774535196048.jpg?ixlib=js-3.8.0&auto=format&s=c7851b9ba77dc378d4c119ca9e575324> (referer: None)
2026-03-29 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5284/20145284/instrument_cluster-1774534374754.jpg> (referer: None)
2026-03-29 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5284/20145284/interior_boot-1774534312929.jpg> (referer: None)
2026-03-29 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5284/20145284/interior_dashboard-1774534310792.jpg> (referer: None)
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb8dbd0>
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2629%252F7172629%252Finterior_dashboard-1774780220282.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2629/7172629/interior_dashboard-1774780220282.jpg saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 717b2854-fa26-5bf6-ba62-96e380834d7e
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6a3110>
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5284%252F20145284%252Fdocs_service_history-1774535196048.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc7851b9ba77dc378d4c119ca9e575324') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5284/20145284/docs_service_history-1774535196048.jpg?ixlib=js-3.8.0&auto=format&s=c7851b9ba77dc378d4c119ca9e575324 saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a19d0>
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5284%252F20145284%252Finstrument_cluster-1774534374754.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5284/20145284/instrument_cluster-1774534374754.jpg saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da85090>
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5284%252F20145284%252Finterior_boot-1774534312929.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5284/20145284/interior_boot-1774534312929.jpg saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a7750>
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5284%252F20145284%252Finterior_dashboard-1774534310792.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5284/20145284/interior_dashboard-1774534310792.jpg saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5
2026-03-29 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5284/20145284/interior_rear_seats-1774534277134.jpg> (referer: None)
2026-03-29 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5284/20145284/interior_front_seats-1774534265948.jpg> (referer: None)
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4bd090>
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5284%252F20145284%252Finterior_rear_seats-1774534277134.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5284/20145284/interior_rear_seats-1774534277134.jpg saved to cache
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20269930.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19118754.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dee4310>
2026-03-29 20:13:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5284%252F20145284%252Finterior_front_seats-1774534265948.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5284/20145284/interior_front_seats-1774534265948.jpg saved to cache
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489216.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c30d05d-f943-51be-b248-769031cd5553 with identifier: 20269930
2026-03-29 20:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c30d05d-f943-51be-b248-769031cd5553 with scrape type 1
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c30d05d-f943-51be-b248-769031cd5553
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9930%252F20269930%252Fexterior_front_driver-1774702701488.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9930/20269930/exterior_front_driver-1774702701488.jpg not downloaded yet
2026-03-29 20:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aaf2803-bca0-5020-bb91-e7668607cc6a with identifier: 19118754
2026-03-29 20:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aaf2803-bca0-5020-bb91-e7668607cc6a with scrape type 1
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6aaf2803-bca0-5020-bb91-e7668607cc6a
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8754%252F19118754%252Fexterior_front_driver-1774707057697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_front_driver-1774707057697.jpg not downloaded yet
2026-03-29 20:13:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20311195.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9930%252F20269930%252Fexterior_rear_driver-1774702716027.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9930/20269930/exterior_rear_driver-1774702716027.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8754%252F19118754%252Fexterior_rear_driver-1774707092891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_rear_driver-1774707092891.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9930%252F20269930%252Fexterior_front_passenger-1774701037597.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9930/20269930/exterior_front_passenger-1774701037597.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8754%252F19118754%252Fexterior_front_passenger-1774707123247.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_front_passenger-1774707123247.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9930%252F20269930%252Fexterior_rear_passenger-1774702770696.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9930/20269930/exterior_rear_passenger-1774702770696.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8754%252F19118754%252Fexterior_rear_passenger-1774707107727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_rear_passenger-1774707107727.jpg not downloaded yet
2026-03-29 20:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6 with identifier: 20489216
2026-03-29 20:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6 with scrape type 1
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9216%252F20489216%252Fexterior_front_driver-1774706768483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_front_driver-1774706768483.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9930%252F20269930%252Finterior_front_seats-1774701607651.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9930/20269930/interior_front_seats-1774701607651.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8754%252F19118754%252Finterior_front_seats-1774707617056.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8754/19118754/interior_front_seats-1774707617056.jpg not downloaded yet
2026-03-29 20:13:05 [scrapy.extensions.logstats] INFO: Crawled 350 pages (at 58 pages/min), scraped 163 items (at 15 items/min)
2026-03-29 20:13:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 302MiB
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9216%252F20489216%252Fexterior_rear_driver-1774706812238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_rear_driver-1774706812238.jpg not downloaded yet
2026-03-29 20:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94cf2789-c990-5f55-aed6-e0c4fe835d86 with identifier: 20311195
2026-03-29 20:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94cf2789-c990-5f55-aed6-e0c4fe835d86 with scrape type 1
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94cf2789-c990-5f55-aed6-e0c4fe835d86
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1195%252F20311195%252Fexterior_front_driver-1774021033383.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_front_driver-1774021033383.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9930%252F20269930%252Finterior_rear_seats-1774701656432.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9930/20269930/interior_rear_seats-1774701656432.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8754%252F19118754%252Finterior_rear_seats-1774707638946.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8754/19118754/interior_rear_seats-1774707638946.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9216%252F20489216%252Fexterior_front_passenger-1774706772870.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_front_passenger-1774706772870.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1195%252F20311195%252Fexterior_rear_driver-1774021073367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_rear_driver-1774021073367.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9930%252F20269930%252Finterior_dashboard-1774702758702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9930/20269930/interior_dashboard-1774702758702.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8754%252F19118754%252Finterior_dashboard-1774710541783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8754/19118754/interior_dashboard-1774710541783.jpg not downloaded yet
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20398366.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9216%252F20489216%252Fexterior_rear_passenger-1774706770715.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_rear_passenger-1774706770715.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1195%252F20311195%252Fexterior_front_passenger-1774021123305.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_front_passenger-1774021123305.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9930%252F20269930%252Finstrument_cluster-1774701697489.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9930/20269930/instrument_cluster-1774701697489.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8754%252F19118754%252Finstrument_cluster-1774707878166.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8754/19118754/instrument_cluster-1774707878166.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9216%252F20489216%252Finterior_front_seats-1774707441310.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9216/20489216/interior_front_seats-1774707441310.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1195%252F20311195%252Fexterior_rear_passenger-1774021100526.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_rear_passenger-1774021100526.jpg not downloaded yet
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_rear_driver-1774780134098.jpg> (referer: None)
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9930%252F20269930%252Finterior_boot-1774701723943.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9930/20269930/interior_boot-1774701723943.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8754%252F19118754%252Finterior_boot-1774707678205.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8754/19118754/interior_boot-1774707678205.jpg not downloaded yet
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_rear_driver-1774534021988.jpg> (referer: None)
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9216%252F20489216%252Finterior_rear_seats-1774707439204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9216/20489216/interior_rear_seats-1774707439204.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1195%252F20311195%252Finterior_front_seats-1774021714871.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1195/20311195/interior_front_seats-1774021714871.jpg not downloaded yet
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_front_driver-1774534007006.jpg> (referer: None)
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_front_passenger-1774534043075.jpg> (referer: None)
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9930%252F20269930%252Fdocs_service_history-1774701845766.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daac8bc1173a1f555db23c94f23a6573f%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9930/20269930/docs_service_history-1774701845766.jpg?ixlib=js-3.8.0&auto=format&s=aac8bc1173a1f555db23c94f23a6573f not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8754%252F19118754%252Fwheels_front_driver-1774707340360.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8754/19118754/wheels_front_driver-1774707340360.jpg not downloaded yet
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9361295.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9216%252F20489216%252Finterior_dashboard-1774708215154.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9216/20489216/interior_dashboard-1774708215154.jpg not downloaded yet
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1195%252F20311195%252Finterior_rear_seats-1774021507435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1195/20311195/interior_rear_seats-1774021507435.jpg not downloaded yet
2026-03-29 20:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823 with identifier: 20398366
2026-03-29 20:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823 with scrape type 1
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8366%252F20398366%252Fexterior_front_driver-1774605463722.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_front_driver-1774605463722.jpg not downloaded yet
2026-03-29 20:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2629/7172629/docs_service_history-1774782013045.jpg?ixlib=js-3.8.0&auto=format&s=cb0e2885f9f0d3b20e91b91b177492c8> (referer: None)
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9216%252F20489216%252Finstrument_cluster-1774707256340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9216/20489216/instrument_cluster-1774707256340.jpg not downloaded yet
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1195%252F20311195%252Finterior_dashboard-1774701252127.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1195/20311195/interior_dashboard-1774701252127.jpg not downloaded yet
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8366%252F20398366%252Fexterior_rear_driver-1774605495415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_rear_driver-1774605495415.jpg not downloaded yet
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9ae690>
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2629%252F7172629%252Fexterior_rear_driver-1774780134098.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_rear_driver-1774780134098.jpg saved to cache
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 717b2854-fa26-5bf6-ba62-96e380834d7e
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db777d0>
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5284%252F20145284%252Fexterior_rear_driver-1774534021988.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_rear_driver-1774534021988.jpg saved to cache
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5
2026-03-29 20:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_rear_passenger-1774534032837.jpg> (referer: None)
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9216%252F20489216%252Finterior_boot-1774707443763.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9216/20489216/interior_boot-1774707443763.jpg not downloaded yet
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1195%252F20311195%252Finstrument_cluster-1774021594347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1195/20311195/instrument_cluster-1774021594347.jpg not downloaded yet
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8366%252F20398366%252Fexterior_front_passenger-1774605532664.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_front_passenger-1774605532664.jpg not downloaded yet
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9216%252F20489216%252Fwheels_front_driver-1774706882284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9216/20489216/wheels_front_driver-1774706882284.jpg not downloaded yet
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1195%252F20311195%252Finterior_boot-1774021614775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1195/20311195/interior_boot-1774021614775.jpg not downloaded yet
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7ab150>
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5284%252F20145284%252Fexterior_front_driver-1774534007006.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_front_driver-1774534007006.jpg saved to cache
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7772d0>
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5284%252F20145284%252Fexterior_front_passenger-1774534043075.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_front_passenger-1774534043075.jpg saved to cache
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5
2026-03-29 20:13:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43de1c0d-df4c-5082-9740-8502f08ae692 with identifier: 9361295
2026-03-29 20:13:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43de1c0d-df4c-5082-9740-8502f08ae692 with scrape type 1
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43de1c0d-df4c-5082-9740-8502f08ae692
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1295%252F9361295%252Fexterior_front_driver-1774458295094.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_front_driver-1774458295094.jpg not downloaded yet
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca41410>
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2629%252F7172629%252Fdocs_service_history-1774782013045.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcb0e2885f9f0d3b20e91b91b177492c8') HTTP/1.1" 204 0
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2629/7172629/docs_service_history-1774782013045.jpg?ixlib=js-3.8.0&auto=format&s=cb0e2885f9f0d3b20e91b91b177492c8 saved to cache
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 717b2854-fa26-5bf6-ba62-96e380834d7e
2026-03-29 20:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2629/7172629/interior_boot-1774780232871.jpg> (referer: None)
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8366%252F20398366%252Fexterior_rear_passenger-1774605510221.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_rear_passenger-1774605510221.jpg not downloaded yet
2026-03-29 20:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2629/7172629/instrument_cluster-1774783435778.jpg> (referer: None)
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1195%252F20311195%252Fdocs_service_history-1774701729973.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D87143e19fba40ed3ce18cec8bf76ed69%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1195/20311195/docs_service_history-1774701729973.jpg?ixlib=js-3.8.0&auto=format&s=87143e19fba40ed3ce18cec8bf76ed69 not downloaded yet
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1295%252F9361295%252Fexterior_rear_driver-1774458334406.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_rear_driver-1774458334406.jpg not downloaded yet
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8366%252F20398366%252Finterior_front_seats-1774618911888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8366/20398366/interior_front_seats-1774618911888.jpg not downloaded yet
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5f72d0>
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5284%252F20145284%252Fexterior_rear_passenger-1774534032837.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_rear_passenger-1774534032837.jpg saved to cache
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5
2026-03-29 20:13:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5, skipping ID generation
2026-03-29 20:13:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5 with scrape type 1
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5 sending to next pipeline
2026-03-29 20:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5, identifier: 20145284
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1295%252F9361295%252Fexterior_front_passenger-1774458311472.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_front_passenger-1774458311472.jpg not downloaded yet
2026-03-29 20:13:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5 with identifier: 20145284
2026-03-29 20:13:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5 with identifier: 20145284
2026-03-29 20:13:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9d573ae5-6cdc-57ee-90ea-1504bbeda0d5 with identifier: 20145284 to the API
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_rear_passenger-1774534032837.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9d573ae5-6cdc-57ee-90ea-1504bbeda0d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM21 WGA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20145284',
'listing': 'auction',
'location': 'Tyne and Wear Sunderland',
'make': 'Vauxhall',
'model': 'Corsa',
'odometer': 24164,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1504194,
'Height': 2500,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_front_driver-1774534007006.jpg',
'Width': 3333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1441315,
'Height': 2459,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_rear_driver-1774534021988.jpg',
'Width': 3279},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1517310,
'Height': 2504,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_front_passenger-1774534043075.jpg',
'Width': 3338},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1705505,
'Height': 2724,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5284/20145284/exterior_rear_passenger-1774534032837.jpg',
'Width': 3632},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3410015,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5284/20145284/interior_front_seats-1774534265948.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3095986,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5284/20145284/interior_rear_seats-1774534277134.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1655758,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5284/20145284/interior_dashboard-1774534310792.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3050493,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5284/20145284/instrument_cluster-1774534374754.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3886189,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5284/20145284/interior_boot-1774534312929.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d573ae5-6cdc-57ee-90ea-1504bbeda0d5/9d573ae5-6cdc-57ee-90ea-1504bbeda0d5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2896567,
'Height': 3172,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5284/20145284/docs_service_history-1774535196048.jpg?ixlib=js-3.8.0&auto=format&s=c7851b9ba77dc378d4c119ca9e575324',
'Width': 2233}],
'price': 8722,
'price_includes_vat': False,
'registration_date': '2021-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Corsa SRI Premium Turbo',
'transmission': 'manual',
'trim': 'SRI Premium Turbo',
'vin': 'VXKUPHNEKM4086088',
'year': 2021}
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720145284%27 HTTP/1.1" 200 None
2026-03-29 20:13:07 [motorway.uk] INFO: Saving data for 20145284: {'created_time': 1774815187.966126, 'last_price_update_time': 1774815187.966138, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20145284') HTTP/1.1" 204 0
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8366%252F20398366%252Finterior_rear_seats-1774618933325.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8366/20398366/interior_rear_seats-1774618933325.jpg not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1295%252F9361295%252Fexterior_rear_passenger-1774458299127.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_rear_passenger-1774458299127.jpg not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8366%252F20398366%252Finterior_dashboard-1774618958897.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8366/20398366/interior_dashboard-1774618958897.jpg not downloaded yet
2026-03-29 20:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490195.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d231390>
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2629%252F7172629%252Finterior_boot-1774780232871.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2629/7172629/interior_boot-1774780232871.jpg saved to cache
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 717b2854-fa26-5bf6-ba62-96e380834d7e
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6fa550>
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2629%252F7172629%252Finstrument_cluster-1774783435778.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2629/7172629/instrument_cluster-1774783435778.jpg saved to cache
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 717b2854-fa26-5bf6-ba62-96e380834d7e
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1295%252F9361295%252Finterior_front_seats-1774458996171.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1295/9361295/interior_front_seats-1774458996171.jpg not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8366%252F20398366%252Finterior_boot-1774618973468.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8366/20398366/interior_boot-1774618973468.jpg not downloaded yet
2026-03-29 20:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20441173.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1295%252F9361295%252Finterior_rear_seats-1774458998069.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1295/9361295/interior_rear_seats-1774458998069.jpg not downloaded yet
2026-03-29 20:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 209aa2f6-dad1-5967-a176-92107de0c80d with identifier: 20490195
2026-03-29 20:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209aa2f6-dad1-5967-a176-92107de0c80d with scrape type 1
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 209aa2f6-dad1-5967-a176-92107de0c80d
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0195%252F20490195%252Fexterior_front_driver-1774714626740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_front_driver-1774714626740.jpg not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8366%252F20398366%252Fdocs_service_history-1774694516401.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da72ae9ee5a230cd3766a929583bd1c97%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8366/20398366/docs_service_history-1774694516401.jpg?ixlib=js-3.8.0&auto=format&s=a72ae9ee5a230cd3766a929583bd1c97 not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1295%252F9361295%252Finterior_dashboard-1774458990340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1295/9361295/interior_dashboard-1774458990340.jpg not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0195%252F20490195%252Fexterior_rear_driver-1774714572396.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_rear_driver-1774714572396.jpg not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8366%252F20398366%252Fdocs_service_history-1774694531849.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5251f604d7bb1f242a30e97403052763%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8366/20398366/docs_service_history-1774694531849.jpg?ixlib=js-3.8.0&auto=format&s=5251f604d7bb1f242a30e97403052763 not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1295%252F9361295%252Finterior_boot-1774458975772.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1295/9361295/interior_boot-1774458975772.jpg not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0195%252F20490195%252Fexterior_front_passenger-1774714549238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_front_passenger-1774714549238.jpg not downloaded yet
2026-03-29 20:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccebdeaa-e386-51dc-b5ba-e0d46e46060d with identifier: 20441173
2026-03-29 20:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d with scrape type 1
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1173%252F20441173%252Fexterior_front_driver-1774718801199.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1173/20441173/exterior_front_driver-1774718801199.jpg not downloaded yet
2026-03-29 20:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_front_driver-1774707057697.jpg> (referer: None)
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1295%252F9361295%252Fdocs_service_history-1774465583575.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7b24dfa5609cf124d977422bf8305297%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1295/9361295/docs_service_history-1774465583575.jpg?ixlib=js-3.8.0&auto=format&s=7b24dfa5609cf124d977422bf8305297 not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0195%252F20490195%252Fexterior_rear_passenger-1774714611798.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_rear_passenger-1774714611798.jpg not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1173%252F20441173%252Fexterior_rear_driver-1774717639580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1173/20441173/exterior_rear_driver-1774717639580.jpg not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1295%252F9361295%252Fdocs_service_history-1774465584392.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3400c371996887e142716a47d816f49f%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1295/9361295/docs_service_history-1774465584392.jpg?ixlib=js-3.8.0&auto=format&s=3400c371996887e142716a47d816f49f not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0195%252F20490195%252Finterior_front_seats-1774715280936.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0195/20490195/interior_front_seats-1774715280936.jpg not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1173%252F20441173%252Fexterior_front_passenger-1774775798801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1173/20441173/exterior_front_passenger-1774775798801.jpg not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0195%252F20490195%252Finterior_rear_seats-1774715204185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0195/20490195/interior_rear_seats-1774715204185.jpg not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1173%252F20441173%252Fexterior_rear_passenger-1774775813673.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1173/20441173/exterior_rear_passenger-1774775813673.jpg not downloaded yet
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0195%252F20490195%252Finterior_dashboard-1774715235906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0195/20490195/interior_dashboard-1774715235906.jpg not downloaded yet
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d597050>
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8754%252F19118754%252Fexterior_front_driver-1774707057697.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_front_driver-1774707057697.jpg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6aaf2803-bca0-5020-bb91-e7668607cc6a
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1173%252F20441173%252Finterior_front_seats-1774718070213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1173/20441173/interior_front_seats-1774718070213.jpg not downloaded yet
2026-03-29 20:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_rear_passenger-1774021100526.jpg> (referer: None)
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0195%252F20490195%252Finstrument_cluster-1774715223812.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0195/20490195/instrument_cluster-1774715223812.jpg not downloaded yet
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1173%252F20441173%252Finterior_rear_seats-1774718068675.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1173/20441173/interior_rear_seats-1774718068675.jpg not downloaded yet
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0195%252F20490195%252Finterior_boot-1774715257074.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0195/20490195/interior_boot-1774715257074.jpg not downloaded yet
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1173%252F20441173%252Finterior_dashboard-1774718082509.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1173/20441173/interior_dashboard-1774718082509.jpg not downloaded yet
2026-03-29 20:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1195/20311195/docs_service_history-1774701729973.jpg?ixlib=js-3.8.0&auto=format&s=87143e19fba40ed3ce18cec8bf76ed69> (referer: None)
2026-03-29 20:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_front_passenger-1774458311472.jpg> (referer: None)
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0195%252F20490195%252Fdocs_service_history-1774716893361.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8971bcf5ea063ceab55a59119f29865f%27 HTTP/1.1" 200 None
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0195/20490195/docs_service_history-1774716893361.jpg?ixlib=js-3.8.0&auto=format&s=8971bcf5ea063ceab55a59119f29865f not downloaded yet
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1173%252F20441173%252Finterior_boot-1774718071177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1173/20441173/interior_boot-1774718071177.jpg not downloaded yet
2026-03-29 20:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_front_driver-1774458295094.jpg> (referer: None)
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1173%252F20441173%252Fdocs_service_history-1774718303331.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De4d5beb81d89de0bf290a6cf8c0d74b6%27 HTTP/1.1" 200 None
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1173/20441173/docs_service_history-1774718303331.jpg?ixlib=js-3.8.0&auto=format&s=e4d5beb81d89de0bf290a6cf8c0d74b6 not downloaded yet
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc5bcd0>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1195%252F20311195%252Fexterior_rear_passenger-1774021100526.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_rear_passenger-1774021100526.jpg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94cf2789-c990-5f55-aed6-e0c4fe835d86
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1173%252F20441173%252Fdocs_service_history-1774718312018.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dec54e7f3fff2c1ee32d1ea5d29d6c069%27 HTTP/1.1" 200 None
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1173/20441173/docs_service_history-1774718312018.jpg?ixlib=js-3.8.0&auto=format&s=ec54e7f3fff2c1ee32d1ea5d29d6c069 not downloaded yet
2026-03-29 20:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8754/19118754/interior_dashboard-1774710541783.jpg> (referer: None)
2026-03-29 20:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1173/20441173/exterior_front_driver-1774718801199.jpg> (referer: None)
2026-03-29 20:13:09 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:13:09 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:13:09 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x009id\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\x84\x9e\x009E\x94\x00\x00\x00\x00'
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0e3e90>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1195%252F20311195%252Fdocs_service_history-1774701729973.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D87143e19fba40ed3ce18cec8bf76ed69') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1195/20311195/docs_service_history-1774701729973.jpg?ixlib=js-3.8.0&auto=format&s=87143e19fba40ed3ce18cec8bf76ed69 saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94cf2789-c990-5f55-aed6-e0c4fe835d86
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d125090>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1295%252F9361295%252Fexterior_front_passenger-1774458311472.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_front_passenger-1774458311472.jpg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43de1c0d-df4c-5082-9740-8502f08ae692
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f436e10>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1295%252F9361295%252Fexterior_front_driver-1774458295094.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_front_driver-1774458295094.jpg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43de1c0d-df4c-5082-9740-8502f08ae692
2026-03-29 20:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_rear_passenger-1774605510221.jpg> (referer: None)
2026-03-29 20:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9216/20489216/interior_front_seats-1774707441310.jpg> (referer: None)
2026-03-29 20:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_rear_driver-1774458334406.jpg> (referer: None)
2026-03-29 20:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_rear_passenger-1774458299127.jpg> (referer: None)
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc96690>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8754%252F19118754%252Finterior_dashboard-1774710541783.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8754/19118754/interior_dashboard-1774710541783.jpg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6aaf2803-bca0-5020-bb91-e7668607cc6a
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d857e50>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1173%252F20441173%252Fexterior_front_driver-1774718801199.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1173/20441173/exterior_front_driver-1774718801199.jpg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c655110>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8366%252F20398366%252Fexterior_rear_passenger-1774605510221.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_rear_passenger-1774605510221.jpg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d7f1010>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9216%252F20489216%252Finterior_front_seats-1774707441310.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9216/20489216/interior_front_seats-1774707441310.jpg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d66d5d0>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1295%252F9361295%252Fexterior_rear_driver-1774458334406.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_rear_driver-1774458334406.jpg saved to cache
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43de1c0d-df4c-5082-9740-8502f08ae692
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0681d0>
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1295%252F9361295%252Fexterior_rear_passenger-1774458299127.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_rear_passenger-1774458299127.jpg saved to cache
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43de1c0d-df4c-5082-9740-8502f08ae692
2026-03-29 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8366/20398366/interior_front_seats-1774618911888.jpg> (referer: None)
2026-03-29 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1173/20441173/interior_front_seats-1774718070213.jpg> (referer: None)
2026-03-29 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1173/20441173/docs_service_history-1774718312018.jpg?ixlib=js-3.8.0&auto=format&s=ec54e7f3fff2c1ee32d1ea5d29d6c069> (referer: None)
2026-03-29 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8366/20398366/interior_rear_seats-1774618933325.jpg> (referer: None)
2026-03-29 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0195/20490195/docs_service_history-1774716893361.jpg?ixlib=js-3.8.0&auto=format&s=8971bcf5ea063ceab55a59119f29865f> (referer: None)
2026-03-29 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0195/20490195/interior_boot-1774715257074.jpg> (referer: None)
2026-03-29 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1173/20441173/docs_service_history-1774718303331.jpg?ixlib=js-3.8.0&auto=format&s=e4d5beb81d89de0bf290a6cf8c0d74b6> (referer: None)
2026-03-29 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1173/20441173/interior_rear_seats-1774718068675.jpg> (referer: None)
2026-03-29 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1173/20441173/interior_boot-1774718071177.jpg> (referer: None)
2026-03-29 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1295/9361295/interior_front_seats-1774458996171.jpg> (referer: None)
2026-03-29 20:13:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d66ea50>
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8366%252F20398366%252Finterior_front_seats-1774618911888.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8366/20398366/interior_front_seats-1774618911888.jpg saved to cache
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8b1a90>
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1173%252F20441173%252Finterior_front_seats-1774718070213.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1173/20441173/interior_front_seats-1774718070213.jpg saved to cache
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7998d0>
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1173%252F20441173%252Fdocs_service_history-1774718312018.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dec54e7f3fff2c1ee32d1ea5d29d6c069') HTTP/1.1" 204 0
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1173/20441173/docs_service_history-1774718312018.jpg?ixlib=js-3.8.0&auto=format&s=ec54e7f3fff2c1ee32d1ea5d29d6c069 saved to cache
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d
2026-03-29 20:13:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c701750>
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8366%252F20398366%252Finterior_rear_seats-1774618933325.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8366/20398366/interior_rear_seats-1774618933325.jpg saved to cache
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f354637d0>
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0195%252F20490195%252Fdocs_service_history-1774716893361.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8971bcf5ea063ceab55a59119f29865f') HTTP/1.1" 204 0
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0195/20490195/docs_service_history-1774716893361.jpg?ixlib=js-3.8.0&auto=format&s=8971bcf5ea063ceab55a59119f29865f saved to cache
2026-03-29 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 209aa2f6-dad1-5967-a176-92107de0c80d
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c827d50>
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0195%252F20490195%252Finterior_boot-1774715257074.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0195/20490195/interior_boot-1774715257074.jpg saved to cache
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 209aa2f6-dad1-5967-a176-92107de0c80d
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6e4e90>
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1173%252F20441173%252Fdocs_service_history-1774718303331.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De4d5beb81d89de0bf290a6cf8c0d74b6') HTTP/1.1" 204 0
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1173/20441173/docs_service_history-1774718303331.jpg?ixlib=js-3.8.0&auto=format&s=e4d5beb81d89de0bf290a6cf8c0d74b6 saved to cache
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7025d0>
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1173%252F20441173%252Finterior_rear_seats-1774718068675.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1173/20441173/interior_rear_seats-1774718068675.jpg saved to cache
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6e41d0>
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1173%252F20441173%252Finterior_boot-1774718071177.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1173/20441173/interior_boot-1774718071177.jpg saved to cache
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d
2026-03-29 20:13:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c824890>
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1295%252F9361295%252Finterior_front_seats-1774458996171.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1295/9361295/interior_front_seats-1774458996171.jpg saved to cache
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43de1c0d-df4c-5082-9740-8502f08ae692
2026-03-29 20:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0195/20490195/instrument_cluster-1774715223812.jpg> (referer: None)
2026-03-29 20:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0195/20490195/interior_dashboard-1774715235906.jpg> (referer: None)
2026-03-29 20:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1173/20441173/exterior_rear_passenger-1774775813673.jpg> (referer: None)
2026-03-29 20:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1173/20441173/interior_dashboard-1774718082509.jpg> (referer: None)
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1f6550>
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0195%252F20490195%252Finstrument_cluster-1774715223812.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0195/20490195/instrument_cluster-1774715223812.jpg saved to cache
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 209aa2f6-dad1-5967-a176-92107de0c80d
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1f7210>
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0195%252F20490195%252Finterior_dashboard-1774715235906.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0195/20490195/interior_dashboard-1774715235906.jpg saved to cache
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 209aa2f6-dad1-5967-a176-92107de0c80d
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c536310>
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1173%252F20441173%252Fexterior_rear_passenger-1774775813673.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1173/20441173/exterior_rear_passenger-1774775813673.jpg saved to cache
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c537e10>
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1173%252F20441173%252Finterior_dashboard-1774718082509.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1173/20441173/interior_dashboard-1774718082509.jpg saved to cache
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1295/9361295/docs_service_history-1774465584392.jpg?ixlib=js-3.8.0&auto=format&s=3400c371996887e142716a47d816f49f> (referer: None)
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_rear_driver-1774714572396.jpg> (referer: None)
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1173/20441173/exterior_rear_driver-1774717639580.jpg> (referer: None)
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0195/20490195/interior_rear_seats-1774715204185.jpg> (referer: None)
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0195/20490195/interior_front_seats-1774715280936.jpg> (referer: None)
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_front_passenger-1774714549238.jpg> (referer: None)
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1173/20441173/exterior_front_passenger-1774775798801.jpg> (referer: None)
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_rear_passenger-1774714611798.jpg> (referer: None)
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1295/9361295/docs_service_history-1774465583575.jpg?ixlib=js-3.8.0&auto=format&s=7b24dfa5609cf124d977422bf8305297> (referer: None)
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1295/9361295/interior_boot-1774458975772.jpg> (referer: None)
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d52d2d0>
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1295%252F9361295%252Fdocs_service_history-1774465584392.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3400c371996887e142716a47d816f49f') HTTP/1.1" 204 0
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1295/9361295/docs_service_history-1774465584392.jpg?ixlib=js-3.8.0&auto=format&s=3400c371996887e142716a47d816f49f saved to cache
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43de1c0d-df4c-5082-9740-8502f08ae692
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8366/20398366/docs_service_history-1774694531849.jpg?ixlib=js-3.8.0&auto=format&s=5251f604d7bb1f242a30e97403052763> (referer: None)
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f27cdd0>
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0195%252F20490195%252Fexterior_rear_driver-1774714572396.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_rear_driver-1774714572396.jpg saved to cache
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 209aa2f6-dad1-5967-a176-92107de0c80d
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f27d250>
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1173%252F20441173%252Fexterior_rear_driver-1774717639580.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1173/20441173/exterior_rear_driver-1774717639580.jpg saved to cache
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db55f10>
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0195%252F20490195%252Finterior_rear_seats-1774715204185.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0195/20490195/interior_rear_seats-1774715204185.jpg saved to cache
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 209aa2f6-dad1-5967-a176-92107de0c80d
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d747e10>
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0195%252F20490195%252Finterior_front_seats-1774715280936.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0195/20490195/interior_front_seats-1774715280936.jpg saved to cache
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 209aa2f6-dad1-5967-a176-92107de0c80d
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db57f50>
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0195%252F20490195%252Fexterior_front_passenger-1774714549238.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_front_passenger-1774714549238.jpg saved to cache
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 209aa2f6-dad1-5967-a176-92107de0c80d
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5c5150>
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1173%252F20441173%252Fexterior_front_passenger-1774775798801.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1173/20441173/exterior_front_passenger-1774775798801.jpg saved to cache
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d
2026-03-29 20:13:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ccebdeaa-e386-51dc-b5ba-e0d46e46060d, skipping ID generation
2026-03-29 20:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d with scrape type 1
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ccebdeaa-e386-51dc-b5ba-e0d46e46060d sending to next pipeline
2026-03-29 20:13:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ccebdeaa-e386-51dc-b5ba-e0d46e46060d, identifier: 20441173
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0b05d0>
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0195%252F20490195%252Fexterior_rear_passenger-1774714611798.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_rear_passenger-1774714611798.jpg saved to cache
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 209aa2f6-dad1-5967-a176-92107de0c80d
2026-03-29 20:13:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d972610>
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1295%252F9361295%252Fdocs_service_history-1774465583575.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7b24dfa5609cf124d977422bf8305297') HTTP/1.1" 204 0
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1295/9361295/docs_service_history-1774465583575.jpg?ixlib=js-3.8.0&auto=format&s=7b24dfa5609cf124d977422bf8305297 saved to cache
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43de1c0d-df4c-5082-9740-8502f08ae692
2026-03-29 20:13:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d66cf50>
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1295%252F9361295%252Finterior_boot-1774458975772.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1295/9361295/interior_boot-1774458975772.jpg saved to cache
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43de1c0d-df4c-5082-9740-8502f08ae692
2026-03-29 20:13:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ccebdeaa-e386-51dc-b5ba-e0d46e46060d with identifier: 20441173
2026-03-29 20:13:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ccebdeaa-e386-51dc-b5ba-e0d46e46060d with identifier: 20441173
2026-03-29 20:13:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ccebdeaa-e386-51dc-b5ba-e0d46e46060d with identifier: 20441173 to the API
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/1173/20441173/exterior_front_passenger-1774775798801.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ccebdeaa-e386-51dc-b5ba-e0d46e46060d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GD17 JVN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20441173',
'listing': 'auction',
'location': 'West Midlands Solihull',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 66919,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 944767,
'Height': 2643,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1173/20441173/exterior_front_driver-1774718801199.jpg',
'Width': 3524},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1097324,
'Height': 2258,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1173/20441173/exterior_rear_driver-1774717639580.jpg',
'Width': 3010},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1636605,
'Height': 2448,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1173/20441173/exterior_front_passenger-1774775798801.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2105050,
'Height': 2774,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1173/20441173/exterior_rear_passenger-1774775813673.jpg',
'Width': 3699},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1726978,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1173/20441173/interior_front_seats-1774718070213.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2912215,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1173/20441173/interior_rear_seats-1774718068675.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2382674,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1173/20441173/interior_dashboard-1774718082509.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2589831,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1173/20441173/interior_boot-1774718071177.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1912339,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1173/20441173/docs_service_history-1774718303331.jpg?ixlib=js-3.8.0&auto=format&s=e4d5beb81d89de0bf290a6cf8c0d74b6',
'Width': 2880},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccebdeaa-e386-51dc-b5ba-e0d46e46060d/ccebdeaa-e386-51dc-b5ba-e0d46e46060d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1090169,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1173/20441173/docs_service_history-1774718312018.jpg?ixlib=js-3.8.0&auto=format&s=ec54e7f3fff2c1ee32d1ea5d29d6c069',
'Width': 2880}],
'price': 6796,
'price_includes_vat': False,
'registration_date': '2017-05-25',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Octavia SE L TSI',
'transmission': 'manual',
'trim': 'SE L TSI',
'vin': 'TMBBC7NEXJ0052458',
'year': 2017}
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720441173%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [motorway.uk] INFO: Saving data for 20441173: {'created_time': 1774815194.54245, 'last_price_update_time': 1774815194.542463, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20441173') HTTP/1.1" 204 0
2026-03-29 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/7903453.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0e2b90>
2026-03-29 20:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8366%252F20398366%252Fdocs_service_history-1774694531849.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5251f604d7bb1f242a30e97403052763') HTTP/1.1" 204 0
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8366/20398366/docs_service_history-1774694531849.jpg?ixlib=js-3.8.0&auto=format&s=5251f604d7bb1f242a30e97403052763 saved to cache
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823
2026-03-29 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8366/20398366/docs_service_history-1774694516401.jpg?ixlib=js-3.8.0&auto=format&s=a72ae9ee5a230cd3766a929583bd1c97> (referer: None)
2026-03-29 20:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a6545c8-c333-58c1-b3ca-13dad136e68b with identifier: 7903453
2026-03-29 20:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6545c8-c333-58c1-b3ca-13dad136e68b with scrape type 1
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a6545c8-c333-58c1-b3ca-13dad136e68b
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3453%252F7903453%252Fexterior_front_driver-1774630501396.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_front_driver-1774630501396.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3453%252F7903453%252Fexterior_rear_driver-1774630537478.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_rear_driver-1774630537478.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3453%252F7903453%252Fexterior_front_passenger-1774531492499.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_front_passenger-1774531492499.jpg not downloaded yet
2026-03-29 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_front_driver-1774714626740.jpg> (referer: None)
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3453%252F7903453%252Fexterior_rear_passenger-1774630518498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_rear_passenger-1774630518498.jpg not downloaded yet
2026-03-29 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1295/9361295/interior_dashboard-1774458990340.jpg> (referer: None)
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3453%252F7903453%252Finterior_front_seats-1774630229385.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3453/7903453/interior_front_seats-1774630229385.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3453%252F7903453%252Finterior_rear_seats-1774630313917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3453/7903453/interior_rear_seats-1774630313917.jpg not downloaded yet
2026-03-29 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20409554.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d929590>
2026-03-29 20:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8366%252F20398366%252Fdocs_service_history-1774694516401.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da72ae9ee5a230cd3766a929583bd1c97') HTTP/1.1" 204 0
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8366/20398366/docs_service_history-1774694516401.jpg?ixlib=js-3.8.0&auto=format&s=a72ae9ee5a230cd3766a929583bd1c97 saved to cache
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3453%252F7903453%252Finterior_dashboard-1774630367256.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3453/7903453/interior_dashboard-1774630367256.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3453%252F7903453%252Finstrument_cluster-1774630407338.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3453/7903453/instrument_cluster-1774630407338.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3453%252F7903453%252Finterior_boot-1774630367702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3453/7903453/interior_boot-1774630367702.jpg not downloaded yet
2026-03-29 20:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db35210>
2026-03-29 20:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0195%252F20490195%252Fexterior_front_driver-1774714626740.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_front_driver-1774714626740.jpg saved to cache
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 209aa2f6-dad1-5967-a176-92107de0c80d
2026-03-29 20:13:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 209aa2f6-dad1-5967-a176-92107de0c80d, skipping ID generation
2026-03-29 20:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209aa2f6-dad1-5967-a176-92107de0c80d with scrape type 1
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 209aa2f6-dad1-5967-a176-92107de0c80d sending to next pipeline
2026-03-29 20:13:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 209aa2f6-dad1-5967-a176-92107de0c80d, identifier: 20490195
2026-03-29 20:13:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c826e10>
2026-03-29 20:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1295%252F9361295%252Finterior_dashboard-1774458990340.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1295/9361295/interior_dashboard-1774458990340.jpg saved to cache
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43de1c0d-df4c-5082-9740-8502f08ae692
2026-03-29 20:13:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 209aa2f6-dad1-5967-a176-92107de0c80d with identifier: 20490195
2026-03-29 20:13:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 209aa2f6-dad1-5967-a176-92107de0c80d with identifier: 20490195
2026-03-29 20:13:15 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 209aa2f6-dad1-5967-a176-92107de0c80d with identifier: 20490195 to the API
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_front_driver-1774714626740.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '209aa2f6-dad1-5967-a176-92107de0c80d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FH15 LCU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20490195',
'listing': 'auction',
'location': 'Swansea Swansea',
'make': 'Volkswagen',
'model': 'Jetta',
'odometer': 63906,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 36,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1392397,
'Height': 2759,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_front_driver-1774714626740.jpg',
'Width': 3679},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 782373,
'Height': 2471,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_rear_driver-1774714572396.jpg',
'Width': 3294},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1481566,
'Height': 2612,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_front_passenger-1774714549238.jpg',
'Width': 3483},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1511348,
'Height': 2671,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0195/20490195/exterior_rear_passenger-1774714611798.jpg',
'Width': 3561},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1517193,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/0195/20490195/interior_front_seats-1774715280936.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1464662,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/0195/20490195/interior_rear_seats-1774715204185.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1756422,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0195/20490195/interior_dashboard-1774715235906.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 949446,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0195/20490195/instrument_cluster-1774715223812.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2246959,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/0195/20490195/interior_boot-1774715257074.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209aa2f6-dad1-5967-a176-92107de0c80d/209aa2f6-dad1-5967-a176-92107de0c80d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1481209,
'Height': 2891,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0195/20490195/docs_service_history-1774716893361.jpg?ixlib=js-3.8.0&auto=format&s=8971bcf5ea063ceab55a59119f29865f',
'Width': 3840}],
'price': 4581,
'price_includes_vat': False,
'registration_date': '2015-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Jetta SE BlueMotion Tech TDI',
'transmission': 'manual',
'trim': 'SE BlueMotion Tech TDI',
'vin': 'WVWZZZ16ZFM026377',
'year': 2015}
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490195%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [motorway.uk] INFO: Saving data for 20490195: {'created_time': 1774815195.721306, 'last_price_update_time': 1774815195.721316, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20490195') HTTP/1.1" 204 0
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3453%252F7903453%252Fdocs_service_history-1774630866785.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5601c737426ea75513c58779f11dcefb%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3453/7903453/docs_service_history-1774630866785.jpg?ixlib=js-3.8.0&auto=format&s=5601c737426ea75513c58779f11dcefb not downloaded yet
2026-03-29 20:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55774551-b45a-563d-ad6c-4319d093fe4e with identifier: 20409554
2026-03-29 20:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55774551-b45a-563d-ad6c-4319d093fe4e with scrape type 1
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55774551-b45a-563d-ad6c-4319d093fe4e
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9554%252F20409554%252Fexterior_front_driver-1774689696244.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9554/20409554/exterior_front_driver-1774689696244.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9554%252F20409554%252Fexterior_rear_driver-1774682000789.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9554/20409554/exterior_rear_driver-1774682000789.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9554%252F20409554%252Fexterior_front_passenger-1774681995506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9554/20409554/exterior_front_passenger-1774681995506.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9554%252F20409554%252Fexterior_rear_passenger-1774682026304.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9554/20409554/exterior_rear_passenger-1774682026304.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9554%252F20409554%252Finterior_front_seats-1774682441117.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9554/20409554/interior_front_seats-1774682441117.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9554%252F20409554%252Finterior_rear_seats-1774682434747.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9554/20409554/interior_rear_seats-1774682434747.jpg not downloaded yet
2026-03-29 20:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9216/20489216/wheels_front_driver-1774706882284.jpg> (referer: None)
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9554%252F20409554%252Finterior_dashboard-1774689587850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9554/20409554/interior_dashboard-1774689587850.jpg not downloaded yet
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9554%252F20409554%252Finstrument_cluster-1774682458429.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9554/20409554/instrument_cluster-1774682458429.jpg not downloaded yet
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9554%252F20409554%252Finterior_boot-1774682436714.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9554/20409554/interior_boot-1774682436714.jpg not downloaded yet
2026-03-29 20:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_rear_driver-1774630537478.jpg> (referer: None)
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9554%252F20409554%252Fdamage_scratches-1774682063100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9554/20409554/damage_scratches-1774682063100.jpg not downloaded yet
2026-03-29 20:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_front_passenger-1774605532664.jpg> (referer: None)
2026-03-29 20:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_front_driver-1774605463722.jpg> (referer: None)
2026-03-29 20:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8366/20398366/interior_dashboard-1774618958897.jpg> (referer: None)
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd49fd0>
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9216%252F20489216%252Fwheels_front_driver-1774706882284.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9216/20489216/wheels_front_driver-1774706882284.jpg saved to cache
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6
2026-03-29 20:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1195/20311195/interior_dashboard-1774701252127.jpg> (referer: None)
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8aa350>
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3453%252F7903453%252Fexterior_rear_driver-1774630537478.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_rear_driver-1774630537478.jpg saved to cache
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a6545c8-c333-58c1-b3ca-13dad136e68b
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f493b90>
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8366%252F20398366%252Fexterior_front_passenger-1774605532664.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_front_passenger-1774605532664.jpg saved to cache
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d015c90>
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8366%252F20398366%252Fexterior_front_driver-1774605463722.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_front_driver-1774605463722.jpg saved to cache
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c788c50>
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8366%252F20398366%252Finterior_dashboard-1774618958897.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8366/20398366/interior_dashboard-1774618958897.jpg saved to cache
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823
2026-03-29 20:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_rear_driver-1774605495415.jpg> (referer: None)
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c79c350>
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1195%252F20311195%252Finterior_dashboard-1774701252127.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1195/20311195/interior_dashboard-1774701252127.jpg saved to cache
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94cf2789-c990-5f55-aed6-e0c4fe835d86
2026-03-29 20:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9216/20489216/instrument_cluster-1774707256340.jpg> (referer: None)
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d736e10>
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8366%252F20398366%252Fexterior_rear_driver-1774605495415.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_rear_driver-1774605495415.jpg saved to cache
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823
2026-03-29 20:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1295/9361295/interior_rear_seats-1774458998069.jpg> (referer: None)
2026-03-29 20:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1195/20311195/instrument_cluster-1774021594347.jpg> (referer: None)
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1933d0>
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9216%252F20489216%252Finstrument_cluster-1774707256340.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9216/20489216/instrument_cluster-1774707256340.jpg saved to cache
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6
2026-03-29 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9216/20489216/interior_boot-1774707443763.jpg> (referer: None)
2026-03-29 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1195/20311195/interior_boot-1774021614775.jpg> (referer: None)
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2541d0>
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1295%252F9361295%252Finterior_rear_seats-1774458998069.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1295/9361295/interior_rear_seats-1774458998069.jpg saved to cache
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43de1c0d-df4c-5082-9740-8502f08ae692
2026-03-29 20:13:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43de1c0d-df4c-5082-9740-8502f08ae692, skipping ID generation
2026-03-29 20:13:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43de1c0d-df4c-5082-9740-8502f08ae692 with scrape type 1
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43de1c0d-df4c-5082-9740-8502f08ae692 sending to next pipeline
2026-03-29 20:13:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 43de1c0d-df4c-5082-9740-8502f08ae692, identifier: 9361295
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1bca50>
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1195%252F20311195%252Finstrument_cluster-1774021594347.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1195/20311195/instrument_cluster-1774021594347.jpg saved to cache
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94cf2789-c990-5f55-aed6-e0c4fe835d86
2026-03-29 20:13:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 43de1c0d-df4c-5082-9740-8502f08ae692 with identifier: 9361295
2026-03-29 20:13:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 43de1c0d-df4c-5082-9740-8502f08ae692 with identifier: 9361295
2026-03-29 20:13:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 43de1c0d-df4c-5082-9740-8502f08ae692 with identifier: 9361295 to the API
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/1295/9361295/interior_rear_seats-1774458998069.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '43de1c0d-df4c-5082-9740-8502f08ae692',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GFZ 8999',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/9361295',
'listing': 'auction',
'location': 'Hampshire Waterlooville',
'make': 'Kia',
'model': 'Sportage',
'odometer': 122000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1226813,
'Height': 2544,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_front_driver-1774458295094.jpg',
'Width': 3392},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1518061,
'Height': 2899,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_rear_driver-1774458334406.jpg',
'Width': 3865},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 818955,
'Height': 2195,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_front_passenger-1774458311472.jpg',
'Width': 2926},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1395839,
'Height': 2895,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1295/9361295/exterior_rear_passenger-1774458299127.jpg',
'Width': 3860},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3726148,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1295/9361295/interior_front_seats-1774458996171.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3906185,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1295/9361295/interior_rear_seats-1774458998069.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3393937,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1295/9361295/interior_dashboard-1774458990340.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4051997,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1295/9361295/interior_boot-1774458975772.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2346097,
'Height': 2950,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1295/9361295/docs_service_history-1774465583575.jpg?ixlib=js-3.8.0&auto=format&s=7b24dfa5609cf124d977422bf8305297',
'Width': 2097},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43de1c0d-df4c-5082-9740-8502f08ae692/43de1c0d-df4c-5082-9740-8502f08ae692_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559527,
'Height': 3411,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1295/9361295/docs_service_history-1774465584392.jpg?ixlib=js-3.8.0&auto=format&s=3400c371996887e142716a47d816f49f',
'Width': 2330}],
'price': 2338,
'price_includes_vat': False,
'registration_date': '2011-07-22',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage KX-3 SAT NAV CRDI A',
'transmission': 'automatic',
'trim': 'KX-3 SAT NAV CRDI A',
'vin': 'U5YPC813SCL079199',
'year': 2011}
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279361295%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [motorway.uk] INFO: Saving data for 9361295: {'created_time': 1774815197.749825, 'last_price_update_time': 1774815197.749836, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='9361295') HTTP/1.1" 204 0
2026-03-29 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8366/20398366/interior_boot-1774618973468.jpg> (referer: None)
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daa2650>
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9216%252F20489216%252Finterior_boot-1774707443763.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9216/20489216/interior_boot-1774707443763.jpg saved to cache
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c79ea90>
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1195%252F20311195%252Finterior_boot-1774021614775.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1195/20311195/interior_boot-1774021614775.jpg saved to cache
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94cf2789-c990-5f55-aed6-e0c4fe835d86
2026-03-29 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3453/7903453/interior_boot-1774630367702.jpg> (referer: None)
2026-03-29 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3453/7903453/docs_service_history-1774630866785.jpg?ixlib=js-3.8.0&auto=format&s=5601c737426ea75513c58779f11dcefb> (referer: None)
2026-03-29 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9554/20409554/interior_rear_seats-1774682434747.jpg> (referer: None)
2026-03-29 20:13:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a9bd0>
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8366%252F20398366%252Finterior_boot-1774618973468.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8366/20398366/interior_boot-1774618973468.jpg saved to cache
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823
2026-03-29 20:13:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823, skipping ID generation
2026-03-29 20:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823 with scrape type 1
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823 sending to next pipeline
2026-03-29 20:13:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823, identifier: 20398366
2026-03-29 20:13:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823 with identifier: 20398366
2026-03-29 20:13:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823 with identifier: 20398366
2026-03-29 20:13:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823 with identifier: 20398366 to the API
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8366/20398366/interior_boot-1774618973468.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DF17 OYA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20398366',
'listing': 'auction',
'location': 'Greater Manchester Oldham',
'make': 'Audi',
'model': 'S3',
'odometer': 53281,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1434444,
'Height': 2206,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_front_driver-1774605463722.jpg',
'Width': 2941},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2060199,
'Height': 2628,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_rear_driver-1774605495415.jpg',
'Width': 3504},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1436219,
'Height': 2210,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_front_passenger-1774605532664.jpg',
'Width': 2947},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1308782,
'Height': 2219,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8366/20398366/exterior_rear_passenger-1774605510221.jpg',
'Width': 2958},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2770118,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8366/20398366/interior_front_seats-1774618911888.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3101907,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8366/20398366/interior_rear_seats-1774618933325.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1459604,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8366/20398366/interior_dashboard-1774618958897.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4550803,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8366/20398366/interior_boot-1774618973468.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577304,
'Height': 2721,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8366/20398366/docs_service_history-1774694516401.jpg?ixlib=js-3.8.0&auto=format&s=a72ae9ee5a230cd3766a929583bd1c97',
'Width': 1964},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823/4ab7a2dc-3dc0-5b87-a80c-9e9a01b12823_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3134879,
'Height': 3404,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8366/20398366/docs_service_history-1774694531849.jpg?ixlib=js-3.8.0&auto=format&s=5251f604d7bb1f242a30e97403052763',
'Width': 1969}],
'price': 17967,
'price_includes_vat': False,
'registration_date': '2017-07-11',
'seats_number': None,
'seller_name': None,
'title': 'Audi S3 Black ED TFSI Quattro S-A',
'transmission': 'automatic',
'trim': 'Black ED TFSI Quattro S-A',
'vin': 'WAUZZZ8V9JA002369',
'year': 2017}
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720398366%27 HTTP/1.1" 200 None
2026-03-29 20:13:18 [motorway.uk] INFO: Saving data for 20398366: {'created_time': 1774815198.739273, 'last_price_update_time': 1774815198.739284, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20398366') HTTP/1.1" 204 0
2026-03-29 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9554/20409554/instrument_cluster-1774682458429.jpg> (referer: None)
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f491810>
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3453%252F7903453%252Finterior_boot-1774630367702.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3453/7903453/interior_boot-1774630367702.jpg saved to cache
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a6545c8-c333-58c1-b3ca-13dad136e68b
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d502b50>
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3453%252F7903453%252Fdocs_service_history-1774630866785.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5601c737426ea75513c58779f11dcefb') HTTP/1.1" 204 0
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3453/7903453/docs_service_history-1774630866785.jpg?ixlib=js-3.8.0&auto=format&s=5601c737426ea75513c58779f11dcefb saved to cache
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a6545c8-c333-58c1-b3ca-13dad136e68b
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de23dd0>
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9554%252F20409554%252Finterior_rear_seats-1774682434747.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9554/20409554/interior_rear_seats-1774682434747.jpg saved to cache
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55774551-b45a-563d-ad6c-4319d093fe4e
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9554/20409554/interior_dashboard-1774689587850.jpg> (referer: None)
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9554/20409554/exterior_front_passenger-1774681995506.jpg> (referer: None)
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c78bdd0>
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9554%252F20409554%252Finstrument_cluster-1774682458429.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9554/20409554/instrument_cluster-1774682458429.jpg saved to cache
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55774551-b45a-563d-ad6c-4319d093fe4e
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9554/20409554/interior_boot-1774682436714.jpg> (referer: None)
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9554/20409554/damage_scratches-1774682063100.jpg> (referer: None)
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9554/20409554/exterior_rear_passenger-1774682026304.jpg> (referer: None)
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9554/20409554/interior_front_seats-1774682441117.jpg> (referer: None)
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c789ad0>
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9554%252F20409554%252Finterior_dashboard-1774689587850.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9554/20409554/interior_dashboard-1774689587850.jpg saved to cache
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55774551-b45a-563d-ad6c-4319d093fe4e
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e05de50>
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9554%252F20409554%252Fexterior_front_passenger-1774681995506.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9554/20409554/exterior_front_passenger-1774681995506.jpg saved to cache
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55774551-b45a-563d-ad6c-4319d093fe4e
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1a1790>
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9554%252F20409554%252Finterior_boot-1774682436714.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9554/20409554/interior_boot-1774682436714.jpg saved to cache
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55774551-b45a-563d-ad6c-4319d093fe4e
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e191010>
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9554%252F20409554%252Fdamage_scratches-1774682063100.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9554/20409554/damage_scratches-1774682063100.jpg saved to cache
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55774551-b45a-563d-ad6c-4319d093fe4e
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e05ced0>
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9554%252F20409554%252Fexterior_rear_passenger-1774682026304.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9554/20409554/exterior_rear_passenger-1774682026304.jpg saved to cache
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55774551-b45a-563d-ad6c-4319d093fe4e
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f471210>
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9554%252F20409554%252Finterior_front_seats-1774682441117.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9554/20409554/interior_front_seats-1774682441117.jpg saved to cache
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55774551-b45a-563d-ad6c-4319d093fe4e
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_front_passenger-1774531492499.jpg> (referer: None)
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9554/20409554/exterior_front_driver-1774689696244.jpg> (referer: None)
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9554/20409554/exterior_rear_driver-1774682000789.jpg> (referer: None)
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_rear_passenger-1774630518498.jpg> (referer: None)
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3453/7903453/interior_dashboard-1774630367256.jpg> (referer: None)
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3453/7903453/interior_front_seats-1774630229385.jpg> (referer: None)
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3453/7903453/interior_rear_seats-1774630313917.jpg> (referer: None)
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1195/20311195/interior_rear_seats-1774021507435.jpg> (referer: None)
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9216/20489216/interior_dashboard-1774708215154.jpg> (referer: None)
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3453/7903453/instrument_cluster-1774630407338.jpg> (referer: None)
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2deec910>
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3453%252F7903453%252Fexterior_front_passenger-1774531492499.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_front_passenger-1774531492499.jpg saved to cache
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a6545c8-c333-58c1-b3ca-13dad136e68b
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d735e90>
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9554%252F20409554%252Fexterior_front_driver-1774689696244.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9554/20409554/exterior_front_driver-1774689696244.jpg saved to cache
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55774551-b45a-563d-ad6c-4319d093fe4e
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d283cd0>
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9554%252F20409554%252Fexterior_rear_driver-1774682000789.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9554/20409554/exterior_rear_driver-1774682000789.jpg saved to cache
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55774551-b45a-563d-ad6c-4319d093fe4e
2026-03-29 20:13:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55774551-b45a-563d-ad6c-4319d093fe4e, skipping ID generation
2026-03-29 20:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55774551-b45a-563d-ad6c-4319d093fe4e with scrape type 1
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55774551-b45a-563d-ad6c-4319d093fe4e sending to next pipeline
2026-03-29 20:13:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 55774551-b45a-563d-ad6c-4319d093fe4e, identifier: 20409554
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1bcd50>
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3453%252F7903453%252Fexterior_rear_passenger-1774630518498.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_rear_passenger-1774630518498.jpg saved to cache
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a6545c8-c333-58c1-b3ca-13dad136e68b
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f381890>
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3453%252F7903453%252Finterior_dashboard-1774630367256.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3453/7903453/interior_dashboard-1774630367256.jpg saved to cache
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a6545c8-c333-58c1-b3ca-13dad136e68b
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c79c090>
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3453%252F7903453%252Finterior_front_seats-1774630229385.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3453/7903453/interior_front_seats-1774630229385.jpg saved to cache
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a6545c8-c333-58c1-b3ca-13dad136e68b
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d281110>
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3453%252F7903453%252Finterior_rear_seats-1774630313917.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3453/7903453/interior_rear_seats-1774630313917.jpg saved to cache
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a6545c8-c333-58c1-b3ca-13dad136e68b
2026-03-29 20:13:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e191950>
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1195%252F20311195%252Finterior_rear_seats-1774021507435.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1195/20311195/interior_rear_seats-1774021507435.jpg saved to cache
2026-03-29 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94cf2789-c990-5f55-aed6-e0c4fe835d86
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0df350>
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9216%252F20489216%252Finterior_dashboard-1774708215154.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9216/20489216/interior_dashboard-1774708215154.jpg saved to cache
2026-03-29 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1af150>
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3453%252F7903453%252Finstrument_cluster-1774630407338.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3453/7903453/instrument_cluster-1774630407338.jpg saved to cache
2026-03-29 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a6545c8-c333-58c1-b3ca-13dad136e68b
2026-03-29 20:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 55774551-b45a-563d-ad6c-4319d093fe4e with identifier: 20409554
2026-03-29 20:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 55774551-b45a-563d-ad6c-4319d093fe4e with identifier: 20409554
2026-03-29 20:13:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 55774551-b45a-563d-ad6c-4319d093fe4e with identifier: 20409554 to the API
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9554/20409554/exterior_rear_driver-1774682000789.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '55774551-b45a-563d-ad6c-4319d093fe4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SK10 LSV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20409554',
'listing': 'auction',
'location': 'Northamptonshire Wellingborough',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 70000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 891529,
'Height': 2549,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9554/20409554/exterior_front_driver-1774689696244.jpg',
'Width': 3399},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1392811,
'Height': 2862,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9554/20409554/exterior_rear_driver-1774682000789.jpg',
'Width': 3816},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 935393,
'Height': 2254,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9554/20409554/exterior_front_passenger-1774681995506.jpg',
'Width': 3005},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1247709,
'Height': 2611,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9554/20409554/exterior_rear_passenger-1774682026304.jpg',
'Width': 3481},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2173048,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9554/20409554/interior_front_seats-1774682441117.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1766212,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9554/20409554/interior_rear_seats-1774682434747.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1472365,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9554/20409554/interior_dashboard-1774689587850.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1586459,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9554/20409554/instrument_cluster-1774682458429.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1607477,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9554/20409554/interior_boot-1774682436714.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55774551-b45a-563d-ad6c-4319d093fe4e/55774551-b45a-563d-ad6c-4319d093fe4e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1590786,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9554/20409554/damage_scratches-1774682063100.jpg',
'Width': 3840}],
'price': 1451,
'price_includes_vat': False,
'registration_date': '2010-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Zetec',
'transmission': 'manual',
'trim': 'Zetec',
'vin': 'WF0GXXGAJG9G41769',
'year': 2010}
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720409554%27 HTTP/1.1" 200 None
2026-03-29 20:13:21 [motorway.uk] INFO: Saving data for 20409554: {'created_time': 1774815201.751113, 'last_price_update_time': 1774815201.751123, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20409554') HTTP/1.1" 204 0
2026-03-29 20:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9930/20269930/docs_service_history-1774701845766.jpg?ixlib=js-3.8.0&auto=format&s=aac8bc1173a1f555db23c94f23a6573f> (referer: None)
2026-03-29 20:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_front_driver-1774630501396.jpg> (referer: None)
2026-03-29 20:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8754/19118754/wheels_front_driver-1774707340360.jpg> (referer: None)
2026-03-29 20:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9216/20489216/interior_rear_seats-1774707439204.jpg> (referer: None)
2026-03-29 20:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8754/19118754/instrument_cluster-1774707878166.jpg> (referer: None)
2026-03-29 20:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9930/20269930/instrument_cluster-1774701697489.jpg> (referer: None)
2026-03-29 20:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8754/19118754/interior_boot-1774707678205.jpg> (referer: None)
2026-03-29 20:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9930/20269930/interior_boot-1774701723943.jpg> (referer: None)
2026-03-29 20:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1195/20311195/interior_front_seats-1774021714871.jpg> (referer: None)
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c767d90>
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9930%252F20269930%252Fdocs_service_history-1774701845766.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daac8bc1173a1f555db23c94f23a6573f') HTTP/1.1" 204 0
2026-03-29 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9930/20269930/docs_service_history-1774701845766.jpg?ixlib=js-3.8.0&auto=format&s=aac8bc1173a1f555db23c94f23a6573f saved to cache
2026-03-29 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c30d05d-f943-51be-b248-769031cd5553
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce2de50>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3453%252F7903453%252Fexterior_front_driver-1774630501396.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_front_driver-1774630501396.jpg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a6545c8-c333-58c1-b3ca-13dad136e68b
2026-03-29 20:13:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a6545c8-c333-58c1-b3ca-13dad136e68b, skipping ID generation
2026-03-29 20:13:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6545c8-c333-58c1-b3ca-13dad136e68b with scrape type 1
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a6545c8-c333-58c1-b3ca-13dad136e68b sending to next pipeline
2026-03-29 20:13:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4a6545c8-c333-58c1-b3ca-13dad136e68b, identifier: 7903453
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de21610>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8754%252F19118754%252Fwheels_front_driver-1774707340360.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8754/19118754/wheels_front_driver-1774707340360.jpg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6aaf2803-bca0-5020-bb91-e7668607cc6a
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3d3210>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9216%252F20489216%252Finterior_rear_seats-1774707439204.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9216/20489216/interior_rear_seats-1774707439204.jpg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d056f50>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8754%252F19118754%252Finstrument_cluster-1774707878166.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8754/19118754/instrument_cluster-1774707878166.jpg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6aaf2803-bca0-5020-bb91-e7668607cc6a
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f490c50>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9930%252F20269930%252Finstrument_cluster-1774701697489.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9930/20269930/instrument_cluster-1774701697489.jpg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c30d05d-f943-51be-b248-769031cd5553
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3d0a10>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8754%252F19118754%252Finterior_boot-1774707678205.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8754/19118754/interior_boot-1774707678205.jpg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6aaf2803-bca0-5020-bb91-e7668607cc6a
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1edf90>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9930%252F20269930%252Finterior_boot-1774701723943.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9930/20269930/interior_boot-1774701723943.jpg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c30d05d-f943-51be-b248-769031cd5553
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce1a390>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1195%252F20311195%252Finterior_front_seats-1774021714871.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1195/20311195/interior_front_seats-1774021714871.jpg saved to cache
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94cf2789-c990-5f55-aed6-e0c4fe835d86
2026-03-29 20:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4a6545c8-c333-58c1-b3ca-13dad136e68b with identifier: 7903453
2026-03-29 20:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4a6545c8-c333-58c1-b3ca-13dad136e68b with identifier: 7903453
2026-03-29 20:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4a6545c8-c333-58c1-b3ca-13dad136e68b with identifier: 7903453 to the API
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_front_driver-1774630501396.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '4a6545c8-c333-58c1-b3ca-13dad136e68b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WG14 AYM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/7903453',
'listing': 'auction',
'location': 'Plymouth Plymouth',
'make': 'Renault',
'model': 'Megane',
'odometer': 75700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1101669,
'Height': 2180,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_front_driver-1774630501396.jpg',
'Width': 2907},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1229507,
'Height': 2116,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_rear_driver-1774630537478.jpg',
'Width': 2821},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379021,
'Height': 2423,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_front_passenger-1774531492499.jpg',
'Width': 3231},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1352561,
'Height': 2268,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3453/7903453/exterior_rear_passenger-1774630518498.jpg',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2337900,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/3453/7903453/interior_front_seats-1774630229385.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2701883,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/3453/7903453/interior_rear_seats-1774630313917.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1776011,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3453/7903453/interior_dashboard-1774630367256.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2368267,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3453/7903453/instrument_cluster-1774630407338.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2472180,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/3453/7903453/interior_boot-1774630367702.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6545c8-c333-58c1-b3ca-13dad136e68b/4a6545c8-c333-58c1-b3ca-13dad136e68b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1599562,
'Height': 3060,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3453/7903453/docs_service_history-1774630866785.jpg?ixlib=js-3.8.0&auto=format&s=5601c737426ea75513c58779f11dcefb',
'Width': 4080}],
'price': 2022,
'price_includes_vat': False,
'registration_date': '2014-05-31',
'seats_number': None,
'seller_name': None,
'title': 'Renault Megane D-QUE TT Energy DCI S/S',
'transmission': 'manual',
'trim': 'D-QUE TT Energy DCI S/S',
'vin': 'VF1BZ140650904923',
'year': 2014}
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277903453%27 HTTP/1.1" 200 None
2026-03-29 20:13:23 [motorway.uk] INFO: Saving data for 7903453: {'created_time': 1774815203.542365, 'last_price_update_time': 1774815203.542376, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='7903453') HTTP/1.1" 204 0
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_front_passenger-1774706772870.jpg> (referer: None)
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_front_driver-1774021033383.jpg> (referer: None)
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_rear_driver-1774021073367.jpg> (referer: None)
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_rear_passenger-1774706770715.jpg> (referer: None)
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_front_passenger-1774021123305.jpg> (referer: None)
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_rear_driver-1774706812238.jpg> (referer: None)
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9930/20269930/interior_dashboard-1774702758702.jpg> (referer: None)
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8754/19118754/interior_rear_seats-1774707638946.jpg> (referer: None)
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9930/20269930/interior_rear_seats-1774701656432.jpg> (referer: None)
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9930/20269930/exterior_front_passenger-1774701037597.jpg> (referer: None)
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9930/20269930/exterior_rear_passenger-1774702770696.jpg> (referer: None)
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8ab890>
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9216%252F20489216%252Fexterior_front_passenger-1774706772870.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_front_passenger-1774706772870.jpg saved to cache
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8a8c10>
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1195%252F20311195%252Fexterior_front_driver-1774021033383.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_front_driver-1774021033383.jpg saved to cache
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94cf2789-c990-5f55-aed6-e0c4fe835d86
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0636d0>
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1195%252F20311195%252Fexterior_rear_driver-1774021073367.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_rear_driver-1774021073367.jpg saved to cache
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94cf2789-c990-5f55-aed6-e0c4fe835d86
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4d76d0>
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9216%252F20489216%252Fexterior_rear_passenger-1774706770715.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_rear_passenger-1774706770715.jpg saved to cache
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8eda50>
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1195%252F20311195%252Fexterior_front_passenger-1774021123305.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_front_passenger-1774021123305.jpg saved to cache
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94cf2789-c990-5f55-aed6-e0c4fe835d86
2026-03-29 20:13:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94cf2789-c990-5f55-aed6-e0c4fe835d86, skipping ID generation
2026-03-29 20:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94cf2789-c990-5f55-aed6-e0c4fe835d86 with scrape type 1
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94cf2789-c990-5f55-aed6-e0c4fe835d86 sending to next pipeline
2026-03-29 20:13:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 94cf2789-c990-5f55-aed6-e0c4fe835d86, identifier: 20311195
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1db110>
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9216%252F20489216%252Fexterior_rear_driver-1774706812238.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_rear_driver-1774706812238.jpg saved to cache
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c665150>
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9930%252F20269930%252Finterior_dashboard-1774702758702.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9930/20269930/interior_dashboard-1774702758702.jpg saved to cache
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c30d05d-f943-51be-b248-769031cd5553
2026-03-29 20:13:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd40190>
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8754%252F19118754%252Finterior_rear_seats-1774707638946.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8754/19118754/interior_rear_seats-1774707638946.jpg saved to cache
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6aaf2803-bca0-5020-bb91-e7668607cc6a
2026-03-29 20:13:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f500750>
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9930%252F20269930%252Finterior_rear_seats-1774701656432.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9930/20269930/interior_rear_seats-1774701656432.jpg saved to cache
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c30d05d-f943-51be-b248-769031cd5553
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4d7650>
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9930%252F20269930%252Fexterior_front_passenger-1774701037597.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9930/20269930/exterior_front_passenger-1774701037597.jpg saved to cache
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c30d05d-f943-51be-b248-769031cd5553
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce2fb10>
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9930%252F20269930%252Fexterior_rear_passenger-1774702770696.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9930/20269930/exterior_rear_passenger-1774702770696.jpg saved to cache
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c30d05d-f943-51be-b248-769031cd5553
2026-03-29 20:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 94cf2789-c990-5f55-aed6-e0c4fe835d86 with identifier: 20311195
2026-03-29 20:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 94cf2789-c990-5f55-aed6-e0c4fe835d86 with identifier: 20311195
2026-03-29 20:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 94cf2789-c990-5f55-aed6-e0c4fe835d86 with identifier: 20311195 to the API
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_front_passenger-1774021123305.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '94cf2789-c990-5f55-aed6-e0c4fe835d86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DU18 NDK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20311195',
'listing': 'auction',
'location': 'West Midlands Halesowen',
'make': 'Vauxhall',
'model': 'Grandland',
'odometer': 64340,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1361163,
'Height': 2514,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_front_driver-1774021033383.jpg',
'Width': 3352},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1482196,
'Height': 2907,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_rear_driver-1774021073367.jpg',
'Width': 3876},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1882456,
'Height': 2936,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_front_passenger-1774021123305.jpg',
'Width': 3915},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1635280,
'Height': 2642,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1195/20311195/exterior_rear_passenger-1774021100526.jpg',
'Width': 3522},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3657474,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1195/20311195/interior_front_seats-1774021714871.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4639847,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1195/20311195/interior_rear_seats-1774021507435.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2478247,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1195/20311195/interior_dashboard-1774701252127.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2411363,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1195/20311195/instrument_cluster-1774021594347.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2850763,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1195/20311195/interior_boot-1774021614775.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94cf2789-c990-5f55-aed6-e0c4fe835d86/94cf2789-c990-5f55-aed6-e0c4fe835d86_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1078107,
'Height': 2416,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1195/20311195/docs_service_history-1774701729973.jpg?ixlib=js-3.8.0&auto=format&s=87143e19fba40ed3ce18cec8bf76ed69',
'Width': 1812}],
'price': 5938,
'price_includes_vat': False,
'registration_date': '2018-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Grandland X Sport NAV Turbo SS',
'transmission': 'manual',
'trim': 'X Sport NAV Turbo SS',
'vin': 'W0VZRHNY7JS241012',
'year': 2018}
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720311195%27 HTTP/1.1" 200 None
2026-03-29 20:13:25 [motorway.uk] INFO: Saving data for 20311195: {'created_time': 1774815205.563612, 'last_price_update_time': 1774815205.563623, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20311195') HTTP/1.1" 204 0
2026-03-29 20:13:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_front_driver-1774706768483.jpg> (referer: None)
2026-03-29 20:13:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9930/20269930/exterior_rear_driver-1774702716027.jpg> (referer: None)
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_rear_driver-1774707092891.jpg> (referer: None)
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_rear_passenger-1774707107727.jpg> (referer: None)
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_front_passenger-1774707123247.jpg> (referer: None)
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9930/20269930/interior_front_seats-1774701607651.jpg> (referer: None)
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8754/19118754/interior_front_seats-1774707617056.jpg> (referer: None)
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_front_driver-1774780101924.jpg> (referer: None)
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddd7b50>
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9216%252F20489216%252Fexterior_front_driver-1774706768483.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_front_driver-1774706768483.jpg saved to cache
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6
2026-03-29 20:13:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6, skipping ID generation
2026-03-29 20:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6 with scrape type 1
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6 sending to next pipeline
2026-03-29 20:13:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6, identifier: 20489216
2026-03-29 20:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6 with identifier: 20489216
2026-03-29 20:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6 with identifier: 20489216
2026-03-29 20:13:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0d5c1871-9e0a-5af7-9c7a-2627e5887ac6 with identifier: 20489216 to the API
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_front_driver-1774706768483.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '0d5c1871-9e0a-5af7-9c7a-2627e5887ac6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GC63 GAZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20489216',
'listing': 'auction',
'location': 'North Ayrshire Council West Kilbride',
'make': 'Ford',
'model': 'Puma',
'odometer': 11000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1539204,
'Height': 2281,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_front_driver-1774706768483.jpg',
'Width': 3041},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1880323,
'Height': 2729,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_rear_driver-1774706812238.jpg',
'Width': 3638},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1246456,
'Height': 2263,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_front_passenger-1774706772870.jpg',
'Width': 3017},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1758893,
'Height': 2846,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9216/20489216/exterior_rear_passenger-1774706770715.jpg',
'Width': 3795},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2562766,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9216/20489216/interior_front_seats-1774707441310.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2149964,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9216/20489216/interior_rear_seats-1774707439204.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2327168,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9216/20489216/interior_dashboard-1774708215154.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2041975,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9216/20489216/instrument_cluster-1774707256340.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2609069,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9216/20489216/interior_boot-1774707443763.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c1871-9e0a-5af7-9c7a-2627e5887ac6/0d5c1871-9e0a-5af7-9c7a-2627e5887ac6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 890260,
'Height': 1966,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9216/20489216/wheels_front_driver-1774706882284.jpg',
'Width': 2621}],
'price': 20125,
'price_includes_vat': False,
'registration_date': '2024-09-17',
'seats_number': None,
'seller_name': None,
'title': 'Ford Puma ST-LINE X MHEV Auto',
'transmission': 'automatic',
'trim': 'ST-LINE X MHEV Auto',
'vin': 'WF02XXERK2RG63630',
'year': 2024}
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489216%27 HTTP/1.1" 200 None
2026-03-29 20:13:26 [motorway.uk] INFO: Saving data for 20489216: {'created_time': 1774815206.318565, 'last_price_update_time': 1774815206.318578, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20489216') HTTP/1.1" 204 0
2026-03-29 20:13:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4244/16994244/interior_boot-1774718841140.jpg> (referer: None)
2026-03-29 20:13:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19896790.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c690b10>
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9930%252F20269930%252Fexterior_rear_driver-1774702716027.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9930/20269930/exterior_rear_driver-1774702716027.jpg saved to cache
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c30d05d-f943-51be-b248-769031cd5553
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7c7f90>
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8754%252F19118754%252Fexterior_rear_driver-1774707092891.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_rear_driver-1774707092891.jpg saved to cache
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6aaf2803-bca0-5020-bb91-e7668607cc6a
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da016d0>
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8754%252F19118754%252Fexterior_rear_passenger-1774707107727.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_rear_passenger-1774707107727.jpg saved to cache
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6aaf2803-bca0-5020-bb91-e7668607cc6a
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c820a10>
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8754%252F19118754%252Fexterior_front_passenger-1774707123247.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_front_passenger-1774707123247.jpg saved to cache
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6aaf2803-bca0-5020-bb91-e7668607cc6a
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f20c210>
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9930%252F20269930%252Finterior_front_seats-1774701607651.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9930/20269930/interior_front_seats-1774701607651.jpg saved to cache
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c30d05d-f943-51be-b248-769031cd5553
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7c6c10>
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8754%252F19118754%252Finterior_front_seats-1774707617056.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8754/19118754/interior_front_seats-1774707617056.jpg saved to cache
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6aaf2803-bca0-5020-bb91-e7668607cc6a
2026-03-29 20:13:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6aaf2803-bca0-5020-bb91-e7668607cc6a, skipping ID generation
2026-03-29 20:13:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aaf2803-bca0-5020-bb91-e7668607cc6a with scrape type 1
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6aaf2803-bca0-5020-bb91-e7668607cc6a sending to next pipeline
2026-03-29 20:13:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6aaf2803-bca0-5020-bb91-e7668607cc6a, identifier: 19118754
2026-03-29 20:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4b2650>
2026-03-29 20:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2629%252F7172629%252Fexterior_front_driver-1774780101924.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_front_driver-1774780101924.jpg saved to cache
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 717b2854-fa26-5bf6-ba62-96e380834d7e
2026-03-29 20:13:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 717b2854-fa26-5bf6-ba62-96e380834d7e, skipping ID generation
2026-03-29 20:13:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 717b2854-fa26-5bf6-ba62-96e380834d7e with scrape type 1
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 717b2854-fa26-5bf6-ba62-96e380834d7e sending to next pipeline
2026-03-29 20:13:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 717b2854-fa26-5bf6-ba62-96e380834d7e, identifier: 7172629
2026-03-29 20:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6aaf2803-bca0-5020-bb91-e7668607cc6a with identifier: 19118754
2026-03-29 20:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6aaf2803-bca0-5020-bb91-e7668607cc6a with identifier: 19118754
2026-03-29 20:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6aaf2803-bca0-5020-bb91-e7668607cc6a with identifier: 19118754 to the API
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8754/19118754/interior_front_seats-1774707617056.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6aaf2803-bca0-5020-bb91-e7668607cc6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CK24 WKL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19118754',
'listing': 'auction',
'location': 'Rhondda Cynon Taff Porth',
'make': 'Renault',
'model': 'Clio',
'odometer': 8153,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2017375,
'Height': 2436,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_front_driver-1774707057697.jpg',
'Width': 3248},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1886488,
'Height': 2592,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_rear_driver-1774707092891.jpg',
'Width': 3456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2012693,
'Height': 2517,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_front_passenger-1774707123247.jpg',
'Width': 3356},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1810262,
'Height': 2458,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8754/19118754/exterior_rear_passenger-1774707107727.jpg',
'Width': 3277},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3497255,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8754/19118754/interior_front_seats-1774707617056.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3070452,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8754/19118754/interior_rear_seats-1774707638946.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2355552,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8754/19118754/interior_dashboard-1774710541783.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2521773,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8754/19118754/instrument_cluster-1774707878166.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3425078,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8754/19118754/interior_boot-1774707678205.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aaf2803-bca0-5020-bb91-e7668607cc6a/6aaf2803-bca0-5020-bb91-e7668607cc6a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1853636,
'Height': 3007,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8754/19118754/wheels_front_driver-1774707340360.jpg',
'Width': 4009}],
'price': 13179,
'price_includes_vat': False,
'registration_date': '2024-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Renault Clio Techno TCE',
'transmission': 'manual',
'trim': 'Techno TCE',
'vin': 'VF1RJA00672341068',
'year': 2024}
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719118754%27 HTTP/1.1" 200 None
2026-03-29 20:13:27 [motorway.uk] INFO: Saving data for 19118754: {'created_time': 1774815207.602639, 'last_price_update_time': 1774815207.602648, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19118754') HTTP/1.1" 204 0
2026-03-29 20:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 717b2854-fa26-5bf6-ba62-96e380834d7e with identifier: 7172629
2026-03-29 20:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 717b2854-fa26-5bf6-ba62-96e380834d7e with identifier: 7172629
2026-03-29 20:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 717b2854-fa26-5bf6-ba62-96e380834d7e with identifier: 7172629 to the API
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_front_driver-1774780101924.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '717b2854-fa26-5bf6-ba62-96e380834d7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO17 EXG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/7172629',
'listing': 'auction',
'location': 'Northumberland Bedlington',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 85812,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405633,
'Height': 1691,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_front_driver-1774780101924.jpg',
'Width': 2254},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342006,
'Height': 1491,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_rear_driver-1774780134098.jpg',
'Width': 1988},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579275,
'Height': 1886,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_front_passenger-1774780112648.jpg',
'Width': 2514},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385473,
'Height': 1547,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2629/7172629/exterior_rear_passenger-1774780123500.jpg',
'Width': 2062},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1310188,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/2629/7172629/interior_front_seats-1774780159700.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1311252,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/2629/7172629/interior_rear_seats-1774780191020.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1522064,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2629/7172629/interior_dashboard-1774780220282.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1213231,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2629/7172629/instrument_cluster-1774783435778.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1618781,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/2629/7172629/interior_boot-1774780232871.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_717b2854-fa26-5bf6-ba62-96e380834d7e/717b2854-fa26-5bf6-ba62-96e380834d7e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 909659,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2629/7172629/docs_service_history-1774782013045.jpg?ixlib=js-3.8.0&auto=format&s=cb0e2885f9f0d3b20e91b91b177492c8',
'Width': 3072}],
'price': 4500,
'price_includes_vat': False,
'registration_date': '2017-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo S AC',
'transmission': 'manual',
'trim': 'S AC',
'vin': 'WVWZZZ6RZHU048327',
'year': 2017}
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277172629%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [motorway.uk] INFO: Saving data for 7172629: {'created_time': 1774815208.015473, 'last_price_update_time': 1774815208.015487, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='7172629') HTTP/1.1" 204 0
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5d3f90>
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4244%252F16994244%252Finterior_boot-1774718841140.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4244/16994244/interior_boot-1774718841140.jpg saved to cache
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c
2026-03-29 20:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd3e8cd0-5ad2-503c-9266-932f9eeb083b with identifier: 19896790
2026-03-29 20:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b with scrape type 1
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6790%252F19896790%252Fexterior_front_driver-1774282544591.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_front_driver-1774282544591.jpg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6790%252F19896790%252Fexterior_rear_driver-1774282526970.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_rear_driver-1774282526970.jpg not downloaded yet
2026-03-29 20:13:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6790%252F19896790%252Fexterior_front_passenger-1774282511206.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_front_passenger-1774282511206.jpg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6790%252F19896790%252Fexterior_rear_passenger-1774282560162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_rear_passenger-1774282560162.jpg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6790%252F19896790%252Finterior_front_seats-1774283679162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6790/19896790/interior_front_seats-1774283679162.jpg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6790%252F19896790%252Finterior_rear_seats-1774283745067.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6790/19896790/interior_rear_seats-1774283745067.jpg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6790%252F19896790%252Finterior_dashboard-1774285575899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6790/19896790/interior_dashboard-1774285575899.jpg not downloaded yet
2026-03-29 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4244/16994244/docs_service_history-1774719965579.jpg?ixlib=js-3.8.0&auto=format&s=848ccaaeeace40e248e9fb96fa181750> (referer: None)
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6790%252F19896790%252Finstrument_cluster-1774285784841.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6790/19896790/instrument_cluster-1774285784841.jpg not downloaded yet
2026-03-29 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4244/16994244/instrument_cluster-1774718901147.jpg> (referer: None)
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6790%252F19896790%252Finterior_boot-1774285711145.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6790/19896790/interior_boot-1774285711145.jpg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6790%252F19896790%252Fdocs_service_history-1774470009485.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da860819fa0331cb5599ae90fe1d588e2%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6790/19896790/docs_service_history-1774470009485.jpg?ixlib=js-3.8.0&auto=format&s=a860819fa0331cb5599ae90fe1d588e2 not downloaded yet
2026-03-29 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9930/20269930/exterior_front_driver-1774702701488.jpg> (referer: None)
2026-03-29 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_front_driver-1774282544591.jpg> (referer: None)
2026-03-29 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4244/16994244/interior_front_seats-1774718867752.jpg> (referer: None)
2026-03-29 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4244/16994244/interior_rear_seats-1774718795909.jpg> (referer: None)
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6c3250>
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4244%252F16994244%252Fdocs_service_history-1774719965579.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D848ccaaeeace40e248e9fb96fa181750') HTTP/1.1" 204 0
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4244/16994244/docs_service_history-1774719965579.jpg?ixlib=js-3.8.0&auto=format&s=848ccaaeeace40e248e9fb96fa181750 saved to cache
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6c1990>
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4244%252F16994244%252Finstrument_cluster-1774718901147.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4244/16994244/instrument_cluster-1774718901147.jpg saved to cache
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2e7790>
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9930%252F20269930%252Fexterior_front_driver-1774702701488.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9930/20269930/exterior_front_driver-1774702701488.jpg saved to cache
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c30d05d-f943-51be-b248-769031cd5553
2026-03-29 20:13:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c30d05d-f943-51be-b248-769031cd5553, skipping ID generation
2026-03-29 20:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c30d05d-f943-51be-b248-769031cd5553 with scrape type 1
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c30d05d-f943-51be-b248-769031cd5553 sending to next pipeline
2026-03-29 20:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2c30d05d-f943-51be-b248-769031cd5553, identifier: 20269930
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d67c8d0>
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6790%252F19896790%252Fexterior_front_driver-1774282544591.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_front_driver-1774282544591.jpg saved to cache
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2b5750>
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4244%252F16994244%252Finterior_front_seats-1774718867752.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4244/16994244/interior_front_seats-1774718867752.jpg saved to cache
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8e64d0>
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4244%252F16994244%252Finterior_rear_seats-1774718795909.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4244/16994244/interior_rear_seats-1774718795909.jpg saved to cache
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c
2026-03-29 20:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2c30d05d-f943-51be-b248-769031cd5553 with identifier: 20269930
2026-03-29 20:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2c30d05d-f943-51be-b248-769031cd5553 with identifier: 20269930
2026-03-29 20:13:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2c30d05d-f943-51be-b248-769031cd5553 with identifier: 20269930 to the API
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/9930/20269930/exterior_front_driver-1774702701488.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2c30d05d-f943-51be-b248-769031cd5553',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF64 KKE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20269930',
'listing': 'auction',
'location': 'Greater Manchester Sale',
'make': 'Toyota',
'model': 'Auris',
'odometer': 70712,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2401128,
'Height': 2467,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9930/20269930/exterior_front_driver-1774702701488.jpg',
'Width': 3289},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2193651,
'Height': 2444,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9930/20269930/exterior_rear_driver-1774702716027.jpg',
'Width': 3259},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2112008,
'Height': 2524,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9930/20269930/exterior_front_passenger-1774701037597.jpg',
'Width': 3365},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1974188,
'Height': 2295,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9930/20269930/exterior_rear_passenger-1774702770696.jpg',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4385751,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9930/20269930/interior_front_seats-1774701607651.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4211430,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9930/20269930/interior_rear_seats-1774701656432.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3180957,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9930/20269930/interior_dashboard-1774702758702.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3405728,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9930/20269930/instrument_cluster-1774701697489.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4381066,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9930/20269930/interior_boot-1774701723943.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c30d05d-f943-51be-b248-769031cd5553/2c30d05d-f943-51be-b248-769031cd5553_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 616814,
'Height': 2267,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9930/20269930/docs_service_history-1774701845766.jpg?ixlib=js-3.8.0&auto=format&s=aac8bc1173a1f555db23c94f23a6573f',
'Width': 3321}],
'price': 4346,
'price_includes_vat': False,
'registration_date': '2014-09-16',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Auris Icon + Dual VVT-i',
'transmission': 'manual',
'trim': 'Icon + Dual VVT-i',
'vin': 'SB1KT3JE40E017712',
'year': 2014}
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720269930%27 HTTP/1.1" 200 None
2026-03-29 20:13:29 [motorway.uk] INFO: Saving data for 20269930: {'created_time': 1774815209.670777, 'last_price_update_time': 1774815209.670788, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20269930') HTTP/1.1" 204 0
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6790/19896790/docs_service_history-1774470009485.jpg?ixlib=js-3.8.0&auto=format&s=a860819fa0331cb5599ae90fe1d588e2> (referer: None)
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6790/19896790/instrument_cluster-1774285784841.jpg> (referer: None)
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4244/16994244/interior_dashboard-1774718827913.jpg> (referer: None)
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6790/19896790/interior_rear_seats-1774283745067.jpg> (referer: None)
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f29dad0>
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6790%252F19896790%252Fdocs_service_history-1774470009485.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da860819fa0331cb5599ae90fe1d588e2') HTTP/1.1" 204 0
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6790/19896790/docs_service_history-1774470009485.jpg?ixlib=js-3.8.0&auto=format&s=a860819fa0331cb5599ae90fe1d588e2 saved to cache
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7ac510>
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6790%252F19896790%252Finstrument_cluster-1774285784841.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6790/19896790/instrument_cluster-1774285784841.jpg saved to cache
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d02b710>
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4244%252F16994244%252Finterior_dashboard-1774718827913.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4244/16994244/interior_dashboard-1774718827913.jpg saved to cache
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d987150>
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6790%252F19896790%252Finterior_rear_seats-1774283745067.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6790/19896790/interior_rear_seats-1774283745067.jpg saved to cache
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b
2026-03-29 20:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_front_passenger-1774282511206.jpg> (referer: None)
2026-03-29 20:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_rear_passenger-1774718976989.jpg> (referer: None)
2026-03-29 20:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_rear_driver-1774282526970.jpg> (referer: None)
2026-03-29 20:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6790/19896790/interior_boot-1774285711145.jpg> (referer: None)
2026-03-29 20:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6790/19896790/interior_dashboard-1774285575899.jpg> (referer: None)
2026-03-29 20:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_rear_passenger-1774282560162.jpg> (referer: None)
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6ede50>
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6790%252F19896790%252Fexterior_front_passenger-1774282511206.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_front_passenger-1774282511206.jpg saved to cache
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2b4c90>
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4244%252F16994244%252Fexterior_rear_passenger-1774718976989.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_rear_passenger-1774718976989.jpg saved to cache
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d20ed90>
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6790%252F19896790%252Fexterior_rear_driver-1774282526970.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_rear_driver-1774282526970.jpg saved to cache
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6c9490>
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6790%252F19896790%252Finterior_boot-1774285711145.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6790/19896790/interior_boot-1774285711145.jpg saved to cache
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6cb690>
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6790%252F19896790%252Finterior_dashboard-1774285575899.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6790/19896790/interior_dashboard-1774285575899.jpg saved to cache
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2dacd0>
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6790%252F19896790%252Fexterior_rear_passenger-1774282560162.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_rear_passenger-1774282560162.jpg saved to cache
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b
2026-03-29 20:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_rear_driver-1774718951509.jpg> (referer: None)
2026-03-29 20:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_front_passenger-1774718926187.jpg> (referer: None)
2026-03-29 20:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_rear_passenger-1774702660413.jpg> (referer: None)
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db0d4d0>
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4244%252F16994244%252Fexterior_rear_driver-1774718951509.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_rear_driver-1774718951509.jpg saved to cache
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce7e290>
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4244%252F16994244%252Fexterior_front_passenger-1774718926187.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_front_passenger-1774718926187.jpg saved to cache
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c
2026-03-29 20:13:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d1d8302-8f23-5767-9a2b-dd0b2283726c, skipping ID generation
2026-03-29 20:13:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c with scrape type 1
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d1d8302-8f23-5767-9a2b-dd0b2283726c sending to next pipeline
2026-03-29 20:13:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2d1d8302-8f23-5767-9a2b-dd0b2283726c, identifier: 16994244
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd35250>
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4776%252F20414776%252Fexterior_rear_passenger-1774702660413.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_rear_passenger-1774702660413.jpg saved to cache
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09
2026-03-29 20:13:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2d1d8302-8f23-5767-9a2b-dd0b2283726c with identifier: 16994244
2026-03-29 20:13:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2d1d8302-8f23-5767-9a2b-dd0b2283726c with identifier: 16994244
2026-03-29 20:13:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2d1d8302-8f23-5767-9a2b-dd0b2283726c with identifier: 16994244 to the API
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_front_passenger-1774718926187.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2d1d8302-8f23-5767-9a2b-dd0b2283726c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'J17 CNP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16994244',
'listing': 'auction',
'location': 'None None',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 46000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 904827,
'Height': 2021,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_front_driver-1774718907637.jpg',
'Width': 2694},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623212,
'Height': 1827,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_rear_driver-1774718951509.jpg',
'Width': 2436},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 783536,
'Height': 1904,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_front_passenger-1774718926187.jpg',
'Width': 2538},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525039,
'Height': 1653,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4244/16994244/exterior_rear_passenger-1774718976989.jpg',
'Width': 2204},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1771258,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4244/16994244/interior_front_seats-1774718867752.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1789336,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4244/16994244/interior_rear_seats-1774718795909.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1506528,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4244/16994244/interior_dashboard-1774718827913.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1355673,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4244/16994244/instrument_cluster-1774718901147.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1729839,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4244/16994244/interior_boot-1774718841140.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1d8302-8f23-5767-9a2b-dd0b2283726c/2d1d8302-8f23-5767-9a2b-dd0b2283726c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1212910,
'Height': 3652,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4244/16994244/docs_service_history-1774719965579.jpg?ixlib=js-3.8.0&auto=format&s=848ccaaeeace40e248e9fb96fa181750',
'Width': 2592}],
'price': 12150,
'price_includes_vat': False,
'registration_date': '2020-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf Life TSI',
'transmission': 'manual',
'trim': 'Life TSI',
'vin': 'WVWZZZCDZLW021635',
'year': 2020}
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716994244%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [motorway.uk] INFO: Saving data for 16994244: {'created_time': 1774815211.872737, 'last_price_update_time': 1774815211.872749, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16994244') HTTP/1.1" 204 0
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1656&page=46&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_front_passenger-1774702690219.jpg> (referer: None)
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_rear_driver-1774702620849.jpg> (referer: None)
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_front_driver-1774702591184.jpg> (referer: None)
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9385/20499385/interior_rear_seats-1774782550312.jpg> (referer: None)
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9385/20499385/interior_front_seats-1774787301167.jpg> (referer: None)
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6790/19896790/interior_front_seats-1774283679162.jpg> (referer: None)
2026-03-29 20:13:32 [motorway.uk] INFO: Found listing with ID: 20100929
2026-03-29 20:13:32 [motorway.uk] INFO: Found listing with ID: 20485662
2026-03-29 20:13:32 [motorway.uk] INFO: Found listing with ID: 20194967
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720194967%27 HTTP/1.1" 200 None
2026-03-29 20:13:32 [motorway.uk] INFO: Scrape type for 20194967: 1
2026-03-29 20:13:32 [motorway.uk] INFO: Found listing with ID: 20381297
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720381297%27 HTTP/1.1" 200 None
2026-03-29 20:13:32 [motorway.uk] INFO: Scrape type for 20381297: 1
2026-03-29 20:13:32 [motorway.uk] INFO: Found listing with ID: 20386223
2026-03-29 20:13:32 [motorway.uk] INFO: Found listing with ID: 20286698
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720286698%27 HTTP/1.1" 200 None
2026-03-29 20:13:32 [motorway.uk] INFO: Scrape type for 20286698: 1
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da8ce90>
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4776%252F20414776%252Fexterior_front_passenger-1774702690219.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_front_passenger-1774702690219.jpg saved to cache
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d67c290>
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4776%252F20414776%252Fexterior_rear_driver-1774702620849.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_rear_driver-1774702620849.jpg saved to cache
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09
2026-03-29 20:13:32 [motorway.uk] INFO: Found listing with ID: 20489245
2026-03-29 20:13:32 [motorway.uk] INFO: Found listing with ID: 20392027
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720392027%27 HTTP/1.1" 200 None
2026-03-29 20:13:32 [motorway.uk] INFO: Scrape type for 20392027: 1
2026-03-29 20:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18151907.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20080126.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17822067.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19525497.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2fa3d0>
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4776%252F20414776%252Fexterior_front_driver-1774702591184.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_front_driver-1774702591184.jpg saved to cache
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09
2026-03-29 20:13:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09, skipping ID generation
2026-03-29 20:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09 with scrape type 1
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09 sending to next pipeline
2026-03-29 20:13:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09, identifier: 20414776
2026-03-29 20:13:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d018550>
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9385%252F20499385%252Finterior_rear_seats-1774782550312.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9385/20499385/interior_rear_seats-1774782550312.jpg saved to cache
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d8f4126-e139-5b85-bf95-298182491aac
2026-03-29 20:13:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2e49d0>
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9385%252F20499385%252Finterior_front_seats-1774787301167.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9385/20499385/interior_front_seats-1774787301167.jpg saved to cache
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d8f4126-e139-5b85-bf95-298182491aac
2026-03-29 20:13:32 [motorway.uk] INFO: Found listing with ID: 3873152
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273873152%27 HTTP/1.1" 200 None
2026-03-29 20:13:32 [motorway.uk] INFO: Scrape type for 3873152: 1
2026-03-29 20:13:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20457137.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09 with identifier: 20414776
2026-03-29 20:13:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09 with identifier: 20414776
2026-03-29 20:13:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09 with identifier: 20414776 to the API
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_front_driver-1774702591184.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'H7 NRX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20414776',
'listing': 'auction',
'location': 'West Yorkshire Halifax',
'make': 'MINI',
'model': 'Countryman',
'odometer': 46665,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1825504,
'Height': 2384,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_front_driver-1774702591184.jpg',
'Width': 3178},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1275357,
'Height': 2147,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_rear_driver-1774702620849.jpg',
'Width': 2862},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1286846,
'Height': 2425,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_front_passenger-1774702690219.jpg',
'Width': 3233},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1536852,
'Height': 2427,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4776/20414776/exterior_rear_passenger-1774702660413.jpg',
'Width': 3236},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3165426,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4776/20414776/interior_front_seats-1774703162232.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3182642,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4776/20414776/interior_rear_seats-1774703132140.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1795642,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4776/20414776/interior_dashboard-1774703102640.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3039217,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4776/20414776/instrument_cluster-1774703170790.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4297533,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4776/20414776/interior_boot-1774703108644.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09/4a0de4f3-99d2-5c3d-9a7b-ab9a19d46f09_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310715,
'Height': 2729,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4776/20414776/docs_service_history-1774706715759.jpg?ixlib=js-3.8.0&auto=format&s=cdd847f44b32f412a2487ef249d3e0b9',
'Width': 1877}],
'price': 8192,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seats_number': None,
'seller_name': None,
'title': 'MINI Countryman Cooper SD ALL4 Auto',
'transmission': 'automatic',
'trim': 'Cooper SD ALL4 Auto',
'vin': 'WMWZD72020WN32877',
'year': 2016}
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720414776%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [motorway.uk] INFO: Saving data for 20414776: {'created_time': 1774815213.277564, 'last_price_update_time': 1774815213.277606, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20414776') HTTP/1.1" 204 0
2026-03-29 20:13:33 [motorway.uk] INFO: Found listing with ID: 11096285
2026-03-29 20:13:33 [motorway.uk] INFO: Found listing with ID: 20482960
2026-03-29 20:13:33 [motorway.uk] INFO: Found listing with ID: 19678576
2026-03-29 20:13:33 [motorway.uk] INFO: Found listing with ID: 18548941
2026-03-29 20:13:33 [motorway.uk] INFO: Found listing with ID: 20491894
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491894%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [motorway.uk] INFO: Scrape type for 20491894: 1
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2b51d0>
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6790%252F19896790%252Finterior_front_seats-1774283679162.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6790/19896790/interior_front_seats-1774283679162.jpg saved to cache
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b
2026-03-29 20:13:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd3e8cd0-5ad2-503c-9266-932f9eeb083b, skipping ID generation
2026-03-29 20:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b with scrape type 1
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd3e8cd0-5ad2-503c-9266-932f9eeb083b sending to next pipeline
2026-03-29 20:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bd3e8cd0-5ad2-503c-9266-932f9eeb083b, identifier: 19896790
2026-03-29 20:13:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98b49382-9cc7-5299-9356-9c88d55b1b52 with identifier: 18151907
2026-03-29 20:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b49382-9cc7-5299-9356-9c88d55b1b52 with scrape type 1
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98b49382-9cc7-5299-9356-9c88d55b1b52
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1907%252F18151907%252Fexterior_front_driver-1774539288286.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1907/18151907/exterior_front_driver-1774539288286.jpg not downloaded yet
2026-03-29 20:13:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2a9492c-7a05-56b9-8aa5-35718b68c8d4 with identifier: 20080126
2026-03-29 20:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2a9492c-7a05-56b9-8aa5-35718b68c8d4 with scrape type 1
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2a9492c-7a05-56b9-8aa5-35718b68c8d4
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0126%252F20080126%252Fexterior_front_driver-1774369878112.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0126/20080126/exterior_front_driver-1774369878112.jpg not downloaded yet
2026-03-29 20:13:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 678c912c-4955-5d44-a7da-001f6794bc22 with identifier: 17822067
2026-03-29 20:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 678c912c-4955-5d44-a7da-001f6794bc22 with scrape type 1
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 678c912c-4955-5d44-a7da-001f6794bc22
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2067%252F17822067%252Fexterior_front_driver-1774338563272.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2067/17822067/exterior_front_driver-1774338563272.jpg not downloaded yet
2026-03-29 20:13:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 280a30ed-6030-571b-a4a7-77d327c87731 with identifier: 19525497
2026-03-29 20:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 280a30ed-6030-571b-a4a7-77d327c87731 with scrape type 1
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 280a30ed-6030-571b-a4a7-77d327c87731
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F19525497%252Fexterior_front_driver-1774184445393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/19525497/exterior_front_driver-1774184445393.jpg not downloaded yet
2026-03-29 20:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bd3e8cd0-5ad2-503c-9266-932f9eeb083b with identifier: 19896790
2026-03-29 20:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bd3e8cd0-5ad2-503c-9266-932f9eeb083b with identifier: 19896790
2026-03-29 20:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bd3e8cd0-5ad2-503c-9266-932f9eeb083b with identifier: 19896790 to the API
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6790/19896790/interior_front_seats-1774283679162.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'bd3e8cd0-5ad2-503c-9266-932f9eeb083b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE69 KHU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19896790',
'listing': 'auction',
'location': 'Lanarkshire Glasgow',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 37883,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1059631,
'Height': 2835,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_front_driver-1774282544591.jpg',
'Width': 3780},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 856954,
'Height': 2501,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_rear_driver-1774282526970.jpg',
'Width': 3334},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1016497,
'Height': 2768,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_front_passenger-1774282511206.jpg',
'Width': 3691},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 944689,
'Height': 2818,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6790/19896790/exterior_rear_passenger-1774282560162.jpg',
'Width': 3757},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2309367,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6790/19896790/interior_front_seats-1774283679162.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1978675,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6790/19896790/interior_rear_seats-1774283745067.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1935725,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6790/19896790/interior_dashboard-1774285575899.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173869,
'Height': 878,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6790/19896790/instrument_cluster-1774285784841.jpg',
'Width': 1171},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 895544,
'Height': 1919,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6790/19896790/interior_boot-1774285711145.jpg',
'Width': 2559},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd3e8cd0-5ad2-503c-9266-932f9eeb083b/bd3e8cd0-5ad2-503c-9266-932f9eeb083b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40919,
'Height': 1600,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6790/19896790/docs_service_history-1774470009485.jpg?ixlib=js-3.8.0&auto=format&s=a860819fa0331cb5599ae90fe1d588e2',
'Width': 738}],
'price': 13665,
'price_includes_vat': False,
'registration_date': '2019-09-20',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 180 Sport Executive D Auto',
'transmission': 'automatic',
'trim': 'A 180 Sport Executive D Auto',
'vin': 'WDD1771032W008838',
'year': 2019}
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719896790%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [motorway.uk] INFO: Saving data for 19896790: {'created_time': 1774815214.13384, 'last_price_update_time': 1774815214.13385, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19896790') HTTP/1.1" 204 0
2026-03-29 20:13:34 [motorway.uk] INFO: Found listing with ID: 19241262
2026-03-29 20:13:34 [motorway.uk] INFO: Found listing with ID: 19752609
2026-03-29 20:13:34 [motorway.uk] INFO: Found listing with ID: 8334948
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278334948%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [motorway.uk] INFO: Scrape type for 8334948: 1
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1907%252F18151907%252Fexterior_rear_driver-1774539305906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1907/18151907/exterior_rear_driver-1774539305906.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0126%252F20080126%252Fexterior_rear_driver-1774369730205.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0126/20080126/exterior_rear_driver-1774369730205.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2067%252F17822067%252Fexterior_rear_driver-1774338550767.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2067/17822067/exterior_rear_driver-1774338550767.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F19525497%252Fexterior_rear_driver-1774184463799.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/19525497/exterior_rear_driver-1774184463799.jpg not downloaded yet
2026-03-29 20:13:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5ab5cb8-930a-5d56-9684-1a95377f97dd with identifier: 20457137
2026-03-29 20:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ab5cb8-930a-5d56-9684-1a95377f97dd with scrape type 1
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5ab5cb8-930a-5d56-9684-1a95377f97dd
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7137%252F20457137%252Fexterior_front_driver-1774709646896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7137/20457137/exterior_front_driver-1774709646896.jpg not downloaded yet
2026-03-29 20:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485932.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10041890.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:34 [motorway.uk] INFO: Found listing with ID: 20386964
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720386964%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [motorway.uk] INFO: Scrape type for 20386964: 1
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1907%252F18151907%252Fexterior_front_passenger-1774705473630.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1907/18151907/exterior_front_passenger-1774705473630.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0126%252F20080126%252Fexterior_front_passenger-1774369606178.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0126/20080126/exterior_front_passenger-1774369606178.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2067%252F17822067%252Fexterior_front_passenger-1774338587962.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2067/17822067/exterior_front_passenger-1774338587962.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F19525497%252Fexterior_front_passenger-1774184542603.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/19525497/exterior_front_passenger-1774184542603.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7137%252F20457137%252Fexterior_rear_driver-1774709561122.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7137/20457137/exterior_rear_driver-1774709561122.jpg not downloaded yet
2026-03-29 20:13:34 [motorway.uk] INFO: Found listing with ID: 20411705
2026-03-29 20:13:34 [motorway.uk] INFO: Found listing with ID: 19182939
2026-03-29 20:13:34 [motorway.uk] INFO: Found listing with ID: 20488347
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488347%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [motorway.uk] INFO: Scrape type for 20488347: 1
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1907%252F18151907%252Fexterior_rear_passenger-1774539302931.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1907/18151907/exterior_rear_passenger-1774539302931.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0126%252F20080126%252Fexterior_rear_passenger-1774369893783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0126/20080126/exterior_rear_passenger-1774369893783.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2067%252F17822067%252Fexterior_rear_passenger-1774338607664.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2067/17822067/exterior_rear_passenger-1774338607664.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F19525497%252Fexterior_rear_passenger-1774184479967.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/19525497/exterior_rear_passenger-1774184479967.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7137%252F20457137%252Fexterior_front_passenger-1774709586095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7137/20457137/exterior_front_passenger-1774709586095.jpg not downloaded yet
2026-03-29 20:13:34 [motorway.uk] INFO: Found listing with ID: 20484773
2026-03-29 20:13:34 [motorway.uk] INFO: Found listing with ID: 17552063
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717552063%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [motorway.uk] INFO: Scrape type for 17552063: 1
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1907%252F18151907%252Finterior_front_seats-1774539512594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1907/18151907/interior_front_seats-1774539512594.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0126%252F20080126%252Finterior_front_seats-1774712145899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0126/20080126/interior_front_seats-1774712145899.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2067%252F17822067%252Finterior_front_seats-1774512834960.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2067/17822067/interior_front_seats-1774512834960.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5497%252F19525497%252Finterior_front_seats-1774185102221.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5497/19525497/interior_front_seats-1774185102221.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7137%252F20457137%252Fexterior_rear_passenger-1774709735377.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7137/20457137/exterior_rear_passenger-1774709735377.jpg not downloaded yet
2026-03-29 20:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20111098.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 165c371d-4f61-5bf7-a1f7-f0e6e4074650 with identifier: 20485932
2026-03-29 20:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 165c371d-4f61-5bf7-a1f7-f0e6e4074650 with scrape type 1
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 165c371d-4f61-5bf7-a1f7-f0e6e4074650
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20485932%252Fexterior_front_driver-1774696689301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20485932/exterior_front_driver-1774696689301.jpg not downloaded yet
2026-03-29 20:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f60045d-f04a-536a-8759-20e507640d8f with identifier: 10041890
2026-03-29 20:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f60045d-f04a-536a-8759-20e507640d8f with scrape type 1
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f60045d-f04a-536a-8759-20e507640d8f
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1890%252F10041890%252Fexterior_front_driver-1774697089502.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1890/10041890/exterior_front_driver-1774697089502.jpg not downloaded yet
2026-03-29 20:13:34 [motorway.uk] INFO: Found listing with ID: 20486399
2026-03-29 20:13:34 [motorway.uk] INFO: Found listing with ID: 19793554
2026-03-29 20:13:34 [motorway.uk] INFO: Found listing with ID: 20162768
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720162768%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [motorway.uk] INFO: Scrape type for 20162768: 1
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1907%252F18151907%252Finterior_rear_seats-1774539547580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1907/18151907/interior_rear_seats-1774539547580.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0126%252F20080126%252Finterior_rear_seats-1774712120050.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0126/20080126/interior_rear_seats-1774712120050.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2067%252F17822067%252Finterior_rear_seats-1774512832346.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2067/17822067/interior_rear_seats-1774512832346.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5497%252F19525497%252Finterior_rear_seats-1774185098044.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5497/19525497/interior_rear_seats-1774185098044.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7137%252F20457137%252Finterior_front_seats-1774712064227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7137/20457137/interior_front_seats-1774712064227.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20485932%252Fexterior_rear_driver-1774696646448.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20485932/exterior_rear_driver-1774696646448.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1890%252F10041890%252Fexterior_rear_driver-1774702255171.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1890/10041890/exterior_rear_driver-1774702255171.jpg not downloaded yet
2026-03-29 20:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_front_driver-1774781811782.jpg> (referer: None)
2026-03-29 20:13:35 [motorway.uk] INFO: Found listing with ID: 20100434
2026-03-29 20:13:35 [motorway.uk] INFO: Found listing with ID: 8441343
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278441343%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [motorway.uk] INFO: Scrape type for 8441343: 1
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1907%252F18151907%252Finterior_dashboard-1774539581703.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1907/18151907/interior_dashboard-1774539581703.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0126%252F20080126%252Finterior_dashboard-1774712060395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0126/20080126/interior_dashboard-1774712060395.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2067%252F17822067%252Finterior_dashboard-1774512869945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2067/17822067/interior_dashboard-1774512869945.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F19525497%252Finterior_dashboard-1774185111435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/19525497/interior_dashboard-1774185111435.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7137%252F20457137%252Finterior_rear_seats-1774711235827.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7137/20457137/interior_rear_seats-1774711235827.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20485932%252Fexterior_front_passenger-1774696669084.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20485932/exterior_front_passenger-1774696669084.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1890%252F10041890%252Fexterior_front_passenger-1774697128292.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1890/10041890/exterior_front_passenger-1774697128292.jpg not downloaded yet
2026-03-29 20:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60a23567-04d2-51d9-99a4-3d580b60f12b with identifier: 20111098
2026-03-29 20:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a23567-04d2-51d9-99a4-3d580b60f12b with scrape type 1
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60a23567-04d2-51d9-99a4-3d580b60f12b
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1098%252F20111098%252Fexterior_front_driver-1774716171238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_front_driver-1774716171238.jpg not downloaded yet
2026-03-29 20:13:35 [motorway.uk] INFO: Found listing with ID: 20452585
2026-03-29 20:13:35 [motorway.uk] INFO: Found listing with ID: 20478128
2026-03-29 20:13:35 [motorway.uk] INFO: Found listing with ID: 10468400
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710468400%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [motorway.uk] INFO: Scrape type for 10468400: 1
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1907%252F18151907%252Finterior_boot-1774539683123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1907/18151907/interior_boot-1774539683123.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0126%252F20080126%252Finstrument_cluster-1774712296951.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0126/20080126/instrument_cluster-1774712296951.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2067%252F17822067%252Finstrument_cluster-1774512899106.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2067/17822067/instrument_cluster-1774512899106.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F19525497%252Finstrument_cluster-1774185173765.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/19525497/instrument_cluster-1774185173765.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7137%252F20457137%252Finterior_dashboard-1774711340891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7137/20457137/interior_dashboard-1774711340891.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20485932%252Fexterior_rear_passenger-1774696653777.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20485932/exterior_rear_passenger-1774696653777.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1890%252F10041890%252Fexterior_rear_passenger-1774702239161.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1890/10041890/exterior_rear_passenger-1774702239161.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1098%252F20111098%252Fexterior_rear_driver-1774716175050.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_rear_driver-1774716175050.jpg not downloaded yet
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c0bd890>
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9385%252F20499385%252Fexterior_front_driver-1774781811782.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_front_driver-1774781811782.jpg saved to cache
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d8f4126-e139-5b85-bf95-298182491aac
2026-03-29 20:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_rear_passenger-1774781859949.jpg> (referer: None)
2026-03-29 20:13:35 [motorway.uk] INFO: Found listing with ID: 20020455
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720020455%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [motorway.uk] INFO: Scrape type for 20020455: 1
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1907%252F18151907%252Fdamage_scratches-1774701758764.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1907/18151907/damage_scratches-1774701758764.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0126%252F20080126%252Finterior_boot-1774711921404.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0126/20080126/interior_boot-1774711921404.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2067%252F17822067%252Finterior_boot-1774512836509.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2067/17822067/interior_boot-1774512836509.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5497%252F19525497%252Finterior_boot-1774185016913.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5497/19525497/interior_boot-1774185016913.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7137%252F20457137%252Finterior_boot-1774712115059.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7137/20457137/interior_boot-1774712115059.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5932%252F20485932%252Finterior_front_seats-1774697038138.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5932/20485932/interior_front_seats-1774697038138.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1890%252F10041890%252Finterior_front_seats-1774697522866.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1890/10041890/interior_front_seats-1774697522866.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1098%252F20111098%252Fexterior_front_passenger-1774716266213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_front_passenger-1774716266213.jpg not downloaded yet
2026-03-29 20:13:35 [motorway.uk] INFO: Found listing with ID: 14838177
2026-03-29 20:13:35 [motorway.uk] INFO: Found listing with ID: 20494569
2026-03-29 20:13:35 [motorway.uk] INFO: Found listing with ID: 20436489
2026-03-29 20:13:35 [motorway.uk] INFO: Found listing with ID: 8662679
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278662679%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [motorway.uk] INFO: Scrape type for 8662679: 1
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1907%252F18151907%252Fdamage_scratches-1774701876600.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1907/18151907/damage_scratches-1774701876600.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0126%252F20080126%252Fdamage_windscreen-1774370042016.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0126/20080126/damage_windscreen-1774370042016.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2067%252F17822067%252Fdocs_service_history-1774514086145.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D79756f1a23d1b6092585fe293ad542af%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2067/17822067/docs_service_history-1774514086145.jpg?ixlib=js-3.8.0&auto=format&s=79756f1a23d1b6092585fe293ad542af not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5497%252F19525497%252Fdocs_service_history-1774185210839.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3a33b310ad07e391c64116c10b671023%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5497/19525497/docs_service_history-1774185210839.jpg?ixlib=js-3.8.0&auto=format&s=3a33b310ad07e391c64116c10b671023 not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7137%252F20457137%252Fdocs_service_history-1774781674785.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9f54b4c0904473a5a18f006b168d4a52%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7137/20457137/docs_service_history-1774781674785.jpg?ixlib=js-3.8.0&auto=format&s=9f54b4c0904473a5a18f006b168d4a52 not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5932%252F20485932%252Finterior_rear_seats-1774697056748.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5932/20485932/interior_rear_seats-1774697056748.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1890%252F10041890%252Finterior_rear_seats-1774697539803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1890/10041890/interior_rear_seats-1774697539803.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1098%252F20111098%252Fexterior_rear_passenger-1774716317823.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_rear_passenger-1774716317823.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7137%252F20457137%252Fdocs_service_history-1774781716442.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddadd6899b695a290eb55f1aa57ccf4e2%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7137/20457137/docs_service_history-1774781716442.jpg?ixlib=js-3.8.0&auto=format&s=dadd6899b695a290eb55f1aa57ccf4e2 not downloaded yet
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c0c5c50>
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9385%252F20499385%252Fexterior_rear_passenger-1774781859949.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_rear_passenger-1774781859949.jpg saved to cache
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d8f4126-e139-5b85-bf95-298182491aac
2026-03-29 20:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_rear_driver-1774781841187.jpg> (referer: None)
2026-03-29 20:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2067/17822067/exterior_front_driver-1774338563272.jpg> (referer: None)
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20485932%252Finterior_dashboard-1774697101157.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20485932/interior_dashboard-1774697101157.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1890%252F10041890%252Finterior_dashboard-1774697567642.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1890/10041890/interior_dashboard-1774697567642.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1098%252F20111098%252Finterior_front_seats-1774716842194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1098/20111098/interior_front_seats-1774716842194.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20485932%252Finstrument_cluster-1774697148818.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20485932/instrument_cluster-1774697148818.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1890%252F10041890%252Finstrument_cluster-1774697620101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1890/10041890/instrument_cluster-1774697620101.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1098%252F20111098%252Finterior_rear_seats-1774716861932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1098/20111098/interior_rear_seats-1774716861932.jpg not downloaded yet
2026-03-29 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1907/18151907/exterior_front_driver-1774539288286.jpg> (referer: None)
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5932%252F20485932%252Finterior_boot-1774697096746.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5932/20485932/interior_boot-1774697096746.jpg not downloaded yet
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1890%252F10041890%252Finterior_boot-1774697586601.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1890/10041890/interior_boot-1774697586601.jpg not downloaded yet
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1098%252F20111098%252Finterior_dashboard-1774786215638.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1098/20111098/interior_dashboard-1774786215638.jpg not downloaded yet
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d7b23d0>
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9385%252F20499385%252Fexterior_rear_driver-1774781841187.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_rear_driver-1774781841187.jpg saved to cache
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d8f4126-e139-5b85-bf95-298182491aac
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce8fed0>
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_678c912c-4955-5d44-a7da-001f6794bc22/678c912c-4955-5d44-a7da-001f6794bc22_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2067%252F17822067%252Fexterior_front_driver-1774338563272.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2067/17822067/exterior_front_driver-1774338563272.jpg saved to cache
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 678c912c-4955-5d44-a7da-001f6794bc22
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5932%252F20485932%252Fdocs_service_history-1774697509008.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D801efc61b02810f2827a77387a24e07d%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5932/20485932/docs_service_history-1774697509008.jpg?ixlib=js-3.8.0&auto=format&s=801efc61b02810f2827a77387a24e07d not downloaded yet
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1890%252F10041890%252Fdocs_service_history-1774697770216.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5302221754c0016462bb748e458edb28%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1890/10041890/docs_service_history-1774697770216.jpg?ixlib=js-3.8.0&auto=format&s=5302221754c0016462bb748e458edb28 not downloaded yet
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1098%252F20111098%252Finstrument_cluster-1774716948949.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1098/20111098/instrument_cluster-1774716948949.jpg not downloaded yet
2026-03-29 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_front_passenger-1774781888958.jpg> (referer: None)
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1098%252F20111098%252Finterior_boot-1774716897626.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1098/20111098/interior_boot-1774716897626.jpg not downloaded yet
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c4b1590>
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b49382-9cc7-5299-9356-9c88d55b1b52/98b49382-9cc7-5299-9356-9c88d55b1b52_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1907%252F18151907%252Fexterior_front_driver-1774539288286.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1907/18151907/exterior_front_driver-1774539288286.jpg saved to cache
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98b49382-9cc7-5299-9356-9c88d55b1b52
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1098%252F20111098%252Fdocs_service_history-1774786073910.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ba992d5e302f29aa4dbae1e04355a54%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1098/20111098/docs_service_history-1774786073910.jpg?ixlib=js-3.8.0&auto=format&s=3ba992d5e302f29aa4dbae1e04355a54 not downloaded yet
2026-03-29 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0126/20080126/exterior_front_driver-1774369878112.jpg> (referer: None)
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb5c750>
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9385%252F20499385%252Fexterior_front_passenger-1774781888958.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_front_passenger-1774781888958.jpg saved to cache
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d8f4126-e139-5b85-bf95-298182491aac
2026-03-29 20:13:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d8f4126-e139-5b85-bf95-298182491aac, skipping ID generation
2026-03-29 20:13:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d8f4126-e139-5b85-bf95-298182491aac with scrape type 1
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d8f4126-e139-5b85-bf95-298182491aac sending to next pipeline
2026-03-29 20:13:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5d8f4126-e139-5b85-bf95-298182491aac, identifier: 20499385
2026-03-29 20:13:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5d8f4126-e139-5b85-bf95-298182491aac with identifier: 20499385
2026-03-29 20:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5d8f4126-e139-5b85-bf95-298182491aac with identifier: 20499385
2026-03-29 20:13:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5d8f4126-e139-5b85-bf95-298182491aac with identifier: 20499385 to the API
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_front_passenger-1774781888958.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '5d8f4126-e139-5b85-bf95-298182491aac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PG16 GJJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20499385',
'listing': 'auction',
'location': 'Aberdeen City Aberdeen',
'make': 'Vauxhall',
'model': 'Mokka',
'odometer': 39000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1309062,
'Height': 2327,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_front_driver-1774781811782.jpg',
'Width': 3102},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1624930,
'Height': 2380,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_rear_driver-1774781841187.jpg',
'Width': 3173},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2048981,
'Height': 2688,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_front_passenger-1774781888958.jpg',
'Width': 3584},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1265038,
'Height': 2154,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9385/20499385/exterior_rear_passenger-1774781859949.jpg',
'Width': 2872},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3216415,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9385/20499385/interior_front_seats-1774787301167.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2132444,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9385/20499385/interior_rear_seats-1774782550312.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2069341,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9385/20499385/interior_dashboard-1774787352873.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4965892,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9385/20499385/interior_boot-1774782645836.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3454420,
'Height': 3404,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9385/20499385/docs_service_history-1774787752368.jpg?ixlib=js-3.8.0&auto=format&s=d819d8a4836d8636e70d5e7582818023',
'Width': 2303},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d8f4126-e139-5b85-bf95-298182491aac/5d8f4126-e139-5b85-bf95-298182491aac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2688350,
'Height': 3009,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9385/20499385/docs_service_history-1774787754100.jpg?ixlib=js-3.8.0&auto=format&s=9bae4015fdd4c35d6f9353bf22c70d7e',
'Width': 2038}],
'price': 6240,
'price_includes_vat': False,
'registration_date': '2016-03-24',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Mokka SE CDTI Auto',
'transmission': 'automatic',
'trim': 'SE CDTI Auto',
'vin': 'W0LJD7EC1GB618025',
'year': 2016}
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499385%27 HTTP/1.1" 200 None
2026-03-29 20:13:37 [motorway.uk] INFO: Saving data for 20499385: {'created_time': 1774815217.242854, 'last_price_update_time': 1774815217.242866, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20499385') HTTP/1.1" 204 0
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb7ef90>
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a9492c-7a05-56b9-8aa5-35718b68c8d4/e2a9492c-7a05-56b9-8aa5-35718b68c8d4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0126%252F20080126%252Fexterior_front_driver-1774369878112.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0126/20080126/exterior_front_driver-1774369878112.jpg saved to cache
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2a9492c-7a05-56b9-8aa5-35718b68c8d4
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5497/19525497/exterior_front_driver-1774184445393.jpg> (referer: None)
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7137/20457137/exterior_rear_driver-1774709561122.jpg> (referer: None)
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5497/19525497/exterior_front_passenger-1774184542603.jpg> (referer: None)
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1890/10041890/exterior_front_driver-1774697089502.jpg> (referer: None)
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5932/20485932/interior_dashboard-1774697101157.jpg> (referer: None)
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1890/10041890/interior_dashboard-1774697567642.jpg> (referer: None)
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7137/20457137/docs_service_history-1774781716442.jpg?ixlib=js-3.8.0&auto=format&s=dadd6899b695a290eb55f1aa57ccf4e2> (referer: None)
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1098/20111098/docs_service_history-1774786073910.jpg?ixlib=js-3.8.0&auto=format&s=3ba992d5e302f29aa4dbae1e04355a54> (referer: None)
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1890/10041890/docs_service_history-1774697770216.jpg?ixlib=js-3.8.0&auto=format&s=5302221754c0016462bb748e458edb28> (referer: None)
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1098/20111098/interior_front_seats-1774716842194.jpg> (referer: None)
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1098/20111098/instrument_cluster-1774716948949.jpg> (referer: None)
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c332790>
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280a30ed-6030-571b-a4a7-77d327c87731/280a30ed-6030-571b-a4a7-77d327c87731_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F19525497%252Fexterior_front_driver-1774184445393.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/19525497/exterior_front_driver-1774184445393.jpg saved to cache
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 280a30ed-6030-571b-a4a7-77d327c87731
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c0a3d90>
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ab5cb8-930a-5d56-9684-1a95377f97dd/c5ab5cb8-930a-5d56-9684-1a95377f97dd_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7137%252F20457137%252Fexterior_rear_driver-1774709561122.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7137/20457137/exterior_rear_driver-1774709561122.jpg saved to cache
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5ab5cb8-930a-5d56-9684-1a95377f97dd
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7be510>
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280a30ed-6030-571b-a4a7-77d327c87731/280a30ed-6030-571b-a4a7-77d327c87731_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F19525497%252Fexterior_front_passenger-1774184542603.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/19525497/exterior_front_passenger-1774184542603.jpg saved to cache
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 280a30ed-6030-571b-a4a7-77d327c87731
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da864d0>
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f60045d-f04a-536a-8759-20e507640d8f/0f60045d-f04a-536a-8759-20e507640d8f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1890%252F10041890%252Fexterior_front_driver-1774697089502.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1890/10041890/exterior_front_driver-1774697089502.jpg saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f60045d-f04a-536a-8759-20e507640d8f
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7bced0>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165c371d-4f61-5bf7-a1f7-f0e6e4074650/165c371d-4f61-5bf7-a1f7-f0e6e4074650_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20485932%252Finterior_dashboard-1774697101157.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20485932/interior_dashboard-1774697101157.jpg saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 165c371d-4f61-5bf7-a1f7-f0e6e4074650
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6254d0>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f60045d-f04a-536a-8759-20e507640d8f/0f60045d-f04a-536a-8759-20e507640d8f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1890%252F10041890%252Finterior_dashboard-1774697567642.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1890/10041890/interior_dashboard-1774697567642.jpg saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f60045d-f04a-536a-8759-20e507640d8f
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6158d0>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ab5cb8-930a-5d56-9684-1a95377f97dd/c5ab5cb8-930a-5d56-9684-1a95377f97dd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7137%252F20457137%252Fdocs_service_history-1774781716442.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddadd6899b695a290eb55f1aa57ccf4e2') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7137/20457137/docs_service_history-1774781716442.jpg?ixlib=js-3.8.0&auto=format&s=dadd6899b695a290eb55f1aa57ccf4e2 saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5ab5cb8-930a-5d56-9684-1a95377f97dd
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d614350>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1098%252F20111098%252Fdocs_service_history-1774786073910.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ba992d5e302f29aa4dbae1e04355a54') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1098/20111098/docs_service_history-1774786073910.jpg?ixlib=js-3.8.0&auto=format&s=3ba992d5e302f29aa4dbae1e04355a54 saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60a23567-04d2-51d9-99a4-3d580b60f12b
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c333f10>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f60045d-f04a-536a-8759-20e507640d8f/0f60045d-f04a-536a-8759-20e507640d8f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1890%252F10041890%252Fdocs_service_history-1774697770216.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5302221754c0016462bb748e458edb28') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1890/10041890/docs_service_history-1774697770216.jpg?ixlib=js-3.8.0&auto=format&s=5302221754c0016462bb748e458edb28 saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f60045d-f04a-536a-8759-20e507640d8f
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c624150>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1098%252F20111098%252Finterior_front_seats-1774716842194.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1098/20111098/interior_front_seats-1774716842194.jpg saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60a23567-04d2-51d9-99a4-3d580b60f12b
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7bccd0>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1098%252F20111098%252Finstrument_cluster-1774716948949.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1098/20111098/instrument_cluster-1774716948949.jpg saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60a23567-04d2-51d9-99a4-3d580b60f12b
2026-03-29 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20286698.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1098/20111098/interior_boot-1774716897626.jpg> (referer: None)
2026-03-29 20:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e84c48c-67ab-5931-9c6d-5a5519b752c2 with identifier: 20286698
2026-03-29 20:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2 with scrape type 1
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6698%252F20286698%252Fexterior_front_driver-1774693863210.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6698/20286698/exterior_front_driver-1774693863210.jpg not downloaded yet
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6698%252F20286698%252Fexterior_rear_driver-1774691054177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6698/20286698/exterior_rear_driver-1774691054177.jpg not downloaded yet
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6698%252F20286698%252Fexterior_front_passenger-1774691055027.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6698/20286698/exterior_front_passenger-1774691055027.jpg not downloaded yet
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8c3c90>
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1098%252F20111098%252Finterior_boot-1774716897626.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1098/20111098/interior_boot-1774716897626.jpg saved to cache
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60a23567-04d2-51d9-99a4-3d580b60f12b
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6698%252F20286698%252Fexterior_rear_passenger-1774691053683.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6698/20286698/exterior_rear_passenger-1774691053683.jpg not downloaded yet
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6698%252F20286698%252Finterior_front_seats-1774693886316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6698/20286698/interior_front_seats-1774693886316.jpg not downloaded yet
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6698%252F20286698%252Finterior_rear_seats-1774691912580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6698/20286698/interior_rear_seats-1774691912580.jpg not downloaded yet
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6698%252F20286698%252Finterior_dashboard-1774691960959.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6698/20286698/interior_dashboard-1774691960959.jpg not downloaded yet
2026-03-29 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20392027.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6698%252F20286698%252Finstrument_cluster-1774692111638.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6698/20286698/instrument_cluster-1774692111638.jpg not downloaded yet
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6698%252F20286698%252Finterior_boot-1774691740578.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6698/20286698/interior_boot-1774691740578.jpg not downloaded yet
2026-03-29 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1098/20111098/interior_dashboard-1774786215638.jpg> (referer: None)
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6698%252F20286698%252Fdocs_service_history-1774693762733.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5c5e494d8907a05605d37aa16b307f6b%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6698/20286698/docs_service_history-1774693762733.jpg?ixlib=js-3.8.0&auto=format&s=5c5e494d8907a05605d37aa16b307f6b not downloaded yet
2026-03-29 20:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 468b5f77-6048-5b26-8910-7f5a2ef2584c with identifier: 20392027
2026-03-29 20:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 468b5f77-6048-5b26-8910-7f5a2ef2584c with scrape type 1
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 468b5f77-6048-5b26-8910-7f5a2ef2584c
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2027%252F20392027%252Fexterior_front_driver-1774705527383.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_front_driver-1774705527383.jpg not downloaded yet
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2027%252F20392027%252Fexterior_rear_driver-1774705746889.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_rear_driver-1774705746889.jpg not downloaded yet
2026-03-29 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5932/20485932/docs_service_history-1774697509008.jpg?ixlib=js-3.8.0&auto=format&s=801efc61b02810f2827a77387a24e07d> (referer: None)
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2027%252F20392027%252Fexterior_front_passenger-1774705583747.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_front_passenger-1774705583747.jpg not downloaded yet
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7beb10>
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1098%252F20111098%252Finterior_dashboard-1774786215638.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1098/20111098/interior_dashboard-1774786215638.jpg saved to cache
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60a23567-04d2-51d9-99a4-3d580b60f12b
2026-03-29 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_rear_passenger-1774716317823.jpg> (referer: None)
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2027%252F20392027%252Fexterior_rear_passenger-1774705564911.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_rear_passenger-1774705564911.jpg not downloaded yet
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2027%252F20392027%252Finterior_front_seats-1774706203432.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2027/20392027/interior_front_seats-1774706203432.jpg not downloaded yet
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f623950>
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165c371d-4f61-5bf7-a1f7-f0e6e4074650/165c371d-4f61-5bf7-a1f7-f0e6e4074650_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5932%252F20485932%252Fdocs_service_history-1774697509008.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D801efc61b02810f2827a77387a24e07d') HTTP/1.1" 204 0
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5932/20485932/docs_service_history-1774697509008.jpg?ixlib=js-3.8.0&auto=format&s=801efc61b02810f2827a77387a24e07d saved to cache
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 165c371d-4f61-5bf7-a1f7-f0e6e4074650
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2027%252F20392027%252Finterior_rear_seats-1774706269947.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2027/20392027/interior_rear_seats-1774706269947.jpg not downloaded yet
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2027%252F20392027%252Finterior_dashboard-1774706309853.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2027/20392027/interior_dashboard-1774706309853.jpg not downloaded yet
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2df810>
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1098%252F20111098%252Fexterior_rear_passenger-1774716317823.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_rear_passenger-1774716317823.jpg saved to cache
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60a23567-04d2-51d9-99a4-3d580b60f12b
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2027%252F20392027%252Finterior_boot-1774706343624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2027/20392027/interior_boot-1774706343624.jpg not downloaded yet
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2027%252F20392027%252Fdocs_service_history-1774706494547.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D70398cbe80c21b4fbcec90b06cded4f5%27 HTTP/1.1" 200 None
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2027/20392027/docs_service_history-1774706494547.jpg?ixlib=js-3.8.0&auto=format&s=70398cbe80c21b4fbcec90b06cded4f5 not downloaded yet
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2027%252F20392027%252Fdocs_service_history-1774706496227.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dba9c79392e0387fd9952eb364fd4411e%27 HTTP/1.1" 200 None
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2027/20392027/docs_service_history-1774706496227.jpg?ixlib=js-3.8.0&auto=format&s=ba9c79392e0387fd9952eb364fd4411e not downloaded yet
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1098/20111098/interior_rear_seats-1774716861932.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5932/20485932/interior_rear_seats-1774697056748.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1890/10041890/instrument_cluster-1774697620101.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5932/20485932/instrument_cluster-1774697148818.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1890/10041890/interior_rear_seats-1774697539803.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5932/20485932/interior_boot-1774697096746.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6698/20286698/interior_dashboard-1774691960959.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7137/20457137/docs_service_history-1774781674785.jpg?ixlib=js-3.8.0&auto=format&s=9f54b4c0904473a5a18f006b168d4a52> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6698/20286698/interior_boot-1774691740578.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1890/10041890/interior_boot-1774697586601.jpg> (referer: None)
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5dddd0>
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1098%252F20111098%252Finterior_rear_seats-1774716861932.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1098/20111098/interior_rear_seats-1774716861932.jpg saved to cache
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60a23567-04d2-51d9-99a4-3d580b60f12b
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_rear_driver-1774705746889.jpg> (referer: None)
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5dc2d0>
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165c371d-4f61-5bf7-a1f7-f0e6e4074650/165c371d-4f61-5bf7-a1f7-f0e6e4074650_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5932%252F20485932%252Finterior_rear_seats-1774697056748.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5932/20485932/interior_rear_seats-1774697056748.jpg saved to cache
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 165c371d-4f61-5bf7-a1f7-f0e6e4074650
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d905350>
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f60045d-f04a-536a-8759-20e507640d8f/0f60045d-f04a-536a-8759-20e507640d8f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1890%252F10041890%252Finstrument_cluster-1774697620101.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1890/10041890/instrument_cluster-1774697620101.jpg saved to cache
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f60045d-f04a-536a-8759-20e507640d8f
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d56d790>
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165c371d-4f61-5bf7-a1f7-f0e6e4074650/165c371d-4f61-5bf7-a1f7-f0e6e4074650_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20485932%252Finstrument_cluster-1774697148818.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20485932/instrument_cluster-1774697148818.jpg saved to cache
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 165c371d-4f61-5bf7-a1f7-f0e6e4074650
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc8c590>
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f60045d-f04a-536a-8759-20e507640d8f/0f60045d-f04a-536a-8759-20e507640d8f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1890%252F10041890%252Finterior_rear_seats-1774697539803.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1890/10041890/interior_rear_seats-1774697539803.jpg saved to cache
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f60045d-f04a-536a-8759-20e507640d8f
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d56f950>
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165c371d-4f61-5bf7-a1f7-f0e6e4074650/165c371d-4f61-5bf7-a1f7-f0e6e4074650_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5932%252F20485932%252Finterior_boot-1774697096746.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5932/20485932/interior_boot-1774697096746.jpg saved to cache
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 165c371d-4f61-5bf7-a1f7-f0e6e4074650
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f3547df50>
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6698%252F20286698%252Finterior_dashboard-1774691960959.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6698/20286698/interior_dashboard-1774691960959.jpg saved to cache
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1b38d0>
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ab5cb8-930a-5d56-9684-1a95377f97dd/c5ab5cb8-930a-5d56-9684-1a95377f97dd_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7137%252F20457137%252Fdocs_service_history-1774781674785.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9f54b4c0904473a5a18f006b168d4a52') HTTP/1.1" 204 0
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7137/20457137/docs_service_history-1774781674785.jpg?ixlib=js-3.8.0&auto=format&s=9f54b4c0904473a5a18f006b168d4a52 saved to cache
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5ab5cb8-930a-5d56-9684-1a95377f97dd
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc8dc10>
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6698%252F20286698%252Finterior_boot-1774691740578.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6698/20286698/interior_boot-1774691740578.jpg saved to cache
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca6dd90>
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f60045d-f04a-536a-8759-20e507640d8f/0f60045d-f04a-536a-8759-20e507640d8f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1890%252F10041890%252Finterior_boot-1774697586601.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1890/10041890/interior_boot-1774697586601.jpg saved to cache
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f60045d-f04a-536a-8759-20e507640d8f
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db48d50>
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2027%252F20392027%252Fexterior_rear_driver-1774705746889.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_rear_driver-1774705746889.jpg saved to cache
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 468b5f77-6048-5b26-8910-7f5a2ef2584c
2026-03-29 20:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_front_passenger-1774705583747.jpg> (referer: None)
2026-03-29 20:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2027/20392027/docs_service_history-1774706496227.jpg?ixlib=js-3.8.0&auto=format&s=ba9c79392e0387fd9952eb364fd4411e> (referer: None)
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6e48d0>
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2027%252F20392027%252Fexterior_front_passenger-1774705583747.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_front_passenger-1774705583747.jpg saved to cache
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 468b5f77-6048-5b26-8910-7f5a2ef2584c
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cf19250>
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2027%252F20392027%252Fdocs_service_history-1774706496227.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dba9c79392e0387fd9952eb364fd4411e') HTTP/1.1" 204 0
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2027/20392027/docs_service_history-1774706496227.jpg?ixlib=js-3.8.0&auto=format&s=ba9c79392e0387fd9952eb364fd4411e saved to cache
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 468b5f77-6048-5b26-8910-7f5a2ef2584c
2026-03-29 20:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2027/20392027/docs_service_history-1774706494547.jpg?ixlib=js-3.8.0&auto=format&s=70398cbe80c21b4fbcec90b06cded4f5> (referer: None)
2026-03-29 20:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6698/20286698/interior_rear_seats-1774691912580.jpg> (referer: None)
2026-03-29 20:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6698/20286698/interior_front_seats-1774693886316.jpg> (referer: None)
2026-03-29 20:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6698/20286698/exterior_rear_passenger-1774691053683.jpg> (referer: None)
2026-03-29 20:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2027/20392027/interior_dashboard-1774706309853.jpg> (referer: None)
2026-03-29 20:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2027/20392027/interior_boot-1774706343624.jpg> (referer: None)
2026-03-29 20:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2027/20392027/interior_rear_seats-1774706269947.jpg> (referer: None)
2026-03-29 20:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6698/20286698/docs_service_history-1774693762733.jpg?ixlib=js-3.8.0&auto=format&s=5c5e494d8907a05605d37aa16b307f6b> (referer: None)
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f55e810>
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2027%252F20392027%252Fdocs_service_history-1774706494547.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D70398cbe80c21b4fbcec90b06cded4f5') HTTP/1.1" 204 0
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2027/20392027/docs_service_history-1774706494547.jpg?ixlib=js-3.8.0&auto=format&s=70398cbe80c21b4fbcec90b06cded4f5 saved to cache
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 468b5f77-6048-5b26-8910-7f5a2ef2584c
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db4a150>
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6698%252F20286698%252Finterior_rear_seats-1774691912580.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6698/20286698/interior_rear_seats-1774691912580.jpg saved to cache
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f59ca90>
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6698%252F20286698%252Finterior_front_seats-1774693886316.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6698/20286698/interior_front_seats-1774693886316.jpg saved to cache
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5ce150>
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6698%252F20286698%252Fexterior_rear_passenger-1774691053683.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6698/20286698/exterior_rear_passenger-1774691053683.jpg saved to cache
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8a9990>
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2027%252F20392027%252Finterior_dashboard-1774706309853.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2027/20392027/interior_dashboard-1774706309853.jpg saved to cache
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 468b5f77-6048-5b26-8910-7f5a2ef2584c
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f55a710>
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2027%252F20392027%252Finterior_boot-1774706343624.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2027/20392027/interior_boot-1774706343624.jpg saved to cache
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 468b5f77-6048-5b26-8910-7f5a2ef2584c
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c716310>
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2027%252F20392027%252Finterior_rear_seats-1774706269947.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2027/20392027/interior_rear_seats-1774706269947.jpg saved to cache
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 468b5f77-6048-5b26-8910-7f5a2ef2584c
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2df27990>
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6698%252F20286698%252Fdocs_service_history-1774693762733.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5c5e494d8907a05605d37aa16b307f6b') HTTP/1.1" 204 0
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6698/20286698/docs_service_history-1774693762733.jpg?ixlib=js-3.8.0&auto=format&s=5c5e494d8907a05605d37aa16b307f6b saved to cache
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2
2026-03-29 20:13:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_front_driver-1774705527383.jpg> (referer: None)
2026-03-29 20:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6698/20286698/instrument_cluster-1774692111638.jpg> (referer: None)
2026-03-29 20:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6698/20286698/exterior_front_passenger-1774691055027.jpg> (referer: None)
2026-03-29 20:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6698/20286698/exterior_rear_driver-1774691054177.jpg> (referer: None)
2026-03-29 20:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6698/20286698/exterior_front_driver-1774693863210.jpg> (referer: None)
2026-03-29 20:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2027/20392027/interior_front_seats-1774706203432.jpg> (referer: None)
2026-03-29 20:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1907/18151907/damage_scratches-1774701876600.jpg> (referer: None)
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2df274d0>
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2027%252F20392027%252Fexterior_front_driver-1774705527383.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_front_driver-1774705527383.jpg saved to cache
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 468b5f77-6048-5b26-8910-7f5a2ef2584c
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5aed50>
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6698%252F20286698%252Finstrument_cluster-1774692111638.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6698/20286698/instrument_cluster-1774692111638.jpg saved to cache
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2
2026-03-29 20:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2067/17822067/docs_service_history-1774514086145.jpg?ixlib=js-3.8.0&auto=format&s=79756f1a23d1b6092585fe293ad542af> (referer: None)
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f618f10>
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6698%252F20286698%252Fexterior_front_passenger-1774691055027.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6698/20286698/exterior_front_passenger-1774691055027.jpg saved to cache
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc46a90>
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6698%252F20286698%252Fexterior_rear_driver-1774691054177.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6698/20286698/exterior_rear_driver-1774691054177.jpg saved to cache
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d186650>
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6698%252F20286698%252Fexterior_front_driver-1774693863210.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6698/20286698/exterior_front_driver-1774693863210.jpg saved to cache
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2
2026-03-29 20:13:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e84c48c-67ab-5931-9c6d-5a5519b752c2, skipping ID generation
2026-03-29 20:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2 with scrape type 1
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e84c48c-67ab-5931-9c6d-5a5519b752c2 sending to next pipeline
2026-03-29 20:13:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0e84c48c-67ab-5931-9c6d-5a5519b752c2, identifier: 20286698
2026-03-29 20:13:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da53e90>
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2027%252F20392027%252Finterior_front_seats-1774706203432.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2027/20392027/interior_front_seats-1774706203432.jpg saved to cache
2026-03-29 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 468b5f77-6048-5b26-8910-7f5a2ef2584c
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5df550>
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b49382-9cc7-5299-9356-9c88d55b1b52/98b49382-9cc7-5299-9356-9c88d55b1b52_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1907%252F18151907%252Fdamage_scratches-1774701876600.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1907/18151907/damage_scratches-1774701876600.jpg saved to cache
2026-03-29 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98b49382-9cc7-5299-9356-9c88d55b1b52
2026-03-29 20:13:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0e84c48c-67ab-5931-9c6d-5a5519b752c2 with identifier: 20286698
2026-03-29 20:13:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0e84c48c-67ab-5931-9c6d-5a5519b752c2 with identifier: 20286698
2026-03-29 20:13:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0e84c48c-67ab-5931-9c6d-5a5519b752c2 with identifier: 20286698 to the API
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/6698/20286698/exterior_front_driver-1774693863210.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '0e84c48c-67ab-5931-9c6d-5a5519b752c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KN12 YGL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20286698',
'listing': 'auction',
'location': 'Hampshire Basingstoke',
'make': 'MINI',
'model': 'Cooper',
'odometer': 67805,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1272065,
'Height': 2372,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6698/20286698/exterior_front_driver-1774693863210.jpg',
'Width': 3163},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1238824,
'Height': 2866,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6698/20286698/exterior_rear_driver-1774691054177.jpg',
'Width': 3821},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1051473,
'Height': 2485,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6698/20286698/exterior_front_passenger-1774691055027.jpg',
'Width': 3313},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1097480,
'Height': 2660,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6698/20286698/exterior_rear_passenger-1774691053683.jpg',
'Width': 3546},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1707549,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6698/20286698/interior_front_seats-1774693886316.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1541278,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6698/20286698/interior_rear_seats-1774691912580.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1978564,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6698/20286698/interior_dashboard-1774691960959.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1722340,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6698/20286698/instrument_cluster-1774692111638.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2004163,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6698/20286698/interior_boot-1774691740578.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e84c48c-67ab-5931-9c6d-5a5519b752c2/0e84c48c-67ab-5931-9c6d-5a5519b752c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1580579,
'Height': 2840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6698/20286698/docs_service_history-1774693762733.jpg?ixlib=js-3.8.0&auto=format&s=5c5e494d8907a05605d37aa16b307f6b',
'Width': 3786}],
'price': 1881,
'price_includes_vat': False,
'registration_date': '2012-03-29',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper D Soho',
'transmission': 'manual',
'trim': 'D Soho',
'vin': 'WMWSW32090T214311',
'year': 2012}
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720286698%27 HTTP/1.1" 200 None
2026-03-29 20:13:44 [motorway.uk] INFO: Saving data for 20286698: {'created_time': 1774815224.690148, 'last_price_update_time': 1774815224.690159, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20286698') HTTP/1.1" 204 0
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cee4b50>
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_678c912c-4955-5d44-a7da-001f6794bc22/678c912c-4955-5d44-a7da-001f6794bc22_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2067%252F17822067%252Fdocs_service_history-1774514086145.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D79756f1a23d1b6092585fe293ad542af') HTTP/1.1" 204 0
2026-03-29 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2067/17822067/docs_service_history-1774514086145.jpg?ixlib=js-3.8.0&auto=format&s=79756f1a23d1b6092585fe293ad542af saved to cache
2026-03-29 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 678c912c-4955-5d44-a7da-001f6794bc22
2026-03-29 20:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_front_passenger-1774716266213.jpg> (referer: None)
2026-03-29 20:13:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_rear_passenger-1774705564911.jpg> (referer: None)
2026-03-29 20:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0126/20080126/damage_windscreen-1774370042016.jpg> (referer: None)
2026-03-29 20:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1890/10041890/interior_front_seats-1774697522866.jpg> (referer: None)
2026-03-29 20:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5497/19525497/docs_service_history-1774185210839.jpg?ixlib=js-3.8.0&auto=format&s=3a33b310ad07e391c64116c10b671023> (referer: None)
2026-03-29 20:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1907/18151907/damage_scratches-1774701758764.jpg> (referer: None)
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de21510>
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1098%252F20111098%252Fexterior_front_passenger-1774716266213.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_front_passenger-1774716266213.jpg saved to cache
2026-03-29 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60a23567-04d2-51d9-99a4-3d580b60f12b
2026-03-29 20:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7137/20457137/interior_boot-1774712115059.jpg> (referer: None)
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d624f90>
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2027%252F20392027%252Fexterior_rear_passenger-1774705564911.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_rear_passenger-1774705564911.jpg saved to cache
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 468b5f77-6048-5b26-8910-7f5a2ef2584c
2026-03-29 20:13:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 468b5f77-6048-5b26-8910-7f5a2ef2584c, skipping ID generation
2026-03-29 20:13:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 468b5f77-6048-5b26-8910-7f5a2ef2584c with scrape type 1
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 468b5f77-6048-5b26-8910-7f5a2ef2584c sending to next pipeline
2026-03-29 20:13:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 468b5f77-6048-5b26-8910-7f5a2ef2584c, identifier: 20392027
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9a9f50>
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a9492c-7a05-56b9-8aa5-35718b68c8d4/e2a9492c-7a05-56b9-8aa5-35718b68c8d4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0126%252F20080126%252Fdamage_windscreen-1774370042016.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0126/20080126/damage_windscreen-1774370042016.jpg saved to cache
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2a9492c-7a05-56b9-8aa5-35718b68c8d4
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c4dce10>
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f60045d-f04a-536a-8759-20e507640d8f/0f60045d-f04a-536a-8759-20e507640d8f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1890%252F10041890%252Finterior_front_seats-1774697522866.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1890/10041890/interior_front_seats-1774697522866.jpg saved to cache
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f60045d-f04a-536a-8759-20e507640d8f
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2df27d10>
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280a30ed-6030-571b-a4a7-77d327c87731/280a30ed-6030-571b-a4a7-77d327c87731_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5497%252F19525497%252Fdocs_service_history-1774185210839.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3a33b310ad07e391c64116c10b671023') HTTP/1.1" 204 0
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5497/19525497/docs_service_history-1774185210839.jpg?ixlib=js-3.8.0&auto=format&s=3a33b310ad07e391c64116c10b671023 saved to cache
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 280a30ed-6030-571b-a4a7-77d327c87731
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f55bfd0>
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b49382-9cc7-5299-9356-9c88d55b1b52/98b49382-9cc7-5299-9356-9c88d55b1b52_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1907%252F18151907%252Fdamage_scratches-1774701758764.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1907/18151907/damage_scratches-1774701758764.jpg saved to cache
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98b49382-9cc7-5299-9356-9c88d55b1b52
2026-03-29 20:13:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 468b5f77-6048-5b26-8910-7f5a2ef2584c with identifier: 20392027
2026-03-29 20:13:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 468b5f77-6048-5b26-8910-7f5a2ef2584c with identifier: 20392027
2026-03-29 20:13:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 468b5f77-6048-5b26-8910-7f5a2ef2584c with identifier: 20392027 to the API
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_rear_passenger-1774705564911.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '468b5f77-6048-5b26-8910-7f5a2ef2584c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY59 XZE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20392027',
'listing': 'auction',
'location': 'Lincolnshire Lincoln',
'make': 'Renault',
'model': 'Megane',
'odometer': 79000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2207918,
'Height': 2470,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_front_driver-1774705527383.jpg',
'Width': 3293},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1932942,
'Height': 2198,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_rear_driver-1774705746889.jpg',
'Width': 2930},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2304343,
'Height': 2723,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_front_passenger-1774705583747.jpg',
'Width': 3631},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2742815,
'Height': 2960,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2027/20392027/exterior_rear_passenger-1774705564911.jpg',
'Width': 3947},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4541734,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2027/20392027/interior_front_seats-1774706203432.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3638857,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2027/20392027/interior_rear_seats-1774706269947.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3343984,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2027/20392027/interior_dashboard-1774706309853.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3435961,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2027/20392027/interior_boot-1774706343624.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 761227,
'Height': 2227,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2027/20392027/docs_service_history-1774706494547.jpg?ixlib=js-3.8.0&auto=format&s=70398cbe80c21b4fbcec90b06cded4f5',
'Width': 3084},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468b5f77-6048-5b26-8910-7f5a2ef2584c/468b5f77-6048-5b26-8910-7f5a2ef2584c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 885867,
'Height': 2494,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2027/20392027/docs_service_history-1774706496227.jpg?ixlib=js-3.8.0&auto=format&s=ba9c79392e0387fd9952eb364fd4411e',
'Width': 3522}],
'price': 800,
'price_includes_vat': False,
'registration_date': '2009-09-01',
'seats_number': None,
'seller_name': None,
'title': 'Renault Megane Dynamique VVT',
'transmission': 'manual',
'trim': 'Dynamique VVT',
'vin': 'VF1BZ0V0641537484',
'year': 2009}
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720392027%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [motorway.uk] INFO: Saving data for 20392027: {'created_time': 1774815226.070956, 'last_price_update_time': 1774815226.070971, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20392027') HTTP/1.1" 204 0
2026-03-29 20:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20491894.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb09ad0>
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ab5cb8-930a-5d56-9684-1a95377f97dd/c5ab5cb8-930a-5d56-9684-1a95377f97dd_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7137%252F20457137%252Finterior_boot-1774712115059.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7137/20457137/interior_boot-1774712115059.jpg saved to cache
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5ab5cb8-930a-5d56-9684-1a95377f97dd
2026-03-29 20:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 156cc15a-2669-53e3-889d-9a7ca15f8000 with identifier: 20491894
2026-03-29 20:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 156cc15a-2669-53e3-889d-9a7ca15f8000 with scrape type 1
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 156cc15a-2669-53e3-889d-9a7ca15f8000
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1894%252F20491894%252Fexterior_front_driver-1774714560964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_front_driver-1774714560964.jpg not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1894%252F20491894%252Fexterior_rear_driver-1774714673075.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_rear_driver-1774714673075.jpg not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1894%252F20491894%252Fexterior_front_passenger-1774714632207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_front_passenger-1774714632207.jpg not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1894%252F20491894%252Fexterior_rear_passenger-1774714614375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_rear_passenger-1774714614375.jpg not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1894%252F20491894%252Finterior_front_seats-1774715621957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1894/20491894/interior_front_seats-1774715621957.jpg not downloaded yet
2026-03-29 20:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8662679.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_rear_driver-1774716175050.jpg> (referer: None)
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1894%252F20491894%252Finterior_rear_seats-1774771417420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1894/20491894/interior_rear_seats-1774771417420.jpg not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1894%252F20491894%252Finterior_dashboard-1774771427366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1894/20491894/interior_dashboard-1774771427366.jpg not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1894%252F20491894%252Finterior_boot-1774715759366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1894/20491894/interior_boot-1774715759366.jpg not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1894%252F20491894%252Fdocs_service_history-1774715926854.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da3998815e4c01fbb7d97a22ca6c8d669%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1894/20491894/docs_service_history-1774715926854.jpg?ixlib=js-3.8.0&auto=format&s=a3998815e4c01fbb7d97a22ca6c8d669 not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1894%252F20491894%252Fdocs_service_history-1774715927501.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9a8ba63c06dcea864d75ed0ca849d8ac%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1894/20491894/docs_service_history-1774715927501.jpg?ixlib=js-3.8.0&auto=format&s=9a8ba63c06dcea864d75ed0ca849d8ac not downloaded yet
2026-03-29 20:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2067/17822067/interior_boot-1774512836509.jpg> (referer: None)
2026-03-29 20:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af8e4428-1bc9-5feb-bfbf-7cda007cce22 with identifier: 8662679
2026-03-29 20:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af8e4428-1bc9-5feb-bfbf-7cda007cce22 with scrape type 1
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af8e4428-1bc9-5feb-bfbf-7cda007cce22
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2679%252F8662679%252Fexterior_front_driver-1742825440212.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2679/8662679/exterior_front_driver-1742825440212.jpeg not downloaded yet
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c5890>
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1098%252F20111098%252Fexterior_rear_driver-1774716175050.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_rear_driver-1774716175050.jpg saved to cache
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60a23567-04d2-51d9-99a4-3d580b60f12b
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2679%252F8662679%252F8662679-exterior_rear_driver-modified-1774776820982.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2679/8662679/8662679-exterior_rear_driver-modified-1774776820982.jpeg not downloaded yet
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1e7610>
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_678c912c-4955-5d44-a7da-001f6794bc22/678c912c-4955-5d44-a7da-001f6794bc22_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2067%252F17822067%252Finterior_boot-1774512836509.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2067/17822067/interior_boot-1774512836509.jpg saved to cache
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 678c912c-4955-5d44-a7da-001f6794bc22
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2679%252F8662679%252Fexterior_front_passenger-1742825572396.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2679/8662679/exterior_front_passenger-1742825572396.jpeg not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2679%252F8662679%252Fexterior_rear_passenger-1742825480472.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2679/8662679/exterior_rear_passenger-1742825480472.jpeg not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2679%252F8662679%252Finterior_front_seats-1742826050072.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2679/8662679/interior_front_seats-1742826050072.jpeg not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2679%252F8662679%252Finterior_rear_seats-1742826004099.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2679/8662679/interior_rear_seats-1742826004099.jpeg not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2679%252F8662679%252Finterior_dashboard-1742825877049.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2679/8662679/interior_dashboard-1742825877049.jpeg not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2679%252F8662679%252Finstrument_cluster-1742825601600.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2679/8662679/instrument_cluster-1742825601600.jpeg not downloaded yet
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2679%252F8662679%252Finterior_boot-1742825693958.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2679/8662679/interior_boot-1742825693958.jpeg not downloaded yet
2026-03-29 20:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5932/20485932/interior_front_seats-1774697038138.jpg> (referer: None)
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F2679%252F8662679%252F8662679-docs_service_history-default-1742818057617.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D05c376e361824fc86dcb3c0a7ee5a1ea%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/2679/8662679/8662679-docs_service_history-default-1742818057617.jpg?ixlib=js-3.8.0&auto=format&s=05c376e361824fc86dcb3c0a7ee5a1ea not downloaded yet
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7137/20457137/interior_dashboard-1774711340891.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2067/17822067/instrument_cluster-1774512899106.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5932/20485932/exterior_rear_passenger-1774696653777.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1890/10041890/exterior_rear_passenger-1774702239161.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1894/20491894/docs_service_history-1774715927501.jpg?ixlib=js-3.8.0&auto=format&s=9a8ba63c06dcea864d75ed0ca849d8ac> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0126/20080126/interior_boot-1774711921404.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5497/19525497/interior_boot-1774185016913.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_rear_passenger-1774714614375.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5497/19525497/instrument_cluster-1774185173765.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0126/20080126/instrument_cluster-1774712296951.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1894/20491894/interior_front_seats-1774715621957.jpg> (referer: None)
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d537250>
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165c371d-4f61-5bf7-a1f7-f0e6e4074650/165c371d-4f61-5bf7-a1f7-f0e6e4074650_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5932%252F20485932%252Finterior_front_seats-1774697038138.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5932/20485932/interior_front_seats-1774697038138.jpg saved to cache
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 165c371d-4f61-5bf7-a1f7-f0e6e4074650
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f48a610>
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ab5cb8-930a-5d56-9684-1a95377f97dd/c5ab5cb8-930a-5d56-9684-1a95377f97dd_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7137%252F20457137%252Finterior_dashboard-1774711340891.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7137/20457137/interior_dashboard-1774711340891.jpg saved to cache
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5ab5cb8-930a-5d56-9684-1a95377f97dd
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c90cc50>
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_678c912c-4955-5d44-a7da-001f6794bc22/678c912c-4955-5d44-a7da-001f6794bc22_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2067%252F17822067%252Finstrument_cluster-1774512899106.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2067/17822067/instrument_cluster-1774512899106.jpg saved to cache
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 678c912c-4955-5d44-a7da-001f6794bc22
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d011310>
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165c371d-4f61-5bf7-a1f7-f0e6e4074650/165c371d-4f61-5bf7-a1f7-f0e6e4074650_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20485932%252Fexterior_rear_passenger-1774696653777.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20485932/exterior_rear_passenger-1774696653777.jpg saved to cache
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 165c371d-4f61-5bf7-a1f7-f0e6e4074650
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4b4550>
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f60045d-f04a-536a-8759-20e507640d8f/0f60045d-f04a-536a-8759-20e507640d8f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1890%252F10041890%252Fexterior_rear_passenger-1774702239161.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1890/10041890/exterior_rear_passenger-1774702239161.jpg saved to cache
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f60045d-f04a-536a-8759-20e507640d8f
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7e9e10>
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1894%252F20491894%252Fdocs_service_history-1774715927501.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9a8ba63c06dcea864d75ed0ca849d8ac') HTTP/1.1" 204 0
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1894/20491894/docs_service_history-1774715927501.jpg?ixlib=js-3.8.0&auto=format&s=9a8ba63c06dcea864d75ed0ca849d8ac saved to cache
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 156cc15a-2669-53e3-889d-9a7ca15f8000
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2defd0>
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a9492c-7a05-56b9-8aa5-35718b68c8d4/e2a9492c-7a05-56b9-8aa5-35718b68c8d4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0126%252F20080126%252Finterior_boot-1774711921404.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0126/20080126/interior_boot-1774711921404.jpg saved to cache
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2a9492c-7a05-56b9-8aa5-35718b68c8d4
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4b7d50>
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280a30ed-6030-571b-a4a7-77d327c87731/280a30ed-6030-571b-a4a7-77d327c87731_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5497%252F19525497%252Finterior_boot-1774185016913.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5497/19525497/interior_boot-1774185016913.jpg saved to cache
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 280a30ed-6030-571b-a4a7-77d327c87731
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c90e5d0>
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1894%252F20491894%252Fexterior_rear_passenger-1774714614375.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_rear_passenger-1774714614375.jpg saved to cache
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 156cc15a-2669-53e3-889d-9a7ca15f8000
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d039250>
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280a30ed-6030-571b-a4a7-77d327c87731/280a30ed-6030-571b-a4a7-77d327c87731_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F19525497%252Finstrument_cluster-1774185173765.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/19525497/instrument_cluster-1774185173765.jpg saved to cache
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 280a30ed-6030-571b-a4a7-77d327c87731
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c919a50>
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a9492c-7a05-56b9-8aa5-35718b68c8d4/e2a9492c-7a05-56b9-8aa5-35718b68c8d4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0126%252F20080126%252Finstrument_cluster-1774712296951.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0126/20080126/instrument_cluster-1774712296951.jpg saved to cache
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2a9492c-7a05-56b9-8aa5-35718b68c8d4
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d536910>
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1894%252F20491894%252Finterior_front_seats-1774715621957.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1894/20491894/interior_front_seats-1774715621957.jpg saved to cache
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 156cc15a-2669-53e3-889d-9a7ca15f8000
2026-03-29 20:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3873152.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2679/8662679/interior_boot-1742825693958.jpeg> (referer: None)
2026-03-29 20:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b61077-3fa6-5f3f-a76d-8d2311dac0cd with identifier: 3873152
2026-03-29 20:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd with scrape type 1
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3152%252F3873152%252Fexterior_front_driver-1774707895964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_front_driver-1774707895964.jpg not downloaded yet
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3152%252F3873152%252Fexterior_rear_driver-1774707912260.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_rear_driver-1774707912260.jpg not downloaded yet
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3152%252F3873152%252Fexterior_front_passenger-1774707947950.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_front_passenger-1774707947950.jpg not downloaded yet
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11 Pro\x00'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 174 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 182 - value: b'16.6.1\x00'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 190 - value: b'2025:03:24 14:14:48\x00'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 210 - value: b'iPhone 11 Pro\x00'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe0'
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d935c50>
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2679%252F8662679%252Finterior_boot-1742825693958.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2679/8662679/interior_boot-1742825693958.jpeg saved to cache
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af8e4428-1bc9-5feb-bfbf-7cda007cce22
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3152%252F3873152%252Fexterior_rear_passenger-1774707929206.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_rear_passenger-1774707929206.jpg not downloaded yet
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3152%252F3873152%252Finterior_front_seats-1774708343325.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3152/3873152/interior_front_seats-1774708343325.jpg not downloaded yet
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3152%252F3873152%252Finterior_rear_seats-1774708382449.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3152/3873152/interior_rear_seats-1774708382449.jpg not downloaded yet
2026-03-29 20:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1894/20491894/docs_service_history-1774715926854.jpg?ixlib=js-3.8.0&auto=format&s=a3998815e4c01fbb7d97a22ca6c8d669> (referer: None)
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3152%252F3873152%252Finterior_dashboard-1774708420953.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3152/3873152/interior_dashboard-1774708420953.jpg not downloaded yet
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3152%252F3873152%252Finstrument_cluster-1774708587766.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3152/3873152/instrument_cluster-1774708587766.jpg not downloaded yet
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3152%252F3873152%252Finterior_boot-1774709326756.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3152/3873152/interior_boot-1774709326756.jpg not downloaded yet
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3152%252F3873152%252Fdocs_service_history-1774708545675.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Deb540476e93b9e13e33c1179a9924349%27 HTTP/1.1" 200 None
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3152/3873152/docs_service_history-1774708545675.jpg?ixlib=js-3.8.0&auto=format&s=eb540476e93b9e13e33c1179a9924349 not downloaded yet
2026-03-29 20:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1894/20491894/interior_rear_seats-1774771417420.jpg> (referer: None)
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd89390>
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1894%252F20491894%252Fdocs_service_history-1774715926854.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da3998815e4c01fbb7d97a22ca6c8d669') HTTP/1.1" 204 0
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1894/20491894/docs_service_history-1774715926854.jpg?ixlib=js-3.8.0&auto=format&s=a3998815e4c01fbb7d97a22ca6c8d669 saved to cache
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 156cc15a-2669-53e3-889d-9a7ca15f8000
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4a0c10>
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1894%252F20491894%252Finterior_rear_seats-1774771417420.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1894/20491894/interior_rear_seats-1774771417420.jpg saved to cache
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 156cc15a-2669-53e3-889d-9a7ca15f8000
2026-03-29 20:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2679/8662679/exterior_front_driver-1742825440212.jpeg> (referer: None)
2026-03-29 20:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1894/20491894/interior_dashboard-1774771427366.jpg> (referer: None)
2026-03-29 20:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/2679/8662679/8662679-docs_service_history-default-1742818057617.jpg?ixlib=js-3.8.0&auto=format&s=05c376e361824fc86dcb3c0a7ee5a1ea> (referer: None)
2026-03-29 20:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2679/8662679/exterior_rear_passenger-1742825480472.jpeg> (referer: None)
2026-03-29 20:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2679/8662679/instrument_cluster-1742825601600.jpeg> (referer: None)
2026-03-29 20:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2679/8662679/8662679-exterior_rear_driver-modified-1774776820982.jpeg> (referer: None)
2026-03-29 20:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2679/8662679/exterior_front_passenger-1742825572396.jpeg> (referer: None)
2026-03-29 20:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2679/8662679/interior_dashboard-1742825877049.jpeg> (referer: None)
2026-03-29 20:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2679/8662679/interior_front_seats-1742826050072.jpeg> (referer: None)
2026-03-29 20:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1894/20491894/interior_boot-1774715759366.jpg> (referer: None)
2026-03-29 20:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2679/8662679/interior_rear_seats-1742826004099.jpeg> (referer: None)
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e107b50>
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2679%252F8662679%252Fexterior_front_driver-1742825440212.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2679/8662679/exterior_front_driver-1742825440212.jpeg saved to cache
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af8e4428-1bc9-5feb-bfbf-7cda007cce22
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5dce90>
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1894%252F20491894%252Finterior_dashboard-1774771427366.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1894/20491894/interior_dashboard-1774771427366.jpg saved to cache
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 156cc15a-2669-53e3-889d-9a7ca15f8000
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cebd010>
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F2679%252F8662679%252F8662679-docs_service_history-default-1742818057617.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D05c376e361824fc86dcb3c0a7ee5a1ea') HTTP/1.1" 204 0
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/2679/8662679/8662679-docs_service_history-default-1742818057617.jpg?ixlib=js-3.8.0&auto=format&s=05c376e361824fc86dcb3c0a7ee5a1ea saved to cache
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af8e4428-1bc9-5feb-bfbf-7cda007cce22
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f21b6d0>
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2679%252F8662679%252Fexterior_rear_passenger-1742825480472.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2679/8662679/exterior_rear_passenger-1742825480472.jpeg saved to cache
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af8e4428-1bc9-5feb-bfbf-7cda007cce22
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11 Pro\x00'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 174 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 182 - value: b'16.6.1\x00'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 190 - value: b'2025:03:24 14:13:19\x00'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 210 - value: b'iPhone 11 Pro\x00'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe0'
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c511750>
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2679%252F8662679%252Finstrument_cluster-1742825601600.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2679/8662679/instrument_cluster-1742825601600.jpeg saved to cache
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af8e4428-1bc9-5feb-bfbf-7cda007cce22
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3359d0>
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2679%252F8662679%252F8662679-exterior_rear_driver-modified-1774776820982.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2679/8662679/8662679-exterior_rear_driver-modified-1774776820982.jpeg saved to cache
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af8e4428-1bc9-5feb-bfbf-7cda007cce22
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c5119d0>
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2679%252F8662679%252Fexterior_front_passenger-1742825572396.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2679/8662679/exterior_front_passenger-1742825572396.jpeg saved to cache
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af8e4428-1bc9-5feb-bfbf-7cda007cce22
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11 Pro\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 174 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 182 - value: b'16.6.1\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 190 - value: b'2025:03:24 14:17:52\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 210 - value: b'iPhone 11 Pro\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe0'
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de569d0>
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2679%252F8662679%252Finterior_dashboard-1742825877049.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2679/8662679/interior_dashboard-1742825877049.jpeg saved to cache
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af8e4428-1bc9-5feb-bfbf-7cda007cce22
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11 Pro\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 174 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 182 - value: b'16.6.1\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 190 - value: b'2025:03:24 14:20:44\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 210 - value: b'iPhone 11 Pro\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe0'
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c510290>
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2679%252F8662679%252Finterior_front_seats-1742826050072.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2679/8662679/interior_front_seats-1742826050072.jpeg saved to cache
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af8e4428-1bc9-5feb-bfbf-7cda007cce22
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8a9790>
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1894%252F20491894%252Finterior_boot-1774715759366.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1894/20491894/interior_boot-1774715759366.jpg saved to cache
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 156cc15a-2669-53e3-889d-9a7ca15f8000
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11 Pro\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 174 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 182 - value: b'16.6.1\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 190 - value: b'2025:03:24 14:19:58\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 210 - value: b'iPhone 11 Pro\x00'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe0'
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c512990>
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2679%252F8662679%252Finterior_rear_seats-1742826004099.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2679/8662679/interior_rear_seats-1742826004099.jpeg saved to cache
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af8e4428-1bc9-5feb-bfbf-7cda007cce22
2026-03-29 20:13:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af8e4428-1bc9-5feb-bfbf-7cda007cce22, skipping ID generation
2026-03-29 20:13:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af8e4428-1bc9-5feb-bfbf-7cda007cce22 with scrape type 1
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af8e4428-1bc9-5feb-bfbf-7cda007cce22 sending to next pipeline
2026-03-29 20:13:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: af8e4428-1bc9-5feb-bfbf-7cda007cce22, identifier: 8662679
2026-03-29 20:13:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: af8e4428-1bc9-5feb-bfbf-7cda007cce22 with identifier: 8662679
2026-03-29 20:13:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: af8e4428-1bc9-5feb-bfbf-7cda007cce22 with identifier: 8662679
2026-03-29 20:13:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: af8e4428-1bc9-5feb-bfbf-7cda007cce22 with identifier: 8662679 to the API
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2679/8662679/interior_rear_seats-1742826004099.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'af8e4428-1bc9-5feb-bfbf-7cda007cce22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LE16 BXR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/8662679',
'listing': 'auction',
'location': 'West Midlands Wolverhampton',
'make': 'MINI',
'model': 'Countryman',
'odometer': 54445,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1889003,
'Height': 2886,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2679/8662679/exterior_front_driver-1742825440212.jpeg',
'Width': 3848},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2977909,
'Height': 2957,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2679/8662679/8662679-exterior_rear_driver-modified-1774776820982.jpeg',
'Width': 3943},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2726818,
'Height': 3011,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2679/8662679/exterior_front_passenger-1742825572396.jpeg',
'Width': 4015},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2437545,
'Height': 2657,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2679/8662679/exterior_rear_passenger-1742825480472.jpeg',
'Width': 3542},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3127964,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2679/8662679/interior_front_seats-1742826050072.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3637826,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2679/8662679/interior_rear_seats-1742826004099.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3087563,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2679/8662679/interior_dashboard-1742825877049.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2824179,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2679/8662679/instrument_cluster-1742825601600.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4032921,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2679/8662679/interior_boot-1742825693958.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8e4428-1bc9-5feb-bfbf-7cda007cce22/af8e4428-1bc9-5feb-bfbf-7cda007cce22_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1629324,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/2679/8662679/8662679-docs_service_history-default-1742818057617.jpg?ixlib=js-3.8.0&auto=format&s=05c376e361824fc86dcb3c0a7ee5a1ea',
'Width': 3024}],
'price': 6000,
'price_includes_vat': False,
'registration_date': '2016-07-15',
'seats_number': None,
'seller_name': None,
'title': 'MINI Countryman Cooper SD Auto',
'transmission': 'automatic',
'trim': 'Cooper SD Auto',
'vin': 'WMWZB72070WU16242',
'year': 2016}
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278662679%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [motorway.uk] INFO: Saving data for 8662679: {'created_time': 1774815231.464435, 'last_price_update_time': 1774815231.464447, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='8662679') HTTP/1.1" 204 0
2026-03-29 20:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20020455.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3152/3873152/docs_service_history-1774708545675.jpg?ixlib=js-3.8.0&auto=format&s=eb540476e93b9e13e33c1179a9924349> (referer: None)
2026-03-29 20:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1692&page=47&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3152/3873152/interior_rear_seats-1774708382449.jpg> (referer: None)
2026-03-29 20:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3152/3873152/instrument_cluster-1774708587766.jpg> (referer: None)
2026-03-29 20:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3152/3873152/interior_boot-1774709326756.jpg> (referer: None)
2026-03-29 20:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2311ff7a-668f-50d4-8a1e-c59ca07eac91 with identifier: 20020455
2026-03-29 20:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91 with scrape type 1
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0455%252F20020455%252Fexterior_front_driver-1774714922441.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0455/20020455/exterior_front_driver-1774714922441.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0455%252F20020455%252Fexterior_rear_driver-1774714935160.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0455/20020455/exterior_rear_driver-1774714935160.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0455%252F20020455%252Fexterior_front_passenger-1774714949097.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0455/20020455/exterior_front_passenger-1774714949097.jpg not downloaded yet
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de54350>
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3152%252F3873152%252Fdocs_service_history-1774708545675.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Deb540476e93b9e13e33c1179a9924349') HTTP/1.1" 204 0
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3152/3873152/docs_service_history-1774708545675.jpg?ixlib=js-3.8.0&auto=format&s=eb540476e93b9e13e33c1179a9924349 saved to cache
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd
2026-03-29 20:13:51 [motorway.uk] INFO: Found listing with ID: 20296573
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720296573%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [motorway.uk] INFO: Scrape type for 20296573: 1
2026-03-29 20:13:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e10b2d0>
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3152%252F3873152%252Finterior_rear_seats-1774708382449.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3152/3873152/interior_rear_seats-1774708382449.jpg saved to cache
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0455%252F20020455%252Fexterior_rear_passenger-1774714965098.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0455/20020455/exterior_rear_passenger-1774714965098.jpg not downloaded yet
2026-03-29 20:13:51 [motorway.uk] INFO: Found listing with ID: 20262707
2026-03-29 20:13:51 [motorway.uk] INFO: Found listing with ID: 20491857
2026-03-29 20:13:51 [motorway.uk] INFO: Found listing with ID: 20392037
2026-03-29 20:13:51 [motorway.uk] INFO: Found listing with ID: 19849179
2026-03-29 20:13:51 [motorway.uk] INFO: Found listing with ID: 19605190
2026-03-29 20:13:51 [motorway.uk] INFO: Found listing with ID: 20436357
2026-03-29 20:13:51 [motorway.uk] INFO: Found listing with ID: 10396132
2026-03-29 20:13:51 [motorway.uk] INFO: Found listing with ID: 4873494
2026-03-29 20:13:51 [motorway.uk] INFO: Found listing with ID: 10731175
2026-03-29 20:13:51 [motorway.uk] INFO: Found listing with ID: 20465263
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720465263%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [motorway.uk] INFO: Scrape type for 20465263: 1
2026-03-29 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20377618.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cec6750>
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3152%252F3873152%252Finstrument_cluster-1774708587766.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3152/3873152/instrument_cluster-1774708587766.jpg saved to cache
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd
2026-03-29 20:13:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c5499d0>
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3152%252F3873152%252Finterior_boot-1774709326756.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3152/3873152/interior_boot-1774709326756.jpg saved to cache
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0455%252F20020455%252Finterior_front_seats-1774275294579.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0455/20020455/interior_front_seats-1774275294579.jpg not downloaded yet
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20445236
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 16814678
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20440911
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 17351129
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20474259
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20448667
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 13582416
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 1049339
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20493132
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720493132%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [motorway.uk] INFO: Scrape type for 20493132: 1
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0455%252F20020455%252Finterior_rear_seats-1774275363028.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0455/20020455/interior_rear_seats-1774275363028.jpg not downloaded yet
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 19757080
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20330269
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 13582420
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20379578
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 19988943
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 18468305
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20011671
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20303061
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20471692
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 16982313
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20403202
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 10707418
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20499574
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499574%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [motorway.uk] INFO: Scrape type for 20499574: 1
2026-03-29 20:13:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9abe7319-8e30-58d3-a351-4c67c0db68f5 with identifier: 20377618
2026-03-29 20:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9abe7319-8e30-58d3-a351-4c67c0db68f5 with scrape type 1
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9abe7319-8e30-58d3-a351-4c67c0db68f5
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F20377618%252Fexterior_front_driver-1774694109715.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_front_driver-1774694109715.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0455%252F20020455%252Finterior_dashboard-1774715140056.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0455/20020455/interior_dashboard-1774715140056.jpg not downloaded yet
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 19862807
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20008184
2026-03-29 20:13:52 [motorway.uk] INFO: Found listing with ID: 20136887
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F20377618%252Fexterior_rear_driver-1774694065070.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_rear_driver-1774694065070.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0455%252F20020455%252Finstrument_cluster-1774275378214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0455/20020455/instrument_cluster-1774275378214.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F20377618%252Fexterior_front_passenger-1774694086839.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_front_passenger-1774694086839.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0455%252F20020455%252Finterior_boot-1774715158207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0455/20020455/interior_boot-1774715158207.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F20377618%252Fexterior_rear_passenger-1774694074243.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_rear_passenger-1774694074243.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0455%252F20020455%252Fdocs_service_history-1774276039461.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0d56cda39d6b807c06c10ccfca65cbfa%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0455/20020455/docs_service_history-1774276039461.jpg?ixlib=js-3.8.0&auto=format&s=0d56cda39d6b807c06c10ccfca65cbfa not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7618%252F20377618%252Finterior_front_seats-1774694682956.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7618/20377618/interior_front_seats-1774694682956.jpg not downloaded yet
2026-03-29 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_front_driver-1774707895964.jpg> (referer: None)
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7618%252F20377618%252Finterior_rear_seats-1774694693908.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7618/20377618/interior_rear_seats-1774694693908.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F20377618%252Finterior_dashboard-1774694759870.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/20377618/interior_dashboard-1774694759870.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F20377618%252Finstrument_cluster-1774694783344.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/20377618/instrument_cluster-1774694783344.jpg not downloaded yet
2026-03-29 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_rear_driver-1774707912260.jpg> (referer: None)
2026-03-29 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_rear_passenger-1774707929206.jpg> (referer: None)
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7618%252F20377618%252Finterior_boot-1774694720617.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7618/20377618/interior_boot-1774694720617.jpg not downloaded yet
2026-03-29 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_front_passenger-1774707947950.jpg> (referer: None)
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7618%252F20377618%252Fdocs_service_history-1774694880093.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc9cad1ef04d096f604b927e8d08dc8af%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7618/20377618/docs_service_history-1774694880093.jpg?ixlib=js-3.8.0&auto=format&s=c9cad1ef04d096f604b927e8d08dc8af not downloaded yet
2026-03-29 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3152/3873152/interior_dashboard-1774708420953.jpg> (referer: None)
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1a4910>
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3152%252F3873152%252Fexterior_front_driver-1774707895964.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_front_driver-1774707895964.jpg saved to cache
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3eb9d0>
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3152%252F3873152%252Fexterior_rear_driver-1774707912260.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_rear_driver-1774707912260.jpg saved to cache
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f438690>
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3152%252F3873152%252Fexterior_rear_passenger-1774707929206.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_rear_passenger-1774707929206.jpg saved to cache
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a6f50>
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3152%252F3873152%252Fexterior_front_passenger-1774707947950.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_front_passenger-1774707947950.jpg saved to cache
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d97f5d0>
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3152%252F3873152%252Finterior_dashboard-1774708420953.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3152/3873152/interior_dashboard-1774708420953.jpg saved to cache
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_rear_driver-1774714673075.jpg> (referer: None)
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_front_driver-1774714560964.jpg> (referer: None)
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_front_passenger-1774714632207.jpg> (referer: None)
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1890/10041890/exterior_front_passenger-1774697128292.jpg> (referer: None)
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_front_driver-1774716171238.jpg> (referer: None)
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3152/3873152/interior_front_seats-1774708343325.jpg> (referer: None)
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1907/18151907/interior_boot-1774539683123.jpg> (referer: None)
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7618/20377618/interior_rear_seats-1774694693908.jpg> (referer: None)
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0455/20020455/interior_front_seats-1774275294579.jpg> (referer: None)
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7618/20377618/interior_front_seats-1774694682956.jpg> (referer: None)
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7618/20377618/interior_dashboard-1774694759870.jpg> (referer: None)
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c552410>
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1894%252F20491894%252Fexterior_rear_driver-1774714673075.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_rear_driver-1774714673075.jpg saved to cache
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 156cc15a-2669-53e3-889d-9a7ca15f8000
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c550350>
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1894%252F20491894%252Fexterior_front_driver-1774714560964.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_front_driver-1774714560964.jpg saved to cache
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 156cc15a-2669-53e3-889d-9a7ca15f8000
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c3250>
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1894%252F20491894%252Fexterior_front_passenger-1774714632207.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_front_passenger-1774714632207.jpg saved to cache
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 156cc15a-2669-53e3-889d-9a7ca15f8000
2026-03-29 20:13:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 156cc15a-2669-53e3-889d-9a7ca15f8000, skipping ID generation
2026-03-29 20:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 156cc15a-2669-53e3-889d-9a7ca15f8000 with scrape type 1
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 156cc15a-2669-53e3-889d-9a7ca15f8000 sending to next pipeline
2026-03-29 20:13:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 156cc15a-2669-53e3-889d-9a7ca15f8000, identifier: 20491894
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f3544ad50>
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f60045d-f04a-536a-8759-20e507640d8f/0f60045d-f04a-536a-8759-20e507640d8f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1890%252F10041890%252Fexterior_front_passenger-1774697128292.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1890/10041890/exterior_front_passenger-1774697128292.jpg saved to cache
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f60045d-f04a-536a-8759-20e507640d8f
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1a4710>
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1098%252F20111098%252Fexterior_front_driver-1774716171238.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_front_driver-1774716171238.jpg saved to cache
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60a23567-04d2-51d9-99a4-3d580b60f12b
2026-03-29 20:13:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60a23567-04d2-51d9-99a4-3d580b60f12b, skipping ID generation
2026-03-29 20:13:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a23567-04d2-51d9-99a4-3d580b60f12b with scrape type 1
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60a23567-04d2-51d9-99a4-3d580b60f12b sending to next pipeline
2026-03-29 20:13:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 60a23567-04d2-51d9-99a4-3d580b60f12b, identifier: 20111098
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db6ae90>
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3152%252F3873152%252Finterior_front_seats-1774708343325.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3152/3873152/interior_front_seats-1774708343325.jpg saved to cache
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd
2026-03-29 20:13:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58b61077-3fa6-5f3f-a76d-8d2311dac0cd, skipping ID generation
2026-03-29 20:13:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd with scrape type 1
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58b61077-3fa6-5f3f-a76d-8d2311dac0cd sending to next pipeline
2026-03-29 20:13:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 58b61077-3fa6-5f3f-a76d-8d2311dac0cd, identifier: 3873152
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a5190>
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b49382-9cc7-5299-9356-9c88d55b1b52/98b49382-9cc7-5299-9356-9c88d55b1b52_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1907%252F18151907%252Finterior_boot-1774539683123.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1907/18151907/interior_boot-1774539683123.jpg saved to cache
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98b49382-9cc7-5299-9356-9c88d55b1b52
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f558b10>
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7618%252F20377618%252Finterior_rear_seats-1774694693908.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7618/20377618/interior_rear_seats-1774694693908.jpg saved to cache
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9abe7319-8e30-58d3-a351-4c67c0db68f5
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd34a10>
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0455%252F20020455%252Finterior_front_seats-1774275294579.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0455/20020455/interior_front_seats-1774275294579.jpg saved to cache
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f558b90>
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7618%252F20377618%252Finterior_front_seats-1774694682956.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7618/20377618/interior_front_seats-1774694682956.jpg saved to cache
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9abe7319-8e30-58d3-a351-4c67c0db68f5
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d216f90>
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F20377618%252Finterior_dashboard-1774694759870.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/20377618/interior_dashboard-1774694759870.jpg saved to cache
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9abe7319-8e30-58d3-a351-4c67c0db68f5
2026-03-29 20:13:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 156cc15a-2669-53e3-889d-9a7ca15f8000 with identifier: 20491894
2026-03-29 20:13:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 156cc15a-2669-53e3-889d-9a7ca15f8000 with identifier: 20491894
2026-03-29 20:13:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 156cc15a-2669-53e3-889d-9a7ca15f8000 with identifier: 20491894 to the API
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_front_passenger-1774714632207.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '156cc15a-2669-53e3-889d-9a7ca15f8000',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'CA62 HNN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20491894',
'listing': 'auction',
'location': 'Newport Newport',
'make': 'Vauxhall',
'model': 'Mokka',
'odometer': 41300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2407131,
'Height': 2956,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_front_driver-1774714560964.jpg',
'Width': 3941},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1965818,
'Height': 2585,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_rear_driver-1774714673075.jpg',
'Width': 3447},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2192493,
'Height': 2417,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_front_passenger-1774714632207.jpg',
'Width': 3223},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2048138,
'Height': 2394,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1894/20491894/exterior_rear_passenger-1774714614375.jpg',
'Width': 3192},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3207138,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1894/20491894/interior_front_seats-1774715621957.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1080998,
'Height': 2048,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1894/20491894/interior_rear_seats-1774771417420.jpg',
'Width': 2731},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1489624,
'Height': 2124,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1894/20491894/interior_dashboard-1774771427366.jpg',
'Width': 2832},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3564109,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1894/20491894/interior_boot-1774715759366.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388034,
'Height': 1768,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1894/20491894/docs_service_history-1774715926854.jpg?ixlib=js-3.8.0&auto=format&s=a3998815e4c01fbb7d97a22ca6c8d669',
'Width': 2634},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156cc15a-2669-53e3-889d-9a7ca15f8000/156cc15a-2669-53e3-889d-9a7ca15f8000_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1042132,
'Height': 1559,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1894/20491894/docs_service_history-1774715927501.jpg?ixlib=js-3.8.0&auto=format&s=9a8ba63c06dcea864d75ed0ca849d8ac',
'Width': 2358}],
'price': 3950,
'price_includes_vat': False,
'registration_date': '2013-01-16',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Mokka SE S/S',
'transmission': 'manual',
'trim': 'SE S/S',
'vin': 'W0LJD7EE5DB057146',
'year': 2013}
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491894%27 HTTP/1.1" 200 None
2026-03-29 20:13:55 [motorway.uk] INFO: Saving data for 20491894: {'created_time': 1774815235.752122, 'last_price_update_time': 1774815235.752133, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20491894') HTTP/1.1" 204 0
2026-03-29 20:13:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 60a23567-04d2-51d9-99a4-3d580b60f12b with identifier: 20111098
2026-03-29 20:13:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 60a23567-04d2-51d9-99a4-3d580b60f12b with identifier: 20111098
2026-03-29 20:13:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 60a23567-04d2-51d9-99a4-3d580b60f12b with identifier: 20111098 to the API
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_front_driver-1774716171238.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '60a23567-04d2-51d9-99a4-3d580b60f12b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'M50 RWL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20111098',
'listing': 'auction',
'location': 'Cornwall Liskeard',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 59000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1855704,
'Height': 2623,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_front_driver-1774716171238.jpg',
'Width': 3497},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1499353,
'Height': 2429,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_rear_driver-1774716175050.jpg',
'Width': 3238},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1550137,
'Height': 2369,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_front_passenger-1774716266213.jpg',
'Width': 3158},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1739347,
'Height': 2430,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1098/20111098/exterior_rear_passenger-1774716317823.jpg',
'Width': 3240},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2927263,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1098/20111098/interior_front_seats-1774716842194.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2849789,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1098/20111098/interior_rear_seats-1774716861932.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582880,
'Height': 1759,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1098/20111098/interior_dashboard-1774786215638.jpg',
'Width': 2346},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2693809,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1098/20111098/instrument_cluster-1774716948949.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3717726,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1098/20111098/interior_boot-1774716897626.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a23567-04d2-51d9-99a4-3d580b60f12b/60a23567-04d2-51d9-99a4-3d580b60f12b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1633637,
'Height': 3036,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1098/20111098/docs_service_history-1774786073910.jpg?ixlib=js-3.8.0&auto=format&s=3ba992d5e302f29aa4dbae1e04355a54',
'Width': 4048}],
'price': 7268,
'price_includes_vat': False,
'registration_date': '2016-06-14',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery Sport SE TD4 Auto',
'transmission': 'automatic',
'trim': 'Sport SE TD4 Auto',
'vin': 'SALCA2AN8HH624036',
'year': 2016}
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720111098%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [motorway.uk] INFO: Saving data for 20111098: {'created_time': 1774815236.221317, 'last_price_update_time': 1774815236.221326, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20111098') HTTP/1.1" 204 0
2026-03-29 20:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 58b61077-3fa6-5f3f-a76d-8d2311dac0cd with identifier: 3873152
2026-03-29 20:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 58b61077-3fa6-5f3f-a76d-8d2311dac0cd with identifier: 3873152
2026-03-29 20:13:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 58b61077-3fa6-5f3f-a76d-8d2311dac0cd with identifier: 3873152 to the API
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3152/3873152/interior_front_seats-1774708343325.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '58b61077-3fa6-5f3f-a76d-8d2311dac0cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DS18 LRZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3873152',
'listing': 'auction',
'location': 'Greater Manchester Stockport',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 77881,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1435898,
'Height': 2336,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_front_driver-1774707895964.jpg',
'Width': 3114},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1251849,
'Height': 2232,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_rear_driver-1774707912260.jpg',
'Width': 2976},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1382284,
'Height': 2318,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_front_passenger-1774707947950.jpg',
'Width': 3090},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1290436,
'Height': 2213,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3152/3873152/exterior_rear_passenger-1774707929206.jpg',
'Width': 2951},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3681307,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3152/3873152/interior_front_seats-1774708343325.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3433089,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3152/3873152/interior_rear_seats-1774708382449.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1658961,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3152/3873152/interior_dashboard-1774708420953.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2520755,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3152/3873152/instrument_cluster-1774708587766.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3656004,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3152/3873152/interior_boot-1774709326756.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b61077-3fa6-5f3f-a76d-8d2311dac0cd/58b61077-3fa6-5f3f-a76d-8d2311dac0cd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655492,
'Height': 3378,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3152/3873152/docs_service_history-1774708545675.jpg?ixlib=js-3.8.0&auto=format&s=eb540476e93b9e13e33c1179a9924349',
'Width': 2358}],
'price': 5878,
'price_includes_vat': False,
'registration_date': '2018-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai N-Connecta DCI',
'transmission': 'manual',
'trim': 'N-Connecta DCI',
'vin': 'SJNFAAJ11U2311899',
'year': 2018}
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273873152%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [motorway.uk] INFO: Saving data for 3873152: {'created_time': 1774815236.603311, 'last_price_update_time': 1774815236.603325, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3873152') HTTP/1.1" 204 0
2026-03-29 20:13:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0455/20020455/docs_service_history-1774276039461.jpg?ixlib=js-3.8.0&auto=format&s=0d56cda39d6b807c06c10ccfca65cbfa> (referer: None)
2026-03-29 20:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7618/20377618/docs_service_history-1774694880093.jpg?ixlib=js-3.8.0&auto=format&s=c9cad1ef04d096f604b927e8d08dc8af> (referer: None)
2026-03-29 20:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7618/20377618/instrument_cluster-1774694783344.jpg> (referer: None)
2026-03-29 20:13:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7618/20377618/interior_boot-1774694720617.jpg> (referer: None)
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d89a350>
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0455%252F20020455%252Fdocs_service_history-1774276039461.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0d56cda39d6b807c06c10ccfca65cbfa') HTTP/1.1" 204 0
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0455/20020455/docs_service_history-1774276039461.jpg?ixlib=js-3.8.0&auto=format&s=0d56cda39d6b807c06c10ccfca65cbfa saved to cache
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5f8e10>
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7618%252F20377618%252Fdocs_service_history-1774694880093.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc9cad1ef04d096f604b927e8d08dc8af') HTTP/1.1" 204 0
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7618/20377618/docs_service_history-1774694880093.jpg?ixlib=js-3.8.0&auto=format&s=c9cad1ef04d096f604b927e8d08dc8af saved to cache
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9abe7319-8e30-58d3-a351-4c67c0db68f5
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cecc610>
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F20377618%252Finstrument_cluster-1774694783344.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/20377618/instrument_cluster-1774694783344.jpg saved to cache
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9abe7319-8e30-58d3-a351-4c67c0db68f5
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5f5e90>
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7618%252F20377618%252Finterior_boot-1774694720617.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7618/20377618/interior_boot-1774694720617.jpg saved to cache
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9abe7319-8e30-58d3-a351-4c67c0db68f5
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20465263.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10468400.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_rear_passenger-1774694074243.jpg> (referer: None)
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_front_driver-1774694109715.jpg> (referer: None)
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_front_passenger-1774694086839.jpg> (referer: None)
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_rear_driver-1774694065070.jpg> (referer: None)
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0455/20020455/exterior_rear_passenger-1774714965098.jpg> (referer: None)
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0455/20020455/interior_dashboard-1774715140056.jpg> (referer: None)
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0455/20020455/instrument_cluster-1774275378214.jpg> (referer: None)
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0455/20020455/interior_boot-1774715158207.jpg> (referer: None)
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0455/20020455/interior_rear_seats-1774275363028.jpg> (referer: None)
2026-03-29 20:13:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d4064e2-a7b1-5519-aacc-b721c07abb14 with identifier: 20465263
2026-03-29 20:13:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4064e2-a7b1-5519-aacc-b721c07abb14 with scrape type 1
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d4064e2-a7b1-5519-aacc-b721c07abb14
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5263%252F20465263%252Fexterior_front_driver-1774775328401.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_front_driver-1774775328401.jpg not downloaded yet
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5263%252F20465263%252Fexterior_rear_driver-1774775360475.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_rear_driver-1774775360475.jpg not downloaded yet
2026-03-29 20:13:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9b6f9e5-6c76-5bed-9137-08543c44d2bd with identifier: 10468400
2026-03-29 20:13:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd with scrape type 1
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8400%252F10468400%252Fexterior_front_driver-1774629755797.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8400/10468400/exterior_front_driver-1774629755797.jpg not downloaded yet
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5263%252F20465263%252Fexterior_front_passenger-1774775397942.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_front_passenger-1774775397942.jpg not downloaded yet
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8400%252F10468400%252Fexterior_rear_driver-1774630362689.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8400/10468400/exterior_rear_driver-1774630362689.jpg not downloaded yet
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cecc890>
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F20377618%252Fexterior_rear_passenger-1774694074243.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_rear_passenger-1774694074243.jpg saved to cache
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9abe7319-8e30-58d3-a351-4c67c0db68f5
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5263%252F20465263%252Fexterior_rear_passenger-1774775374955.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_rear_passenger-1774775374955.jpg not downloaded yet
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8400%252F10468400%252Fexterior_front_passenger-1774197287298.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8400/10468400/exterior_front_passenger-1774197287298.jpg not downloaded yet
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20493132.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5263%252F20465263%252Finterior_front_seats-1774775953957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5263/20465263/interior_front_seats-1774775953957.jpg not downloaded yet
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d214d90>
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F20377618%252Fexterior_front_driver-1774694109715.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_front_driver-1774694109715.jpg saved to cache
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9abe7319-8e30-58d3-a351-4c67c0db68f5
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d08df90>
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F20377618%252Fexterior_front_passenger-1774694086839.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_front_passenger-1774694086839.jpg saved to cache
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9abe7319-8e30-58d3-a351-4c67c0db68f5
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7e5c50>
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F20377618%252Fexterior_rear_driver-1774694065070.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_rear_driver-1774694065070.jpg saved to cache
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9abe7319-8e30-58d3-a351-4c67c0db68f5
2026-03-29 20:13:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9abe7319-8e30-58d3-a351-4c67c0db68f5, skipping ID generation
2026-03-29 20:13:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9abe7319-8e30-58d3-a351-4c67c0db68f5 with scrape type 1
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9abe7319-8e30-58d3-a351-4c67c0db68f5 sending to next pipeline
2026-03-29 20:13:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9abe7319-8e30-58d3-a351-4c67c0db68f5, identifier: 20377618
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4ea550>
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0455%252F20020455%252Fexterior_rear_passenger-1774714965098.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0455/20020455/exterior_rear_passenger-1774714965098.jpg saved to cache
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c0a0e10>
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0455%252F20020455%252Finterior_dashboard-1774715140056.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0455/20020455/interior_dashboard-1774715140056.jpg saved to cache
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c66aed0>
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0455%252F20020455%252Finstrument_cluster-1774275378214.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0455/20020455/instrument_cluster-1774275378214.jpg saved to cache
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0fa310>
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0455%252F20020455%252Finterior_boot-1774715158207.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0455/20020455/interior_boot-1774715158207.jpg saved to cache
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cbcec50>
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0455%252F20020455%252Finterior_rear_seats-1774275363028.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0455/20020455/interior_rear_seats-1774275363028.jpg saved to cache
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8400%252F10468400%252Fexterior_rear_passenger-1774197213026.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8400/10468400/exterior_rear_passenger-1774197213026.jpg not downloaded yet
2026-03-29 20:13:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9abe7319-8e30-58d3-a351-4c67c0db68f5 with identifier: 20377618
2026-03-29 20:13:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9abe7319-8e30-58d3-a351-4c67c0db68f5 with identifier: 20377618
2026-03-29 20:13:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9abe7319-8e30-58d3-a351-4c67c0db68f5 with identifier: 20377618 to the API
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_rear_driver-1774694065070.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9abe7319-8e30-58d3-a351-4c67c0db68f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS24 XOK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20377618',
'listing': 'auction',
'location': 'Milton Keynes Milton Keynes',
'make': 'Kia',
'model': 'Stonic',
'odometer': 9493,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1768030,
'Height': 2905,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_front_driver-1774694109715.jpg',
'Width': 3873},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1919325,
'Height': 2968,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_rear_driver-1774694065070.jpg',
'Width': 3957},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1730434,
'Height': 2477,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_front_passenger-1774694086839.jpg',
'Width': 3302},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1374395,
'Height': 2440,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7618/20377618/exterior_rear_passenger-1774694074243.jpg',
'Width': 3253},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4718102,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7618/20377618/interior_front_seats-1774694682956.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2752036,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7618/20377618/interior_rear_seats-1774694693908.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3173894,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7618/20377618/interior_dashboard-1774694759870.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2419474,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7618/20377618/instrument_cluster-1774694783344.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3902351,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7618/20377618/interior_boot-1774694720617.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abe7319-8e30-58d3-a351-4c67c0db68f5/9abe7319-8e30-58d3-a351-4c67c0db68f5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1112687,
'Height': 1778,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7618/20377618/docs_service_history-1774694880093.jpg?ixlib=js-3.8.0&auto=format&s=c9cad1ef04d096f604b927e8d08dc8af',
'Width': 2392}],
'price': 16650,
'price_includes_vat': False,
'registration_date': '2024-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Kia Stonic GT-LINE S-A',
'transmission': 'automatic',
'trim': 'GT-LINE S-A',
'vin': 'KNADD817VRT957992',
'year': 2024}
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720377618%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [motorway.uk] INFO: Saving data for 20377618: {'created_time': 1774815239.1942, 'last_price_update_time': 1774815239.194215, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20377618') HTTP/1.1" 204 0
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5263%252F20465263%252Finterior_rear_seats-1774775970919.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5263/20465263/interior_rear_seats-1774775970919.jpg not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8400%252F10468400%252Finterior_front_seats-1774630411116.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8400/10468400/interior_front_seats-1774630411116.jpg not downloaded yet
2026-03-29 20:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d6de18a-54a0-510f-9318-0376c613b6ed with identifier: 20493132
2026-03-29 20:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d6de18a-54a0-510f-9318-0376c613b6ed with scrape type 1
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d6de18a-54a0-510f-9318-0376c613b6ed
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3132%252F20493132%252Fexterior_front_driver-1774788755085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_front_driver-1774788755085.jpg not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5263%252F20465263%252Finterior_dashboard-1774776085669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5263/20465263/interior_dashboard-1774776085669.jpg not downloaded yet
2026-03-29 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1728&page=48&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8400%252F10468400%252Finterior_rear_seats-1774198381026.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8400/10468400/interior_rear_seats-1774198381026.jpg not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3132%252F20493132%252Fexterior_rear_driver-1774788730487.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_rear_driver-1774788730487.jpg not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5263%252F20465263%252Finterior_boot-1774776016307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5263/20465263/interior_boot-1774776016307.jpg not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8400%252F10468400%252Finterior_dashboard-1774198576932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8400/10468400/interior_dashboard-1774198576932.jpg not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3132%252F20493132%252Fexterior_front_passenger-1774788746390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_front_passenger-1774788746390.jpg not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5263%252F20465263%252Fdocs_service_history-1774776543516.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3e4cb6f5de24816ad3aed5ec1f032e09%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5263/20465263/docs_service_history-1774776543516.jpg?ixlib=js-3.8.0&auto=format&s=3e4cb6f5de24816ad3aed5ec1f032e09 not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8400%252F10468400%252Finterior_boot-1774198662165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8400/10468400/interior_boot-1774198662165.jpg not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3132%252F20493132%252Fexterior_rear_passenger-1774788734996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_rear_passenger-1774788734996.jpg not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5263%252F20465263%252Fdocs_service_history-1774776636580.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1b8e1d4ec3054809d693db345f86e1a8%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5263/20465263/docs_service_history-1774776636580.jpg?ixlib=js-3.8.0&auto=format&s=1b8e1d4ec3054809d693db345f86e1a8 not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8400%252F10468400%252Fdocs_service_history-1774198842305.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D56bbd0df3c3c660436f0bb847c5a732d%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8400/10468400/docs_service_history-1774198842305.jpg?ixlib=js-3.8.0&auto=format&s=56bbd0df3c3c660436f0bb847c5a732d not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3132%252F20493132%252Finterior_front_seats-1774793868340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3132/20493132/interior_front_seats-1774793868340.jpg not downloaded yet
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20457474
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 7788719
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20496394
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20492076
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 19211859
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719211859%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [motorway.uk] INFO: Scrape type for 19211859: 1
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8400%252F10468400%252Fdocs_service_history-1774199173752.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df0a2a2cca4f50ff52309a141e87718ea%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8400/10468400/docs_service_history-1774199173752.jpg?ixlib=js-3.8.0&auto=format&s=f0a2a2cca4f50ff52309a141e87718ea not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3132%252F20493132%252Finterior_rear_seats-1774789833095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3132/20493132/interior_rear_seats-1774789833095.jpg not downloaded yet
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 19957337
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20446457
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720446457%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [motorway.uk] INFO: Scrape type for 20446457: 1
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3132%252F20493132%252Finterior_dashboard-1774792236984.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3132/20493132/interior_dashboard-1774792236984.jpg not downloaded yet
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 18634070
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718634070%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [motorway.uk] INFO: Scrape type for 18634070: 1
2026-03-29 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5932/20485932/exterior_front_passenger-1774696669084.jpg> (referer: None)
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3132%252F20493132%252Finterior_boot-1774789621494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3132/20493132/interior_boot-1774789621494.jpg not downloaded yet
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20245213
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 10528347
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20486592
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20469845
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 13914989
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 19622244
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719622244%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [motorway.uk] INFO: Scrape type for 19622244: 2
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3132%252F20493132%252Fdocs_service_history-1774790416243.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1d5ae5f6a1e79adb350f9d934a228f88%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3132/20493132/docs_service_history-1774790416243.jpg?ixlib=js-3.8.0&auto=format&s=1d5ae5f6a1e79adb350f9d934a228f88 not downloaded yet
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20450720
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 19849878
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719849878%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [motorway.uk] INFO: Scrape type for 19849878: 1
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3132%252F20493132%252Fdocs_service_history-1774790744831.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7d75913bd2c01946aa08781a1c0b3db7%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3132/20493132/docs_service_history-1774790744831.jpg?ixlib=js-3.8.0&auto=format&s=7d75913bd2c01946aa08781a1c0b3db7 not downloaded yet
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20408794
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20238739
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720238739%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [motorway.uk] INFO: Scrape type for 20238739: 1
2026-03-29 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0455/20020455/exterior_front_driver-1774714922441.jpg> (referer: None)
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 19824492
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719824492%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [motorway.uk] INFO: Scrape type for 19824492: 2
2026-03-29 20:13:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0455/20020455/exterior_rear_driver-1774714935160.jpg> (referer: None)
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20486445
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 19470954
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20407532
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20469143
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 20452615
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 15157797
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715157797%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [motorway.uk] INFO: Scrape type for 15157797: 2
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f442b90>
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165c371d-4f61-5bf7-a1f7-f0e6e4074650/165c371d-4f61-5bf7-a1f7-f0e6e4074650_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20485932%252Fexterior_front_passenger-1774696669084.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20485932/exterior_front_passenger-1774696669084.jpg saved to cache
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 165c371d-4f61-5bf7-a1f7-f0e6e4074650
2026-03-29 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_rear_driver-1774775360475.jpg> (referer: None)
2026-03-29 20:13:59 [motorway.uk] INFO: Found listing with ID: 10964475
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710964475%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [motorway.uk] INFO: Scrape type for 10964475: 1
2026-03-29 20:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_rear_passenger-1774775374955.jpg> (referer: None)
2026-03-29 20:14:00 [motorway.uk] INFO: Found listing with ID: 20476933
2026-03-29 20:14:00 [motorway.uk] INFO: Found listing with ID: 20393132
2026-03-29 20:14:00 [motorway.uk] INFO: Found listing with ID: 20348231
2026-03-29 20:14:00 [motorway.uk] INFO: Found listing with ID: 20380472
2026-03-29 20:14:00 [motorway.uk] INFO: Found listing with ID: 17242412
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717242412%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [motorway.uk] INFO: Scrape type for 17242412: 1
2026-03-29 20:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0455/20020455/exterior_front_passenger-1774714949097.jpg> (referer: None)
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dab61d0>
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0455%252F20020455%252Fexterior_front_driver-1774714922441.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0455/20020455/exterior_front_driver-1774714922441.jpg saved to cache
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c7410>
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0455%252F20020455%252Fexterior_rear_driver-1774714935160.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0455/20020455/exterior_rear_driver-1774714935160.jpg saved to cache
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91
2026-03-29 20:14:00 [motorway.uk] INFO: Found listing with ID: 10152059
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710152059%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [motorway.uk] INFO: Scrape type for 10152059: 1
2026-03-29 20:14:00 [motorway.uk] INFO: Found listing with ID: 20348457
2026-03-29 20:14:00 [motorway.uk] INFO: Found listing with ID: 20393265
2026-03-29 20:14:00 [motorway.uk] INFO: Found listing with ID: 19488823
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719488823%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [motorway.uk] INFO: Scrape type for 19488823: 1
2026-03-29 20:14:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:00 [motorway.uk] INFO: Found listing with ID: 19580167
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d47f5d0>
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5263%252F20465263%252Fexterior_rear_driver-1774775360475.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_rear_driver-1774775360475.jpg saved to cache
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d4064e2-a7b1-5519-aacc-b721c07abb14
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d886950>
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5263%252F20465263%252Fexterior_rear_passenger-1774775374955.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_rear_passenger-1774775374955.jpg saved to cache
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d4064e2-a7b1-5519-aacc-b721c07abb14
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6faf90>
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0455%252F20020455%252Fexterior_front_passenger-1774714949097.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0455/20020455/exterior_front_passenger-1774714949097.jpg saved to cache
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91
2026-03-29 20:14:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2311ff7a-668f-50d4-8a1e-c59ca07eac91, skipping ID generation
2026-03-29 20:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91 with scrape type 1
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2311ff7a-668f-50d4-8a1e-c59ca07eac91 sending to next pipeline
2026-03-29 20:14:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2311ff7a-668f-50d4-8a1e-c59ca07eac91, identifier: 20020455
2026-03-29 20:14:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2311ff7a-668f-50d4-8a1e-c59ca07eac91 with identifier: 20020455
2026-03-29 20:14:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2311ff7a-668f-50d4-8a1e-c59ca07eac91 with identifier: 20020455
2026-03-29 20:14:01 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2311ff7a-668f-50d4-8a1e-c59ca07eac91 with identifier: 20020455 to the API
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0455/20020455/exterior_front_passenger-1774714949097.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2311ff7a-668f-50d4-8a1e-c59ca07eac91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WK62 ZJZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20020455',
'listing': 'auction',
'location': 'Cornwall Saint Ives',
'make': 'Suzuki',
'model': 'Grand Vitara',
'odometer': 48500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2420372,
'Height': 2690,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0455/20020455/exterior_front_driver-1774714922441.jpg',
'Width': 3587},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1839183,
'Height': 2418,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0455/20020455/exterior_rear_driver-1774714935160.jpg',
'Width': 3224},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1984741,
'Height': 2544,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0455/20020455/exterior_front_passenger-1774714949097.jpg',
'Width': 3392},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2067468,
'Height': 2516,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0455/20020455/exterior_rear_passenger-1774714965098.jpg',
'Width': 3355},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4354815,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0455/20020455/interior_front_seats-1774275294579.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3602348,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0455/20020455/interior_rear_seats-1774275363028.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2312650,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0455/20020455/interior_dashboard-1774715140056.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2538674,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0455/20020455/instrument_cluster-1774275378214.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2920045,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0455/20020455/interior_boot-1774715158207.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2311ff7a-668f-50d4-8a1e-c59ca07eac91/2311ff7a-668f-50d4-8a1e-c59ca07eac91_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620190,
'Height': 1894,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0455/20020455/docs_service_history-1774276039461.jpg?ixlib=js-3.8.0&auto=format&s=0d56cda39d6b807c06c10ccfca65cbfa',
'Width': 3715}],
'price': 4734,
'price_includes_vat': False,
'registration_date': '2012-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Suzuki Grand Vitara SZ4',
'transmission': 'manual',
'trim': 'SZ4',
'vin': 'JSAJTA74V00630736',
'year': 2012}
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720020455%27 HTTP/1.1" 200 None
2026-03-29 20:14:01 [motorway.uk] INFO: Saving data for 20020455: {'created_time': 1774815241.563152, 'last_price_update_time': 1774815241.563163, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20020455') HTTP/1.1" 204 0
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20499574.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8400/10468400/exterior_front_passenger-1774197287298.jpg> (referer: None)
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_front_driver-1774788755085.jpg> (referer: None)
2026-03-29 20:14:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8400/10468400/exterior_rear_passenger-1774197213026.jpg> (referer: None)
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8400/10468400/exterior_front_driver-1774629755797.jpg> (referer: None)
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8400/10468400/exterior_rear_driver-1774630362689.jpg> (referer: None)
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_front_passenger-1774775397942.jpg> (referer: None)
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5263/20465263/interior_rear_seats-1774775970919.jpg> (referer: None)
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3132/20493132/interior_dashboard-1774792236984.jpg> (referer: None)
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5263/20465263/interior_front_seats-1774775953957.jpg> (referer: None)
2026-03-29 20:14:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c617631-d477-53f0-9013-04dac1b260d1 with identifier: 20499574
2026-03-29 20:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c617631-d477-53f0-9013-04dac1b260d1 with scrape type 1
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c617631-d477-53f0-9013-04dac1b260d1
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9574%252F20499574%252Fexterior_front_driver-1774773142762.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9574/20499574/exterior_front_driver-1774773142762.jpeg not downloaded yet
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9574%252F20499574%252Fexterior_rear_driver-1774773233639.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9574/20499574/exterior_rear_driver-1774773233639.jpeg not downloaded yet
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9574%252F20499574%252F20499574-exterior_front_passenger-modified-1774775787070.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9574/20499574/20499574-exterior_front_passenger-modified-1774775787070.jpeg not downloaded yet
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f441950>
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8400%252F10468400%252Fexterior_front_passenger-1774197287298.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8400/10468400/exterior_front_passenger-1774197287298.jpg saved to cache
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c785f10>
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3132%252F20493132%252Fexterior_front_driver-1774788755085.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_front_driver-1774788755085.jpg saved to cache
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d6de18a-54a0-510f-9318-0376c613b6ed
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c504110>
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8400%252F10468400%252Fexterior_rear_passenger-1774197213026.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8400/10468400/exterior_rear_passenger-1774197213026.jpg saved to cache
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c5051d0>
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8400%252F10468400%252Fexterior_front_driver-1774629755797.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8400/10468400/exterior_front_driver-1774629755797.jpg saved to cache
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0be490>
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8400%252F10468400%252Fexterior_rear_driver-1774630362689.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8400/10468400/exterior_rear_driver-1774630362689.jpg saved to cache
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f53ef50>
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5263%252F20465263%252Fexterior_front_passenger-1774775397942.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_front_passenger-1774775397942.jpg saved to cache
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d4064e2-a7b1-5519-aacc-b721c07abb14
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9574%252F20499574%252Fexterior_rear_passenger-1774773217421.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9574/20499574/exterior_rear_passenger-1774773217421.jpeg not downloaded yet
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c504250>
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5263%252F20465263%252Finterior_rear_seats-1774775970919.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5263/20465263/interior_rear_seats-1774775970919.jpg saved to cache
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d4064e2-a7b1-5519-aacc-b721c07abb14
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d270510>
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3132%252F20493132%252Finterior_dashboard-1774792236984.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3132/20493132/interior_dashboard-1774792236984.jpg saved to cache
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d6de18a-54a0-510f-9318-0376c613b6ed
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5afb50>
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5263%252F20465263%252Finterior_front_seats-1774775953957.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5263/20465263/interior_front_seats-1774775953957.jpg saved to cache
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d4064e2-a7b1-5519-aacc-b721c07abb14
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9574%252F20499574%252F20499574-interior_front_seats-modified-1774775774630.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9574/20499574/20499574-interior_front_seats-modified-1774775774630.jpeg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9574%252F20499574%252Finterior_rear_seats-1774773279941.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9574/20499574/interior_rear_seats-1774773279941.jpeg not downloaded yet
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20296573.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20238739.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9574%252F20499574%252F20499574-interior_dashboard-modified-1774775764898.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9574/20499574/20499574-interior_dashboard-modified-1774775764898.jpeg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9574%252F20499574%252Finterior_boot-1774773320947.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9574/20499574/interior_boot-1774773320947.jpeg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9574%252F20499574%252Fdocs_service_history-1774773644445.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da8272c3a669f1569d48690c18f835283%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9574/20499574/docs_service_history-1774773644445.jpeg?ixlib=js-3.8.0&auto=format&s=a8272c3a669f1569d48690c18f835283 not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9574%252F20499574%252Fwheels_front_driver-1774773364969.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9574/20499574/wheels_front_driver-1774773364969.jpeg not downloaded yet
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3132/20493132/docs_service_history-1774790744831.jpg?ixlib=js-3.8.0&auto=format&s=7d75913bd2c01946aa08781a1c0b3db7> (referer: None)
2026-03-29 20:14:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 484fe803-6f2f-5ca0-aa2c-8d0e42308b56 with identifier: 20296573
2026-03-29 20:14:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56 with scrape type 1
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6573%252F20296573%252Fexterior_front_driver-1774009497099.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_front_driver-1774009497099.jpg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6573%252F20296573%252Fexterior_rear_driver-1774009501110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_rear_driver-1774009501110.jpg not downloaded yet
2026-03-29 20:14:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04ca21ce-af69-56f1-985c-36a731e49223 with identifier: 20238739
2026-03-29 20:14:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04ca21ce-af69-56f1-985c-36a731e49223 with scrape type 1
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04ca21ce-af69-56f1-985c-36a731e49223
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8739%252F20238739%252Fexterior_front_driver-1774275632267.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_front_driver-1774275632267.jpg not downloaded yet
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3132/20493132/docs_service_history-1774790416243.jpg?ixlib=js-3.8.0&auto=format&s=1d5ae5f6a1e79adb350f9d934a228f88> (referer: None)
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6573%252F20296573%252Fexterior_front_passenger-1774009502248.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_front_passenger-1774009502248.jpg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8739%252F20238739%252Fexterior_rear_driver-1774275634031.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_rear_driver-1774275634031.jpg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6573%252F20296573%252Fexterior_rear_passenger-1774009498175.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_rear_passenger-1774009498175.jpg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8739%252F20238739%252Fexterior_front_passenger-1774275626435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_front_passenger-1774275626435.jpg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6573%252F20296573%252Finterior_front_seats-1774011549403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6573/20296573/interior_front_seats-1774011549403.jpg not downloaded yet
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb5d910>
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3132%252F20493132%252Fdocs_service_history-1774790744831.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7d75913bd2c01946aa08781a1c0b3db7') HTTP/1.1" 204 0
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3132/20493132/docs_service_history-1774790744831.jpg?ixlib=js-3.8.0&auto=format&s=7d75913bd2c01946aa08781a1c0b3db7 saved to cache
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d6de18a-54a0-510f-9318-0376c613b6ed
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8739%252F20238739%252Fexterior_rear_passenger-1774275622018.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_rear_passenger-1774275622018.jpg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6573%252F20296573%252Finterior_rear_seats-1774011437834.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6573/20296573/interior_rear_seats-1774011437834.jpg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8739%252F20238739%252Finterior_front_seats-1774277101778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8739/20238739/interior_front_seats-1774277101778.jpg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6573%252F20296573%252Finterior_dashboard-1774011450105.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6573/20296573/interior_dashboard-1774011450105.jpg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8739%252F20238739%252Finterior_rear_seats-1774278892416.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8739/20238739/interior_rear_seats-1774278892416.jpg not downloaded yet
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f30e850>
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3132%252F20493132%252Fdocs_service_history-1774790416243.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1d5ae5f6a1e79adb350f9d934a228f88') HTTP/1.1" 204 0
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3132/20493132/docs_service_history-1774790416243.jpg?ixlib=js-3.8.0&auto=format&s=1d5ae5f6a1e79adb350f9d934a228f88 saved to cache
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d6de18a-54a0-510f-9318-0376c613b6ed
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6573%252F20296573%252Finstrument_cluster-1774691665409.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6573/20296573/instrument_cluster-1774691665409.jpg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8739%252F20238739%252Finterior_dashboard-1774277116273.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8739/20238739/interior_dashboard-1774277116273.jpg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6573%252F20296573%252Finterior_boot-1774011440302.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6573/20296573/interior_boot-1774011440302.jpg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8739%252F20238739%252Finstrument_cluster-1774276371516.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8739/20238739/instrument_cluster-1774276371516.jpg not downloaded yet
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_front_driver-1774275632267.jpg> (referer: None)
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6573%252F20296573%252Fdocs_service_history-1774012483622.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D31b50a438ce6e77b7a845c5572aa90ad%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6573/20296573/docs_service_history-1774012483622.jpg?ixlib=js-3.8.0&auto=format&s=31b50a438ce6e77b7a845c5572aa90ad not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8739%252F20238739%252Finterior_boot-1774277053318.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8739/20238739/interior_boot-1774277053318.jpg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8739%252F20238739%252Fdocs_service_history-1774278978699.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcb013d3fb1f0134dd567ac1d8dc5964a%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8739/20238739/docs_service_history-1774278978699.jpg?ixlib=js-3.8.0&auto=format&s=cb013d3fb1f0134dd567ac1d8dc5964a not downloaded yet
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9574/20499574/wheels_front_driver-1774773364969.jpeg> (referer: None)
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9574/20499574/exterior_front_driver-1774773142762.jpeg> (referer: None)
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9574/20499574/exterior_rear_passenger-1774773217421.jpeg> (referer: None)
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9574/20499574/exterior_rear_driver-1774773233639.jpeg> (referer: None)
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9574/20499574/20499574-exterior_front_passenger-modified-1774775787070.jpeg> (referer: None)
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9574/20499574/20499574-interior_front_seats-modified-1774775774630.jpeg> (referer: None)
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6573/20296573/interior_boot-1774011440302.jpg> (referer: None)
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6e8e10>
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8739%252F20238739%252Fexterior_front_driver-1774275632267.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_front_driver-1774275632267.jpg saved to cache
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04ca21ce-af69-56f1-985c-36a731e49223
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc3f9d0>
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9574%252F20499574%252Fwheels_front_driver-1774773364969.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9574/20499574/wheels_front_driver-1774773364969.jpeg saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c617631-d477-53f0-9013-04dac1b260d1
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c90d910>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9574%252F20499574%252Fexterior_front_driver-1774773142762.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9574/20499574/exterior_front_driver-1774773142762.jpeg saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c617631-d477-53f0-9013-04dac1b260d1
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6474d0>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9574%252F20499574%252Fexterior_rear_passenger-1774773217421.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9574/20499574/exterior_rear_passenger-1774773217421.jpeg saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c617631-d477-53f0-9013-04dac1b260d1
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c90dc50>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9574%252F20499574%252Fexterior_rear_driver-1774773233639.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9574/20499574/exterior_rear_driver-1774773233639.jpeg saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c617631-d477-53f0-9013-04dac1b260d1
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c784310>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9574%252F20499574%252F20499574-exterior_front_passenger-modified-1774775787070.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9574/20499574/20499574-exterior_front_passenger-modified-1774775787070.jpeg saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c617631-d477-53f0-9013-04dac1b260d1
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d556490>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9574%252F20499574%252F20499574-interior_front_seats-modified-1774775774630.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9574/20499574/20499574-interior_front_seats-modified-1774775774630.jpeg saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c617631-d477-53f0-9013-04dac1b260d1
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da62f50>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6573%252F20296573%252Finterior_boot-1774011440302.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6573/20296573/interior_boot-1774011440302.jpg saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56
2026-03-29 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8739/20238739/docs_service_history-1774278978699.jpg?ixlib=js-3.8.0&auto=format&s=cb013d3fb1f0134dd567ac1d8dc5964a> (referer: None)
2026-03-29 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8739/20238739/interior_boot-1774277053318.jpg> (referer: None)
2026-03-29 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6573/20296573/instrument_cluster-1774691665409.jpg> (referer: None)
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x0f\x00\x00'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xb8\x0b\x00\x00'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy S25\x00'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 178 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 186 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 194 - value: b'S931BXXS8BZB5\x00'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 208 - value: b'2026:03:23 15:14:49\x00'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe4\x00\x00\x00'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x02\x00\x00\x00'
2026-03-29 20:14:04 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x00\x03\x00\xc5\x82+\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xef\xe7\x01\x000R*\x00\x00\x00\x00\x00'
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f46e010>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8739%252F20238739%252Fdocs_service_history-1774278978699.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcb013d3fb1f0134dd567ac1d8dc5964a') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8739/20238739/docs_service_history-1774278978699.jpg?ixlib=js-3.8.0&auto=format&s=cb013d3fb1f0134dd567ac1d8dc5964a saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04ca21ce-af69-56f1-985c-36a731e49223
2026-03-29 20:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6573/20296573/docs_service_history-1774012483622.jpg?ixlib=js-3.8.0&auto=format&s=31b50a438ce6e77b7a845c5572aa90ad> (referer: None)
2026-03-29 20:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10152059.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6573/20296573/interior_rear_seats-1774011437834.jpg> (referer: None)
2026-03-29 20:14:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d595e90>
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8739%252F20238739%252Finterior_boot-1774277053318.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8739/20238739/interior_boot-1774277053318.jpg saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04ca21ce-af69-56f1-985c-36a731e49223
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c4c50d0>
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6573%252F20296573%252Finstrument_cluster-1774691665409.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6573/20296573/instrument_cluster-1774691665409.jpg saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56
2026-03-29 20:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6573/20296573/interior_dashboard-1774011450105.jpg> (referer: None)
2026-03-29 20:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17242412.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1764&page=49&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cee6cd0>
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6573%252F20296573%252Fdocs_service_history-1774012483622.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D31b50a438ce6e77b7a845c5572aa90ad') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6573/20296573/docs_service_history-1774012483622.jpg?ixlib=js-3.8.0&auto=format&s=31b50a438ce6e77b7a845c5572aa90ad saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56
2026-03-29 20:14:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05 with identifier: 10152059
2026-03-29 20:14:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05 with scrape type 1
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2059%252F10152059%252Fexterior_front_driver-1774690263525.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_front_driver-1774690263525.jpg not downloaded yet
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daf3a50>
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6573%252F20296573%252Finterior_rear_seats-1774011437834.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6573/20296573/interior_rear_seats-1774011437834.jpg saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2059%252F10152059%252Fexterior_rear_driver-1774690259587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_rear_driver-1774690259587.jpg not downloaded yet
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d526d10>
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6573%252F20296573%252Finterior_dashboard-1774011450105.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6573/20296573/interior_dashboard-1774011450105.jpg saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56
2026-03-29 20:14:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd2000a4-db25-557c-ad30-4f556614595b with identifier: 17242412
2026-03-29 20:14:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd2000a4-db25-557c-ad30-4f556614595b with scrape type 1
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd2000a4-db25-557c-ad30-4f556614595b
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2412%252F17242412%252Fexterior_front_driver-1772125546533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_front_driver-1772125546533.jpg not downloaded yet
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 8578317
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278578317%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [motorway.uk] INFO: Scrape type for 8578317: 1
2026-03-29 20:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6573/20296573/interior_front_seats-1774011549403.jpg> (referer: None)
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2059%252F10152059%252Fexterior_front_passenger-1774690300956.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_front_passenger-1774690300956.jpg not downloaded yet
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2412%252F17242412%252Fexterior_rear_driver-1772125601986.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_rear_driver-1772125601986.jpg not downloaded yet
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 19824079
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 19829498
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20487631
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20419362
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720419362%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [motorway.uk] INFO: Scrape type for 20419362: 1
2026-03-29 20:14:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_rear_passenger-1774009498175.jpg> (referer: None)
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2059%252F10152059%252Fexterior_rear_passenger-1774690253942.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_rear_passenger-1774690253942.jpg not downloaded yet
2026-03-29 20:14:05 [scrapy.extensions.logstats] INFO: Crawled 386 pages (at 36 pages/min), scraped 187 items (at 24 items/min)
2026-03-29 20:14:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 302MiB
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2412%252F17242412%252Fexterior_front_passenger-1772125565718.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_front_passenger-1772125565718.jpg not downloaded yet
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20488089
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 19636358
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20488455
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20418259
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20381652
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 2896184
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20043341
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720043341%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [motorway.uk] INFO: Scrape type for 20043341: 1
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2059%252F10152059%252Finterior_front_seats-1774690882315.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2059/10152059/interior_front_seats-1774690882315.jpg not downloaded yet
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2412%252F17242412%252Fexterior_rear_passenger-1772125587502.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_rear_passenger-1772125587502.jpg not downloaded yet
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 19364610
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 17969883
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 18144645
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718144645%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [motorway.uk] INFO: Scrape type for 18144645: 1
2026-03-29 20:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_front_passenger-1774009502248.jpg> (referer: None)
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2059%252F10152059%252Finterior_rear_seats-1774690889230.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2059/10152059/interior_rear_seats-1774690889230.jpg not downloaded yet
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2412%252F17242412%252Finterior_front_seats-1772125398212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2412/17242412/interior_front_seats-1772125398212.jpg not downloaded yet
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 18778922
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 19235717
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 19262827
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 19938992
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20450000
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20501873
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720501873%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [motorway.uk] INFO: Scrape type for 20501873: 1
2026-03-29 20:14:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d59cdd0>
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6573%252F20296573%252Finterior_front_seats-1774011549403.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6573/20296573/interior_front_seats-1774011549403.jpg saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2059%252F10152059%252Finterior_dashboard-1774690924883.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2059/10152059/interior_dashboard-1774690924883.jpg not downloaded yet
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2412%252F17242412%252Finterior_rear_seats-1772125452903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2412/17242412/interior_rear_seats-1772125452903.jpg not downloaded yet
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20412901
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20388002
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20143003
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20488215
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 17070613
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 19820283
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719820283%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [motorway.uk] INFO: Scrape type for 19820283: 1
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb3c750>
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6573%252F20296573%252Fexterior_rear_passenger-1774009498175.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_rear_passenger-1774009498175.jpg saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2059%252F10152059%252Finstrument_cluster-1774714854851.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2059/10152059/instrument_cluster-1774714854851.jpg not downloaded yet
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2412%252F17242412%252Finterior_dashboard-1772125854922.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2412/17242412/interior_dashboard-1772125854922.jpg not downloaded yet
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20452595
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 19130680
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 20491315
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 18265722
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 18293404
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718293404%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [motorway.uk] INFO: Scrape type for 18293404: 1
2026-03-29 20:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8739/20238739/interior_dashboard-1774277116273.jpg> (referer: None)
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2059%252F10152059%252Finterior_boot-1774690885713.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2059/10152059/interior_boot-1774690885713.jpg not downloaded yet
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c797650>
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6573%252F20296573%252Fexterior_front_passenger-1774009502248.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_front_passenger-1774009502248.jpg saved to cache
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2412%252F17242412%252Finterior_boot-1772384603744.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2412/17242412/interior_boot-1772384603744.jpg not downloaded yet
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 5296288
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275296288%27 HTTP/1.1" 200 None
2026-03-29 20:14:06 [motorway.uk] INFO: Scrape type for 5296288: 1
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2059%252F10152059%252Fdocs_service_history-1774692744135.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbd632658dd61603c6a26d834c505695f%27 HTTP/1.1" 200 None
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2059/10152059/docs_service_history-1774692744135.jpg?ixlib=js-3.8.0&auto=format&s=bd632658dd61603c6a26d834c505695f not downloaded yet
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2412%252F17242412%252F17242412-damage_missing_trims-modified-1772444097823.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2412/17242412/17242412-damage_missing_trims-modified-1772444097823.jpeg not downloaded yet
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 20200708
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720200708%27 HTTP/1.1" 200 None
2026-03-29 20:14:06 [motorway.uk] INFO: Scrape type for 20200708: 1
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8739/20238739/instrument_cluster-1774276371516.jpg> (referer: None)
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_front_passenger-1774690300956.jpg> (referer: None)
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2412%252F17242412%252Fwheels_front_driver-1772125611110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2412/17242412/wheels_front_driver-1772125611110.jpg not downloaded yet
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 20488052
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488052%27 HTTP/1.1" 200 None
2026-03-29 20:14:06 [motorway.uk] INFO: Scrape type for 20488052: 1
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb3eb10>
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8739%252F20238739%252Finterior_dashboard-1774277116273.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8739/20238739/interior_dashboard-1774277116273.jpg saved to cache
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 04ca21ce-af69-56f1-985c-36a731e49223
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 20489099
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_rear_driver-1774275634031.jpg> (referer: None)
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8a8b50>
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8739%252F20238739%252Finstrument_cluster-1774276371516.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8739/20238739/instrument_cluster-1774276371516.jpg saved to cache
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04ca21ce-af69-56f1-985c-36a731e49223
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f30ed10>
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2059%252F10152059%252Fexterior_front_passenger-1774690300956.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_front_passenger-1774690300956.jpg saved to cache
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_front_passenger-1774275626435.jpg> (referer: None)
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15157797.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_rear_passenger-1774275622018.jpg> (referer: None)
2026-03-29 20:14:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca65c10>
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8739%252F20238739%252Fexterior_rear_driver-1774275634031.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_rear_driver-1774275634031.jpg saved to cache
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04ca21ce-af69-56f1-985c-36a731e49223
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8739/20238739/interior_rear_seats-1774278892416.jpg> (referer: None)
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2059/10152059/instrument_cluster-1774714854851.jpg> (referer: None)
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8739/20238739/interior_front_seats-1774277101778.jpg> (referer: None)
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2059/10152059/docs_service_history-1774692744135.jpg?ixlib=js-3.8.0&auto=format&s=bd632658dd61603c6a26d834c505695f> (referer: None)
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f48a750>
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8739%252F20238739%252Fexterior_front_passenger-1774275626435.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_front_passenger-1774275626435.jpg saved to cache
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04ca21ce-af69-56f1-985c-36a731e49223
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19488823.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19849878.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57cd2390-e096-58a6-a0f4-93c611ace816 with identifier: 15157797
2026-03-29 20:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57cd2390-e096-58a6-a0f4-93c611ace816 with scrape type 2
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57cd2390-e096-58a6-a0f4-93c611ace816 with scrape type 2
2026-03-29 20:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 57cd2390-e096-58a6-a0f4-93c611ace816, identifier: 15157797
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f645f90>
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8739%252F20238739%252Fexterior_rear_passenger-1774275622018.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_rear_passenger-1774275622018.jpg saved to cache
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04ca21ce-af69-56f1-985c-36a731e49223
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de232d0>
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8739%252F20238739%252Finterior_rear_seats-1774278892416.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8739/20238739/interior_rear_seats-1774278892416.jpg saved to cache
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04ca21ce-af69-56f1-985c-36a731e49223
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c918a10>
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2059%252F10152059%252Finstrument_cluster-1774714854851.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2059/10152059/instrument_cluster-1774714854851.jpg saved to cache
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce32510>
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8739%252F20238739%252Finterior_front_seats-1774277101778.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8739/20238739/interior_front_seats-1774277101778.jpg saved to cache
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04ca21ce-af69-56f1-985c-36a731e49223
2026-03-29 20:14:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04ca21ce-af69-56f1-985c-36a731e49223, skipping ID generation
2026-03-29 20:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04ca21ce-af69-56f1-985c-36a731e49223 with scrape type 1
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04ca21ce-af69-56f1-985c-36a731e49223 sending to next pipeline
2026-03-29 20:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 04ca21ce-af69-56f1-985c-36a731e49223, identifier: 20238739
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f55c350>
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2059%252F10152059%252Fdocs_service_history-1774692744135.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbd632658dd61603c6a26d834c505695f') HTTP/1.1" 204 0
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2059/10152059/docs_service_history-1774692744135.jpg?ixlib=js-3.8.0&auto=format&s=bd632658dd61603c6a26d834c505695f saved to cache
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05
2026-03-29 20:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 57cd2390-e096-58a6-a0f4-93c611ace816 with identifier: 15157797
2026-03-29 20:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 57cd2390-e096-58a6-a0f4-93c611ace816 with identifier: 15157797
2026-03-29 20:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 57cd2390-e096-58a6-a0f4-93c611ace816 with identifier: 15157797 to the API
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15157797.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '57cd2390-e096-58a6-a0f4-93c611ace816',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'G10 OWX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15157797',
'listing': 'auction',
'location': 'Essex Canvey Island',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 79280,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 4140,
'price_includes_vat': False,
'registration_date': '2015-10-19',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque SE Tech ED4',
'transmission': 'manual',
'trim': 'Evoque SE Tech ED4',
'vin': 'SALVB2CN4GH097176',
'year': 2015}
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715157797%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [motorway.uk] INFO: Saving data for 15157797: {'auction_closing_time': 1774884600.0, 'created_time': 1774642893.246268, 'last_price_update_time': 1774815248.176553}
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15157797') HTTP/1.1" 204 0
2026-03-29 20:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 04ca21ce-af69-56f1-985c-36a731e49223 with identifier: 20238739
2026-03-29 20:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 04ca21ce-af69-56f1-985c-36a731e49223 with identifier: 20238739
2026-03-29 20:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 04ca21ce-af69-56f1-985c-36a731e49223 with identifier: 20238739 to the API
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8739/20238739/interior_front_seats-1774277101778.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '04ca21ce-af69-56f1-985c-36a731e49223',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK61 WNY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20238739',
'listing': 'auction',
'location': 'Kent Snodland',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 91393,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 586472,
'Height': 1610,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_front_driver-1774275632267.jpg',
'Width': 2147},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1118845,
'Height': 2240,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_rear_driver-1774275634031.jpg',
'Width': 2987},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1725666,
'Height': 2400,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_front_passenger-1774275626435.jpg',
'Width': 3200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1627635,
'Height': 2476,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8739/20238739/exterior_rear_passenger-1774275622018.jpg',
'Width': 3301},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2617138,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8739/20238739/interior_front_seats-1774277101778.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2367715,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8739/20238739/interior_rear_seats-1774278892416.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1772461,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8739/20238739/interior_dashboard-1774277116273.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1490502,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8739/20238739/instrument_cluster-1774276371516.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1947971,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8739/20238739/interior_boot-1774277053318.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04ca21ce-af69-56f1-985c-36a731e49223/04ca21ce-af69-56f1-985c-36a731e49223_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1048739,
'Height': 1998,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8739/20238739/docs_service_history-1774278978699.jpg?ixlib=js-3.8.0&auto=format&s=cb013d3fb1f0134dd567ac1d8dc5964a',
'Width': 2664}],
'price': 1430,
'price_includes_vat': False,
'registration_date': '2011-09-29',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Zetec S TDCI',
'transmission': 'manual',
'trim': 'Zetec S TDCI',
'vin': 'WF0GXXGAJGBL62431',
'year': 2011}
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720238739%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [motorway.uk] INFO: Saving data for 20238739: {'created_time': 1774815248.728946, 'last_price_update_time': 1774815248.728957, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20238739') HTTP/1.1" 204 0
2026-03-29 20:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aaa8302-e483-58d2-981c-e62c47996173 with identifier: 19488823
2026-03-29 20:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aaa8302-e483-58d2-981c-e62c47996173 with scrape type 1
2026-03-29 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5aaa8302-e483-58d2-981c-e62c47996173
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F19488823%252Fexterior_front_driver-1774625624520.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_front_driver-1774625624520.jpg not downloaded yet
2026-03-29 20:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747c08ea-7ed8-5299-847c-922d249da7cc with identifier: 19849878
2026-03-29 20:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747c08ea-7ed8-5299-847c-922d249da7cc with scrape type 1
2026-03-29 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 747c08ea-7ed8-5299-847c-922d249da7cc
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9878%252F19849878%252Fexterior_front_driver-1774697182756.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_front_driver-1774697182756.jpg not downloaded yet
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F19488823%252Fexterior_rear_driver-1774625626479.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_rear_driver-1774625626479.jpg not downloaded yet
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9878%252F19849878%252Fexterior_rear_driver-1774697185788.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_rear_driver-1774697185788.jpg not downloaded yet
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F19488823%252Fexterior_front_passenger-1774625624720.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_front_passenger-1774625624720.jpg not downloaded yet
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9878%252F19849878%252Fexterior_front_passenger-1774697177114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_front_passenger-1774697177114.jpg not downloaded yet
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F19488823%252Fexterior_rear_passenger-1774625625110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_rear_passenger-1774625625110.jpg not downloaded yet
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9878%252F19849878%252Fexterior_rear_passenger-1774697188304.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_rear_passenger-1774697188304.jpg not downloaded yet
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8823%252F19488823%252Finterior_front_seats-1774627227385.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8823/19488823/interior_front_seats-1774627227385.jpg not downloaded yet
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9878%252F19849878%252Finterior_front_seats-1774697633528.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9878/19849878/interior_front_seats-1774697633528.jpg not downloaded yet
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8823%252F19488823%252Finterior_rear_seats-1774627225631.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8823/19488823/interior_rear_seats-1774627225631.jpg not downloaded yet
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9878%252F19849878%252Finterior_rear_seats-1774697708832.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9878/19849878/interior_rear_seats-1774697708832.jpg not downloaded yet
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F19488823%252Finterior_dashboard-1774627240918.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/19488823/interior_dashboard-1774627240918.jpg not downloaded yet
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9878%252F19849878%252Finterior_dashboard-1774697800426.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9878/19849878/interior_dashboard-1774697800426.jpg not downloaded yet
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8578317.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19824492.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18144645.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8823%252F19488823%252Finterior_boot-1774629509160.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8823/19488823/interior_boot-1774629509160.jpg not downloaded yet
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9878%252F19849878%252Finterior_boot-1774697539796.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9878/19849878/interior_boot-1774697539796.jpg not downloaded yet
2026-03-29 20:14:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10964475.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2412/17242412/17242412-damage_missing_trims-modified-1772444097823.jpeg> (referer: None)
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8823%252F19488823%252Fdocs_service_history-1774627509119.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc42291515b37dbe14683dc61ff5f70b4%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8823/19488823/docs_service_history-1774627509119.jpg?ixlib=js-3.8.0&auto=format&s=c42291515b37dbe14683dc61ff5f70b4 not downloaded yet
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9878%252F19849878%252Fdocs_service_history-1774697937113.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddc2c428de5eee82d264139ab7e2421f5%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9878/19849878/docs_service_history-1774697937113.jpg?ixlib=js-3.8.0&auto=format&s=dc2c428de5eee82d264139ab7e2421f5 not downloaded yet
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8823%252F19488823%252Fdocs_service_history-1774627541289.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0d50a99f4b959e928ba86dc91806063a%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8823/19488823/docs_service_history-1774627541289.jpg?ixlib=js-3.8.0&auto=format&s=0d50a99f4b959e928ba86dc91806063a not downloaded yet
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9878%252F19849878%252Fdocs_service_history-1774697967054.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6977cd62d4587203ee078cda87e140f1%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9878/19849878/docs_service_history-1774697967054.jpg?ixlib=js-3.8.0&auto=format&s=6977cd62d4587203ee078cda87e140f1 not downloaded yet
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2412/17242412/wheels_front_driver-1772125611110.jpg> (referer: None)
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19622244.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49fe882d-f056-5ec7-ac6c-f9ce2ff616c1 with identifier: 8578317
2026-03-29 20:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49fe882d-f056-5ec7-ac6c-f9ce2ff616c1 with scrape type 1
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49fe882d-f056-5ec7-ac6c-f9ce2ff616c1
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8317%252F8578317%252Fexterior_front_driver-1772625958285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8317/8578317/exterior_front_driver-1772625958285.jpg already downloaded
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8317%252F8578317%252Fexterior_rear_driver-1772626462204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8317/8578317/exterior_rear_driver-1772626462204.jpg already downloaded
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8317%252F8578317%252Fexterior_front_passenger-1772626515702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8317/8578317/exterior_front_passenger-1772626515702.jpg already downloaded
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8317%252F8578317%252Fexterior_rear_passenger-1772626489870.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8317/8578317/exterior_rear_passenger-1772626489870.jpg already downloaded
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8317%252F8578317%252Finterior_front_seats-1772626613856.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8317/8578317/interior_front_seats-1772626613856.jpg already downloaded
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8317%252F8578317%252Finterior_rear_seats-1772626320577.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8317/8578317/interior_rear_seats-1772626320577.jpg already downloaded
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8317%252F8578317%252Finterior_dashboard-1772719692581.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8317/8578317/interior_dashboard-1772719692581.jpg already downloaded
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8317%252F8578317%252Finterior_boot-1772626297581.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8317/8578317/interior_boot-1772626297581.jpg already downloaded
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F8317%252F8578317%252Fdocs_service_history-1772641148711.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D74aa51270b0ec679b4ed808c0ed6c89a%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/8317/8578317/docs_service_history-1772641148711.jpg?ixlib=js-3.8.0&auto=format&s=74aa51270b0ec679b4ed808c0ed6c89a already downloaded
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8317%252F8578317%252Fdamage_scratches-1772625965919.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8317/8578317/damage_scratches-1772625965919.jpg already downloaded
2026-03-29 20:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 49fe882d-f056-5ec7-ac6c-f9ce2ff616c1, identifier: 8578317
2026-03-29 20:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8373b871-d46e-5d03-b4bb-5e543af2aa9d with identifier: 19824492
2026-03-29 20:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8373b871-d46e-5d03-b4bb-5e543af2aa9d with scrape type 2
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8373b871-d46e-5d03-b4bb-5e543af2aa9d with scrape type 2
2026-03-29 20:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8373b871-d46e-5d03-b4bb-5e543af2aa9d, identifier: 19824492
2026-03-29 20:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd084cca-2f4b-52f7-9ba7-5083bde7b724 with identifier: 18144645
2026-03-29 20:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd084cca-2f4b-52f7-9ba7-5083bde7b724 with scrape type 1
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd084cca-2f4b-52f7-9ba7-5083bde7b724
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4645%252F18144645%252Fexterior_front_driver-1774702192944.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_front_driver-1774702192944.jpg not downloaded yet
2026-03-29 20:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 49fe882d-f056-5ec7-ac6c-f9ce2ff616c1 with identifier: 8578317
2026-03-29 20:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 49fe882d-f056-5ec7-ac6c-f9ce2ff616c1 with identifier: 8578317
2026-03-29 20:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 49fe882d-f056-5ec7-ac6c-f9ce2ff616c1 with identifier: 8578317 to the API
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8578317.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.7L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '49fe882d-f056-5ec7-ac6c-f9ce2ff616c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'ML17 XLJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/8578317',
'listing': 'auction',
'location': 'Greater Manchester Wigan',
'make': 'Kia',
'model': 'Sportage',
'odometer': 84500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/8317/8578317/exterior_front_driver-1772625958285.jpg',
'https://motorway-photos-redacted.imgix.net/8317/8578317/exterior_rear_driver-1772626462204.jpg',
'https://motorway-photos-redacted.imgix.net/8317/8578317/exterior_front_passenger-1772626515702.jpg',
'https://motorway-photos-redacted.imgix.net/8317/8578317/exterior_rear_passenger-1772626489870.jpg',
'https://motorway-photos.imgix.net/8317/8578317/interior_front_seats-1772626613856.jpg',
'https://motorway-photos.imgix.net/8317/8578317/interior_rear_seats-1772626320577.jpg',
'https://motorway-photos-redacted.imgix.net/8317/8578317/interior_dashboard-1772719692581.jpg',
'https://motorway-photos.imgix.net/8317/8578317/interior_boot-1772626297581.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/8317/8578317/docs_service_history-1772641148711.jpg?ixlib=js-3.8.0&auto=format&s=74aa51270b0ec679b4ed808c0ed6c89a',
'https://motorway-photos.imgix.net/8317/8578317/damage_scratches-1772625965919.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c421f68-e8cf-5e48-aa0b-c7e7071a7d80/1c421f68-e8cf-5e48-aa0b-c7e7071a7d80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1218789,
'Height': 2291,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8317/8578317/exterior_front_driver-1772625958285.jpg',
'Width': 3054},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c421f68-e8cf-5e48-aa0b-c7e7071a7d80/1c421f68-e8cf-5e48-aa0b-c7e7071a7d80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1006912,
'Height': 2187,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8317/8578317/exterior_rear_driver-1772626462204.jpg',
'Width': 2916},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c421f68-e8cf-5e48-aa0b-c7e7071a7d80/1c421f68-e8cf-5e48-aa0b-c7e7071a7d80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1286816,
'Height': 2247,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8317/8578317/exterior_front_passenger-1772626515702.jpg',
'Width': 2996},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c421f68-e8cf-5e48-aa0b-c7e7071a7d80/1c421f68-e8cf-5e48-aa0b-c7e7071a7d80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1483931,
'Height': 2289,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8317/8578317/exterior_rear_passenger-1772626489870.jpg',
'Width': 3052},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c421f68-e8cf-5e48-aa0b-c7e7071a7d80/1c421f68-e8cf-5e48-aa0b-c7e7071a7d80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8660105,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8317/8578317/interior_front_seats-1772626613856.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c421f68-e8cf-5e48-aa0b-c7e7071a7d80/1c421f68-e8cf-5e48-aa0b-c7e7071a7d80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 10359824,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8317/8578317/interior_rear_seats-1772626320577.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c421f68-e8cf-5e48-aa0b-c7e7071a7d80/1c421f68-e8cf-5e48-aa0b-c7e7071a7d80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1276067,
'Height': 4080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8317/8578317/interior_dashboard-1772719692581.jpg',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c421f68-e8cf-5e48-aa0b-c7e7071a7d80/1c421f68-e8cf-5e48-aa0b-c7e7071a7d80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 9068437,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8317/8578317/interior_boot-1772626297581.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c421f68-e8cf-5e48-aa0b-c7e7071a7d80/1c421f68-e8cf-5e48-aa0b-c7e7071a7d80_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1234337,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/8317/8578317/docs_service_history-1772641148711.jpg?ixlib=js-3.8.0&auto=format&s=74aa51270b0ec679b4ed808c0ed6c89a',
'Width': 3000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c421f68-e8cf-5e48-aa0b-c7e7071a7d80/1c421f68-e8cf-5e48-aa0b-c7e7071a7d80_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8202358,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8317/8578317/damage_scratches-1772625965919.jpg',
'Width': 4080}],
'price': 4542,
'price_includes_vat': False,
'registration_date': '2017-04-07',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage 1 CRDI ISG',
'transmission': 'manual',
'trim': '1 CRDI ISG',
'vin': 'U5YPG815LHL255016',
'year': 2017}
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278578317%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [motorway.uk] INFO: Saving data for 8578317: {'created_time': 1774815250.147402, 'last_price_update_time': 1774815250.147414, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='8578317') HTTP/1.1" 204 0
2026-03-29 20:14:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8373b871-d46e-5d03-b4bb-5e543af2aa9d with identifier: 19824492
2026-03-29 20:14:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8373b871-d46e-5d03-b4bb-5e543af2aa9d with identifier: 19824492
2026-03-29 20:14:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8373b871-d46e-5d03-b4bb-5e543af2aa9d with identifier: 19824492 to the API
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19824492.json>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '8373b871-d46e-5d03-b4bb-5e543af2aa9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY23 ZSN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19824492',
'listing': 'auction',
'location': 'Edinburgh Edinburgh',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 22860,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 17425,
'price_includes_vat': False,
'registration_date': '2023-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai Tekna DiG-T MHEV CVT',
'transmission': 'automatic',
'trim': 'Tekna DiG-T MHEV CVT',
'vin': 'SJNTAAJ12U1249462',
'year': 2023}
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719824492%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [motorway.uk] INFO: Saving data for 19824492: {'auction_closing_time': 1774884600.0, 'created_time': 1774385032.971324, 'last_price_update_time': 1774815250.51202}
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19824492') HTTP/1.1" 204 0
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4645%252F18144645%252Fexterior_rear_driver-1774702112691.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_rear_driver-1774702112691.jpg not downloaded yet
2026-03-29 20:14:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8823/19488823/interior_boot-1774629509160.jpg> (referer: None)
2026-03-29 20:14:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b with identifier: 10964475
2026-03-29 20:14:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b with scrape type 1
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4475%252F10964475%252Fexterior_front_driver-1774711485762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_front_driver-1774711485762.jpg not downloaded yet
2026-03-29 20:14:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d272510>
2026-03-29 20:14:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2412%252F17242412%252F17242412-damage_missing_trims-modified-1772444097823.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2412/17242412/17242412-damage_missing_trims-modified-1772444097823.jpeg saved to cache
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd2000a4-db25-557c-ad30-4f556614595b
2026-03-29 20:14:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d3f0250>
2026-03-29 20:14:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2412%252F17242412%252Fwheels_front_driver-1772125611110.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2412/17242412/wheels_front_driver-1772125611110.jpg saved to cache
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd2000a4-db25-557c-ad30-4f556614595b
2026-03-29 20:14:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de5dbef1-cbd8-5878-8eac-753c7c119b8f with identifier: 19622244
2026-03-29 20:14:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de5dbef1-cbd8-5878-8eac-753c7c119b8f with scrape type 2
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de5dbef1-cbd8-5878-8eac-753c7c119b8f with scrape type 2
2026-03-29 20:14:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: de5dbef1-cbd8-5878-8eac-753c7c119b8f, identifier: 19622244
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4645%252F18144645%252Fexterior_front_passenger-1774702215577.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_front_passenger-1774702215577.jpg not downloaded yet
2026-03-29 20:14:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: de5dbef1-cbd8-5878-8eac-753c7c119b8f with identifier: 19622244
2026-03-29 20:14:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: de5dbef1-cbd8-5878-8eac-753c7c119b8f with identifier: 19622244
2026-03-29 20:14:11 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: de5dbef1-cbd8-5878-8eac-753c7c119b8f with identifier: 19622244 to the API
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19622244.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'de5dbef1-cbd8-5878-8eac-753c7c119b8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LJ04 LWJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19622244',
'listing': 'auction',
'location': 'Gwynedd Porthmadog',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 50600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 7282,
'price_includes_vat': False,
'registration_date': '2015-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A200 Sport CDI Auto',
'transmission': 'automatic',
'trim': 'A200 Sport CDI Auto',
'vin': 'WDD1760082V069387',
'year': 2015}
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719622244%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [motorway.uk] INFO: Saving data for 19622244: {'auction_closing_time': 1774884600.0, 'created_time': 1774728434.268754, 'last_price_update_time': 1774815251.310059}
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19622244') HTTP/1.1" 204 0
2026-03-29 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8823/19488823/interior_dashboard-1774627240918.jpg> (referer: None)
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4475%252F10964475%252Fexterior_rear_driver-1774711508806.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_rear_driver-1774711508806.jpg not downloaded yet
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4645%252F18144645%252Fexterior_rear_passenger-1774702090368.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_rear_passenger-1774702090368.jpg not downloaded yet
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c5690>
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8823%252F19488823%252Finterior_boot-1774629509160.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8823/19488823/interior_boot-1774629509160.jpg saved to cache
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5aaa8302-e483-58d2-981c-e62c47996173
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4475%252F10964475%252Fexterior_front_passenger-1774711541898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_front_passenger-1774711541898.jpg not downloaded yet
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4645%252F18144645%252Finterior_front_seats-1774702481392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4645/18144645/interior_front_seats-1774702481392.jpg not downloaded yet
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4475%252F10964475%252Fexterior_rear_passenger-1774711525015.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_rear_passenger-1774711525015.jpg not downloaded yet
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4645%252F18144645%252Finterior_rear_seats-1774702538713.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4645/18144645/interior_rear_seats-1774702538713.jpg not downloaded yet
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4475%252F10964475%252Finterior_front_seats-1774712211572.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4475/10964475/interior_front_seats-1774712211572.jpg not downloaded yet
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0ebc90>
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F19488823%252Finterior_dashboard-1774627240918.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/19488823/interior_dashboard-1774627240918.jpg saved to cache
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5aaa8302-e483-58d2-981c-e62c47996173
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4645%252F18144645%252Finterior_dashboard-1774702525911.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4645/18144645/interior_dashboard-1774702525911.jpg not downloaded yet
2026-03-29 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8823/19488823/docs_service_history-1774627541289.jpg?ixlib=js-3.8.0&auto=format&s=0d50a99f4b959e928ba86dc91806063a> (referer: None)
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4475%252F10964475%252Finterior_rear_seats-1774712229647.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4475/10964475/interior_rear_seats-1774712229647.jpg not downloaded yet
2026-03-29 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2059/10152059/interior_boot-1774690885713.jpg> (referer: None)
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4645%252F18144645%252Finstrument_cluster-1774702587411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4645/18144645/instrument_cluster-1774702587411.jpg not downloaded yet
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4475%252F10964475%252Finterior_dashboard-1774712262691.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4475/10964475/interior_dashboard-1774712262691.jpg not downloaded yet
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4645%252F18144645%252Finterior_boot-1774702549595.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4645/18144645/interior_boot-1774702549595.jpg not downloaded yet
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4475%252F10964475%252Finstrument_cluster-1774715731789.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4475/10964475/instrument_cluster-1774715731789.jpg not downloaded yet
2026-03-29 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2412/17242412/interior_dashboard-1772125854922.jpg> (referer: None)
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4645%252F18144645%252Fdocs_service_history-1774703814646.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8fc67a3797654b40bdef59a23f483c0c%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4645/18144645/docs_service_history-1774703814646.jpg?ixlib=js-3.8.0&auto=format&s=8fc67a3797654b40bdef59a23f483c0c not downloaded yet
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4475%252F10964475%252Finterior_boot-1774712272183.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4475/10964475/interior_boot-1774712272183.jpg not downloaded yet
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:27 16:05:35\x00'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c5890>
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8823%252F19488823%252Fdocs_service_history-1774627541289.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0d50a99f4b959e928ba86dc91806063a') HTTP/1.1" 204 0
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8823/19488823/docs_service_history-1774627541289.jpg?ixlib=js-3.8.0&auto=format&s=0d50a99f4b959e928ba86dc91806063a saved to cache
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5aaa8302-e483-58d2-981c-e62c47996173
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4475%252F10964475%252Fdocs_service_history-1774714933711.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1a2b4cc14b3d51f466ef08c1055bbd0c%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4475/10964475/docs_service_history-1774714933711.png?ixlib=js-3.8.0&auto=format&s=1a2b4cc14b3d51f466ef08c1055bbd0c not downloaded yet
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db84f10>
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2059%252F10152059%252Finterior_boot-1774690885713.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2059/10152059/interior_boot-1774690885713.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db87f50>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2412%252F17242412%252Finterior_dashboard-1772125854922.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2412/17242412/interior_dashboard-1772125854922.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd2000a4-db25-557c-ad30-4f556614595b
2026-03-29 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2412/17242412/interior_boot-1772384603744.jpg> (referer: None)
2026-03-29 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9878/19849878/interior_dashboard-1774697800426.jpg> (referer: None)
2026-03-29 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9878/19849878/docs_service_history-1774697967054.jpg?ixlib=js-3.8.0&auto=format&s=6977cd62d4587203ee078cda87e140f1> (referer: None)
2026-03-29 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9878/19849878/interior_boot-1774697539796.jpg> (referer: None)
2026-03-29 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4475/10964475/instrument_cluster-1774715731789.jpg> (referer: None)
2026-03-29 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_front_driver-1774702192944.jpg> (referer: None)
2026-03-29 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_front_passenger-1774702215577.jpg> (referer: None)
2026-03-29 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9878/19849878/interior_rear_seats-1774697708832.jpg> (referer: None)
2026-03-29 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4645/18144645/interior_dashboard-1774702525911.jpg> (referer: None)
2026-03-29 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4475/10964475/interior_front_seats-1774712211572.jpg> (referer: None)
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c331c10>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2412%252F17242412%252Finterior_boot-1772384603744.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2412/17242412/interior_boot-1772384603744.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd2000a4-db25-557c-ad30-4f556614595b
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2c6210>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9878%252F19849878%252Finterior_dashboard-1774697800426.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9878/19849878/interior_dashboard-1774697800426.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 747c08ea-7ed8-5299-847c-922d249da7cc
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6a8150>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9878%252F19849878%252Fdocs_service_history-1774697967054.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6977cd62d4587203ee078cda87e140f1') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9878/19849878/docs_service_history-1774697967054.jpg?ixlib=js-3.8.0&auto=format&s=6977cd62d4587203ee078cda87e140f1 saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 747c08ea-7ed8-5299-847c-922d249da7cc
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d04de50>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9878%252F19849878%252Finterior_boot-1774697539796.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9878/19849878/interior_boot-1774697539796.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 747c08ea-7ed8-5299-847c-922d249da7cc
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6ab590>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4475%252F10964475%252Finstrument_cluster-1774715731789.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4475/10964475/instrument_cluster-1774715731789.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6aac50>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4645%252F18144645%252Fexterior_front_driver-1774702192944.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_front_driver-1774702192944.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd084cca-2f4b-52f7-9ba7-5083bde7b724
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f644410>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4645%252F18144645%252Fexterior_front_passenger-1774702215577.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_front_passenger-1774702215577.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd084cca-2f4b-52f7-9ba7-5083bde7b724
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd31c90>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9878%252F19849878%252Finterior_rear_seats-1774697708832.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9878/19849878/interior_rear_seats-1774697708832.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 747c08ea-7ed8-5299-847c-922d249da7cc
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6a8d90>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4645%252F18144645%252Finterior_dashboard-1774702525911.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4645/18144645/interior_dashboard-1774702525911.jpg saved to cache
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd084cca-2f4b-52f7-9ba7-5083bde7b724
2026-03-29 20:14:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc5bad0>
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4475%252F10964475%252Finterior_front_seats-1774712211572.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4475/10964475/interior_front_seats-1774712211572.jpg saved to cache
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b
2026-03-29 20:14:13 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (16263039) larger than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4475/10964475/docs_service_history-1774714933711.png?ixlib=js-3.8.0&auto=format&s=1a2b4cc14b3d51f466ef08c1055bbd0c>.
2026-03-29 20:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4645/18144645/docs_service_history-1774703814646.jpg?ixlib=js-3.8.0&auto=format&s=8fc67a3797654b40bdef59a23f483c0c> (referer: None)
2026-03-29 20:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20200708.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6aacd0>
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4645%252F18144645%252Fdocs_service_history-1774703814646.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8fc67a3797654b40bdef59a23f483c0c') HTTP/1.1" 204 0
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4645/18144645/docs_service_history-1774703814646.jpg?ixlib=js-3.8.0&auto=format&s=8fc67a3797654b40bdef59a23f483c0c saved to cache
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd084cca-2f4b-52f7-9ba7-5083bde7b724
2026-03-29 20:14:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b1cc191-f87d-5209-9f0f-940489302e04 with identifier: 20200708
2026-03-29 20:14:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b1cc191-f87d-5209-9f0f-940489302e04 with scrape type 1
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b1cc191-f87d-5209-9f0f-940489302e04
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0708%252F20200708%252Fexterior_front_driver-1774699242094.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_front_driver-1774699242094.jpg not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0708%252F20200708%252Fexterior_rear_driver-1774699262005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_rear_driver-1774699262005.jpg not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0708%252F20200708%252Fexterior_front_passenger-1774699281558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_front_passenger-1774699281558.jpg not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0708%252F20200708%252Fexterior_rear_passenger-1774699271782.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_rear_passenger-1774699271782.jpg not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0708%252F20200708%252Finterior_front_seats-1774699790561.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0708/20200708/interior_front_seats-1774699790561.jpg not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0708%252F20200708%252Finterior_rear_seats-1774699815046.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0708/20200708/interior_rear_seats-1774699815046.jpg not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0708%252F20200708%252Finterior_dashboard-1774708745349.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0708/20200708/interior_dashboard-1774708745349.jpg not downloaded yet
2026-03-29 20:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4645/18144645/instrument_cluster-1774702587411.jpg> (referer: None)
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0708%252F20200708%252Finstrument_cluster-1774699835479.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0708/20200708/instrument_cluster-1774699835479.jpg not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0708%252F20200708%252Finterior_boot-1774699866334.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0708/20200708/interior_boot-1774699866334.jpg not downloaded yet
2026-03-29 20:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_front_passenger-1774711541898.jpg> (referer: None)
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0708%252F20200708%252Fdamage_dents-1774699463996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0708/20200708/damage_dents-1774699463996.jpg not downloaded yet
2026-03-29 20:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/5296288.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_rear_passenger-1774711525015.jpg> (referer: None)
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c2ed0>
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4645%252F18144645%252Finstrument_cluster-1774702587411.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4645/18144645/instrument_cluster-1774702587411.jpg saved to cache
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd084cca-2f4b-52f7-9ba7-5083bde7b724
2026-03-29 20:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4475/10964475/interior_dashboard-1774712262691.jpg> (referer: None)
2026-03-29 20:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_rear_passenger-1774702090368.jpg> (referer: None)
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7d6090>
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4475%252F10964475%252Fexterior_front_passenger-1774711541898.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_front_passenger-1774711541898.jpg saved to cache
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b
2026-03-29 20:14:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75 with identifier: 5296288
2026-03-29 20:14:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75 with scrape type 1
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6288%252F5296288%252Fexterior_front_driver-1774700859823.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_front_driver-1774700859823.jpg not downloaded yet
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f56e8d0>
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4475%252F10964475%252Fexterior_rear_passenger-1774711525015.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_rear_passenger-1774711525015.jpg saved to cache
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6288%252F5296288%252Fexterior_rear_driver-1774700916120.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_rear_driver-1774700916120.jpg not downloaded yet
2026-03-29 20:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19820283.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488052.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6288%252F5296288%252Fexterior_front_passenger-1774700880599.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_front_passenger-1774700880599.jpg not downloaded yet
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3c0d90>
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4475%252F10964475%252Finterior_dashboard-1774712262691.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4475/10964475/interior_dashboard-1774712262691.jpg saved to cache
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c0650>
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4645%252F18144645%252Fexterior_rear_passenger-1774702090368.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_rear_passenger-1774702090368.jpg saved to cache
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd084cca-2f4b-52f7-9ba7-5083bde7b724
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6288%252F5296288%252Fexterior_rear_passenger-1774700899789.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_rear_passenger-1774700899789.jpg not downloaded yet
2026-03-29 20:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4645/18144645/interior_boot-1774702549595.jpg> (referer: None)
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6288%252F5296288%252Finterior_front_seats-1774700933328.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6288/5296288/interior_front_seats-1774700933328.jpg not downloaded yet
2026-03-29 20:14:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df with identifier: 19820283
2026-03-29 20:14:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df with scrape type 1
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0283%252F19820283%252Fexterior_front_driver-1774701949296.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_front_driver-1774701949296.jpeg not downloaded yet
2026-03-29 20:14:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4908dfe-719a-5585-967f-d0d34e8ccc86 with identifier: 20488052
2026-03-29 20:14:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4908dfe-719a-5585-967f-d0d34e8ccc86 with scrape type 1
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4908dfe-719a-5585-967f-d0d34e8ccc86
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8052%252F20488052%252Fexterior_front_driver-1774711774965.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_front_driver-1774711774965.jpg not downloaded yet
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6288%252F5296288%252Finterior_rear_seats-1774700979858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6288/5296288/interior_rear_seats-1774700979858.jpg not downloaded yet
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0283%252F19820283%252Fexterior_rear_driver-1774701994487.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_rear_driver-1774701994487.jpeg not downloaded yet
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8052%252F20488052%252Fexterior_rear_driver-1774711693681.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_rear_driver-1774711693681.jpg not downloaded yet
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6288%252F5296288%252Finterior_dashboard-1774701015282.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6288/5296288/interior_dashboard-1774701015282.jpg not downloaded yet
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0283%252F19820283%252Fexterior_front_passenger-1774701965172.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_front_passenger-1774701965172.jpeg not downloaded yet
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8052%252F20488052%252Fexterior_front_passenger-1774711718794.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_front_passenger-1774711718794.jpg not downloaded yet
2026-03-29 20:14:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2daadcd0>
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4645%252F18144645%252Finterior_boot-1774702549595.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4645/18144645/interior_boot-1774702549595.jpg saved to cache
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd084cca-2f4b-52f7-9ba7-5083bde7b724
2026-03-29 20:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4475/10964475/interior_rear_seats-1774712229647.jpg> (referer: None)
2026-03-29 20:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4645/18144645/interior_rear_seats-1774702538713.jpg> (referer: None)
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6288%252F5296288%252F5296288-instrument_cluster-modified-1774702250321.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6288/5296288/5296288-instrument_cluster-modified-1774702250321.jpeg not downloaded yet
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0283%252F19820283%252Fexterior_rear_passenger-1774701984944.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_rear_passenger-1774701984944.jpeg not downloaded yet
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8052%252F20488052%252Fexterior_rear_passenger-1774711706080.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_rear_passenger-1774711706080.jpg not downloaded yet
2026-03-29 20:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4645/18144645/interior_front_seats-1774702481392.jpg> (referer: None)
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6288%252F5296288%252Finterior_boot-1774701019406.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6288/5296288/interior_boot-1774701019406.jpg not downloaded yet
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0283%252F19820283%252Finterior_front_seats-1774702231687.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0283/19820283/interior_front_seats-1774702231687.jpeg not downloaded yet
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8052%252F20488052%252Finterior_front_seats-1774712194473.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8052/20488052/interior_front_seats-1774712194473.jpg not downloaded yet
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6288%252F5296288%252Fdocs_service_history-1774701473948.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8ddf0101b3b437d6e78e8707eb533ea6%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6288/5296288/docs_service_history-1774701473948.jpg?ixlib=js-3.8.0&auto=format&s=8ddf0101b3b437d6e78e8707eb533ea6 not downloaded yet
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0283%252F19820283%252Finterior_rear_seats-1774702165303.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0283/19820283/interior_rear_seats-1774702165303.jpeg not downloaded yet
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8052%252F20488052%252Finterior_rear_seats-1774712214006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8052/20488052/interior_rear_seats-1774712214006.jpg not downloaded yet
2026-03-29 20:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4475/10964475/interior_boot-1774712272183.jpg> (referer: None)
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f52f850>
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4475%252F10964475%252Finterior_rear_seats-1774712229647.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4475/10964475/interior_rear_seats-1774712229647.jpg saved to cache
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db89d50>
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4645%252F18144645%252Finterior_rear_seats-1774702538713.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4645/18144645/interior_rear_seats-1774702538713.jpg saved to cache
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd084cca-2f4b-52f7-9ba7-5083bde7b724
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d2bdad0>
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4645%252F18144645%252Finterior_front_seats-1774702481392.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4645/18144645/interior_front_seats-1774702481392.jpg saved to cache
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd084cca-2f4b-52f7-9ba7-5083bde7b724
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0283%252F19820283%252Finterior_dashboard-1774702329132.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0283/19820283/interior_dashboard-1774702329132.jpeg not downloaded yet
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8052%252F20488052%252Finterior_dashboard-1774778354173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8052/20488052/interior_dashboard-1774778354173.jpg not downloaded yet
2026-03-29 20:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_front_passenger-1774700880599.jpg> (referer: None)
2026-03-29 20:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_rear_passenger-1774700899789.jpg> (referer: None)
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0283%252F19820283%252Finstrument_cluster-1774702274397.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0283/19820283/instrument_cluster-1774702274397.jpeg not downloaded yet
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8052%252F20488052%252Finstrument_cluster-1774712297287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8052/20488052/instrument_cluster-1774712297287.jpg not downloaded yet
2026-03-29 20:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_rear_driver-1774700916120.jpg> (referer: None)
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0283%252F19820283%252Finterior_boot-1774702214401.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0283/19820283/interior_boot-1774702214401.jpeg not downloaded yet
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8052%252F20488052%252Finterior_boot-1774712251742.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8052/20488052/interior_boot-1774712251742.jpg not downloaded yet
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db88f10>
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4475%252F10964475%252Finterior_boot-1774712272183.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4475/10964475/interior_boot-1774712272183.jpg saved to cache
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0283%252F19820283%252Fdocs_service_history-1774703045369.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De65fe671a0ec6eecd76ce8d5510f7bf6%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0283/19820283/docs_service_history-1774703045369.jpeg?ixlib=js-3.8.0&auto=format&s=e65fe671a0ec6eecd76ce8d5510f7bf6 not downloaded yet
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8052%252F20488052%252Fdocs_service_history-1774712520810.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dde20a1af63a218323773347648f7c72b%27 HTTP/1.1" 200 None
2026-03-29 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8052/20488052/docs_service_history-1774712520810.jpg?ixlib=js-3.8.0&auto=format&s=de20a1af63a218323773347648f7c72b not downloaded yet
2026-03-29 20:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_front_driver-1774700859823.jpg> (referer: None)
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c769c90>
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6288%252F5296288%252Fexterior_front_passenger-1774700880599.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_front_passenger-1774700880599.jpg saved to cache
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc7dfd0>
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6288%252F5296288%252Fexterior_rear_passenger-1774700899789.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_rear_passenger-1774700899789.jpg saved to cache
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c654250>
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6288%252F5296288%252Fexterior_rear_driver-1774700916120.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_rear_driver-1774700916120.jpg saved to cache
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75
2026-03-29 20:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0708/20200708/damage_dents-1774699463996.jpg> (referer: None)
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c656710>
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6288%252F5296288%252Fexterior_front_driver-1774700859823.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_front_driver-1774700859823.jpg saved to cache
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75
2026-03-29 20:14:16 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4475/10964475/docs_service_history-1774714933711.png?ixlib=js-3.8.0&auto=format&s=1a2b4cc14b3d51f466ef08c1055bbd0c>.
2026-03-29 20:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0708/20200708/instrument_cluster-1774699835479.jpg> (referer: None)
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d616f90>
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0708%252F20200708%252Fdamage_dents-1774699463996.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0708/20200708/damage_dents-1774699463996.jpg saved to cache
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b1cc191-f87d-5209-9f0f-940489302e04
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c645890>
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0708%252F20200708%252Finstrument_cluster-1774699835479.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0708/20200708/instrument_cluster-1774699835479.jpg saved to cache
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b1cc191-f87d-5209-9f0f-940489302e04
2026-03-29 20:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0708/20200708/interior_dashboard-1774708745349.jpg> (referer: None)
2026-03-29 20:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0708/20200708/interior_rear_seats-1774699815046.jpg> (referer: None)
2026-03-29 20:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0708/20200708/interior_boot-1774699866334.jpg> (referer: None)
2026-03-29 20:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4475/10964475/docs_service_history-1774714933711.png?ixlib=js-3.8.0&auto=format&s=1a2b4cc14b3d51f466ef08c1055bbd0c> (referer: None)
2026-03-29 20:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8052/20488052/docs_service_history-1774712520810.jpg?ixlib=js-3.8.0&auto=format&s=de20a1af63a218323773347648f7c72b> (referer: None)
2026-03-29 20:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8052/20488052/interior_rear_seats-1774712214006.jpg> (referer: None)
2026-03-29 20:14:16 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (14951042) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0283/19820283/interior_rear_seats-1774702165303.jpeg>.
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d08e590>
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0708%252F20200708%252Finterior_dashboard-1774708745349.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0708/20200708/interior_dashboard-1774708745349.jpg saved to cache
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b1cc191-f87d-5209-9f0f-940489302e04
2026-03-29 20:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8052/20488052/interior_dashboard-1774778354173.jpg> (referer: None)
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db8a710>
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0708%252F20200708%252Finterior_rear_seats-1774699815046.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0708/20200708/interior_rear_seats-1774699815046.jpg saved to cache
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b1cc191-f87d-5209-9f0f-940489302e04
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4b8150>
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0708%252F20200708%252Finterior_boot-1774699866334.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0708/20200708/interior_boot-1774699866334.jpg saved to cache
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b1cc191-f87d-5209-9f0f-940489302e04
2026-03-29 20:14:17 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:14:17 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-29 20:14:17 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 54 120
2026-03-29 20:14:17 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 186 9
2026-03-29 20:14:17 [PIL.PngImagePlugin] DEBUG: STREAM b'iDOT' 207 28
2026-03-29 20:14:17 [PIL.PngImagePlugin] DEBUG: b'iDOT' 207 28 (unknown)
2026-03-29 20:14:17 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 247 16384
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f55d190>
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_9.png HTTP/1.1" 201 0
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4475%252F10964475%252Fdocs_service_history-1774714933711.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1a2b4cc14b3d51f466ef08c1055bbd0c') HTTP/1.1" 204 0
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4475/10964475/docs_service_history-1774714933711.png?ixlib=js-3.8.0&auto=format&s=1a2b4cc14b3d51f466ef08c1055bbd0c saved to cache
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2a8090>
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8052%252F20488052%252Fdocs_service_history-1774712520810.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dde20a1af63a218323773347648f7c72b') HTTP/1.1" 204 0
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8052/20488052/docs_service_history-1774712520810.jpg?ixlib=js-3.8.0&auto=format&s=de20a1af63a218323773347648f7c72b saved to cache
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4908dfe-719a-5585-967f-d0d34e8ccc86
2026-03-29 20:14:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4bae10>
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8052%252F20488052%252Finterior_rear_seats-1774712214006.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8052/20488052/interior_rear_seats-1774712214006.jpg saved to cache
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4908dfe-719a-5585-967f-d0d34e8ccc86
2026-03-29 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8052/20488052/instrument_cluster-1774712297287.jpg> (referer: None)
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dccef10>
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8052%252F20488052%252Finterior_dashboard-1774778354173.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8052/20488052/interior_dashboard-1774778354173.jpg saved to cache
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4908dfe-719a-5585-967f-d0d34e8ccc86
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18293404.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c504b10>
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8052%252F20488052%252Finstrument_cluster-1774712297287.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8052/20488052/instrument_cluster-1774712297287.jpg saved to cache
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4908dfe-719a-5585-967f-d0d34e8ccc86
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6288/5296288/docs_service_history-1774701473948.jpg?ixlib=js-3.8.0&auto=format&s=8ddf0101b3b437d6e78e8707eb533ea6> (referer: None)
2026-03-29 20:14:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 106e5118-2551-554e-bab4-bc690e4d21ea with identifier: 18293404
2026-03-29 20:14:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 106e5118-2551-554e-bab4-bc690e4d21ea with scrape type 1
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 106e5118-2551-554e-bab4-bc690e4d21ea
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3404%252F18293404%252Fexterior_front_driver-1768304687779.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_front_driver-1768304687779.jpeg not downloaded yet
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3404%252F18293404%252Fexterior_rear_driver-1768304740602.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_rear_driver-1768304740602.jpeg not downloaded yet
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3404%252F18293404%252Fexterior_front_passenger-1768304697611.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_front_passenger-1768304697611.jpeg not downloaded yet
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3404%252F18293404%252Fexterior_rear_passenger-1768304727532.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_rear_passenger-1768304727532.jpeg not downloaded yet
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3404%252F18293404%252Finterior_front_seats-1768304762034.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3404/18293404/interior_front_seats-1768304762034.jpeg not downloaded yet
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3404%252F18293404%252Finterior_rear_seats-1768304868589.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3404/18293404/interior_rear_seats-1768304868589.jpeg not downloaded yet
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c76bc50>
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6288%252F5296288%252Fdocs_service_history-1774701473948.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8ddf0101b3b437d6e78e8707eb533ea6') HTTP/1.1" 204 0
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6288/5296288/docs_service_history-1774701473948.jpg?ixlib=js-3.8.0&auto=format&s=8ddf0101b3b437d6e78e8707eb533ea6 saved to cache
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3404%252F18293404%252Finterior_dashboard-1768304909451.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3404/18293404/interior_dashboard-1768304909451.jpeg not downloaded yet
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3404%252F18293404%252Finterior_boot-1768304982929.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3404/18293404/interior_boot-1768304982929.jpeg not downloaded yet
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F3404%252F18293404%252Fdocs_service_history-1768312529195.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3afa2fb777ffb4e1174e67ff73067454%27 HTTP/1.1" 200 None
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/3404/18293404/docs_service_history-1768312529195.jpeg?ixlib=js-3.8.0&auto=format&s=3afa2fb777ffb4e1174e67ff73067454 not downloaded yet
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3404%252F18293404%252Fdamage_scratches-1768305349730.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3404/18293404/damage_scratches-1768305349730.jpeg not downloaded yet
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6288/5296288/interior_boot-1774701019406.jpg> (referer: None)
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0283/19820283/interior_dashboard-1774702329132.jpeg> (referer: None)
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6288/5296288/5296288-instrument_cluster-modified-1774702250321.jpeg> (referer: None)
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0283/19820283/docs_service_history-1774703045369.jpeg?ixlib=js-3.8.0&auto=format&s=e65fe671a0ec6eecd76ce8d5510f7bf6> (referer: None)
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8052/20488052/interior_boot-1774712251742.jpg> (referer: None)
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_rear_passenger-1774711706080.jpg> (referer: None)
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_front_passenger-1774711718794.jpg> (referer: None)
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0283/19820283/instrument_cluster-1774702274397.jpeg> (referer: None)
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0283/19820283/interior_boot-1774702214401.jpeg> (referer: None)
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da8f790>
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6288%252F5296288%252Finterior_boot-1774701019406.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6288/5296288/interior_boot-1774701019406.jpg saved to cache
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6288/5296288/interior_dashboard-1774701015282.jpg> (referer: None)
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d856c90>
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0283%252F19820283%252Finterior_dashboard-1774702329132.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0283/19820283/interior_dashboard-1774702329132.jpeg saved to cache
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6e8490>
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6288%252F5296288%252F5296288-instrument_cluster-modified-1774702250321.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6288/5296288/5296288-instrument_cluster-modified-1774702250321.jpeg saved to cache
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8e5b90>
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0283%252F19820283%252Fdocs_service_history-1774703045369.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De65fe671a0ec6eecd76ce8d5510f7bf6') HTTP/1.1" 204 0
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0283/19820283/docs_service_history-1774703045369.jpeg?ixlib=js-3.8.0&auto=format&s=e65fe671a0ec6eecd76ce8d5510f7bf6 saved to cache
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df
2026-03-29 20:14:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d555390>
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8052%252F20488052%252Finterior_boot-1774712251742.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8052/20488052/interior_boot-1774712251742.jpg saved to cache
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4908dfe-719a-5585-967f-d0d34e8ccc86
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dbde390>
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8052%252F20488052%252Fexterior_rear_passenger-1774711706080.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_rear_passenger-1774711706080.jpg saved to cache
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4908dfe-719a-5585-967f-d0d34e8ccc86
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f682b10>
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8052%252F20488052%252Fexterior_front_passenger-1774711718794.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_front_passenger-1774711718794.jpg saved to cache
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4908dfe-719a-5585-967f-d0d34e8ccc86
2026-03-29 20:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/3404/18293404/docs_service_history-1768312529195.jpeg?ixlib=js-3.8.0&auto=format&s=3afa2fb777ffb4e1174e67ff73067454> (referer: None)
2026-03-29 20:14:19 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:19 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:19 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00wO\x1a\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\x9c=\x00wE&\x00\x00\x00\x00'
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c69d9d0>
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0283%252F19820283%252Finstrument_cluster-1774702274397.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0283/19820283/instrument_cluster-1774702274397.jpeg saved to cache
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df
2026-03-29 20:14:19 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:19 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:19 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x8bXH\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xedH\x00\x8bNT\x00\x00\x00\x00'
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd55a10>
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0283%252F19820283%252Finterior_boot-1774702214401.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0283/19820283/interior_boot-1774702214401.jpeg saved to cache
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0b7c50>
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6288%252F5296288%252Finterior_dashboard-1774701015282.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6288/5296288/interior_dashboard-1774701015282.jpg saved to cache
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75
2026-03-29 20:14:20 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0283/19820283/interior_rear_seats-1774702165303.jpeg>.
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c784d10>
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F3404%252F18293404%252Fdocs_service_history-1768312529195.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3afa2fb777ffb4e1174e67ff73067454') HTTP/1.1" 204 0
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/3404/18293404/docs_service_history-1768312529195.jpeg?ixlib=js-3.8.0&auto=format&s=3afa2fb777ffb4e1174e67ff73067454 saved to cache
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 106e5118-2551-554e-bab4-bc690e4d21ea
2026-03-29 20:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_front_passenger-1774701965172.jpeg> (referer: None)
2026-03-29 20:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8052/20488052/interior_front_seats-1774712194473.jpg> (referer: None)
2026-03-29 20:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0283/19820283/interior_rear_seats-1774702165303.jpeg> (referer: None)
2026-03-29 20:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_rear_passenger-1774701984944.jpeg> (referer: None)
2026-03-29 20:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0283/19820283/interior_front_seats-1774702231687.jpeg> (referer: None)
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cbcddd0>
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0283%252F19820283%252Fexterior_front_passenger-1774701965172.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_front_passenger-1774701965172.jpeg saved to cache
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df
2026-03-29 20:14:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d483350>
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8052%252F20488052%252Finterior_front_seats-1774712194473.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8052/20488052/interior_front_seats-1774712194473.jpg saved to cache
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4908dfe-719a-5585-967f-d0d34e8ccc86
2026-03-29 20:14:20 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:20 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:20 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xdc\x03\x93\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x1e\xef\x00\xdb\xf9\x9f\x00\x00\x00\x00'
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de99610>
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0283%252F19820283%252Finterior_rear_seats-1774702165303.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0283/19820283/interior_rear_seats-1774702165303.jpeg saved to cache
2026-03-29 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d301610>
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0283%252F19820283%252Fexterior_rear_passenger-1774701984944.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_rear_passenger-1774701984944.jpeg saved to cache
2026-03-29 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df
2026-03-29 20:14:21 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:21 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:21 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x98\x17\xde\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\xe2d\x00\x98\r\xea\x00\x00\x00\x00'
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8f9d50>
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0283%252F19820283%252Finterior_front_seats-1774702231687.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0283/19820283/interior_front_seats-1774702231687.jpeg saved to cache
2026-03-29 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df
2026-03-29 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_rear_driver-1768304740602.jpeg> (referer: None)
2026-03-29 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_front_driver-1768304687779.jpeg> (referer: None)
2026-03-29 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_rear_passenger-1768304727532.jpeg> (referer: None)
2026-03-29 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_rear_driver-1774711693681.jpg> (referer: None)
2026-03-29 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_front_passenger-1768304697611.jpeg> (referer: None)
2026-03-29 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3404/18293404/interior_rear_seats-1768304868589.jpeg> (referer: None)
2026-03-29 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3404/18293404/interior_front_seats-1768304762034.jpeg> (referer: None)
2026-03-29 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3404/18293404/damage_scratches-1768305349730.jpeg> (referer: None)
2026-03-29 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_rear_driver-1774701994487.jpeg> (referer: None)
2026-03-29 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3404/18293404/interior_boot-1768304982929.jpeg> (referer: None)
2026-03-29 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3404/18293404/interior_dashboard-1768304909451.jpeg> (referer: None)
2026-03-29 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6288/5296288/interior_rear_seats-1774700979858.jpg> (referer: None)
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e16d690>
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3404%252F18293404%252Fexterior_rear_driver-1768304740602.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_rear_driver-1768304740602.jpeg saved to cache
2026-03-29 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 106e5118-2551-554e-bab4-bc690e4d21ea
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e16c110>
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3404%252F18293404%252Fexterior_front_driver-1768304687779.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_front_driver-1768304687779.jpeg saved to cache
2026-03-29 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 106e5118-2551-554e-bab4-bc690e4d21ea
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f488050>
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3404%252F18293404%252Fexterior_rear_passenger-1768304727532.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_rear_passenger-1768304727532.jpeg saved to cache
2026-03-29 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 106e5118-2551-554e-bab4-bc690e4d21ea
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c70f090>
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8052%252F20488052%252Fexterior_rear_driver-1774711693681.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_rear_driver-1774711693681.jpg saved to cache
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4908dfe-719a-5585-967f-d0d34e8ccc86
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f438310>
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3404%252F18293404%252Fexterior_front_passenger-1768304697611.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_front_passenger-1768304697611.jpeg saved to cache
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 106e5118-2551-554e-bab4-bc690e4d21ea
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00+\x86|\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01~\x9a\x00+|\x8e\x00\x00\x00\x00'
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f43af90>
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3404%252F18293404%252Finterior_rear_seats-1768304868589.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3404/18293404/interior_rear_seats-1768304868589.jpeg saved to cache
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 106e5118-2551-554e-bab4-bc690e4d21ea
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00+"\x93\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x0bn\x00+\x18\xa5\x00\x00\x00\x00'
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c656b50>
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3404%252F18293404%252Finterior_front_seats-1768304762034.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3404/18293404/interior_front_seats-1768304762034.jpeg saved to cache
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 106e5118-2551-554e-bab4-bc690e4d21ea
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00-\x8aD\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xed\x1b\x00-\x80V\x00\x00\x00\x00'
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db8b650>
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3404%252F18293404%252Fdamage_scratches-1768305349730.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3404/18293404/damage_scratches-1768305349730.jpeg saved to cache
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 106e5118-2551-554e-bab4-bc690e4d21ea
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c654210>
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0283%252F19820283%252Fexterior_rear_driver-1774701994487.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_rear_driver-1774701994487.jpeg saved to cache
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x005\x81\xcf\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02/\xca\x005w\x99\x00\x00\x00\x00'
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dde3b10>
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3404%252F18293404%252Finterior_boot-1768304982929.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3404/18293404/interior_boot-1768304982929.jpeg saved to cache
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 106e5118-2551-554e-bab4-bc690e4d21ea
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00:\xc0\xdf\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\x08\x03\x00:\xb6\xb3\x00\x00\x00\x00'
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f43a590>
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3404%252F18293404%252Finterior_dashboard-1768304909451.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3404/18293404/interior_dashboard-1768304909451.jpeg saved to cache
2026-03-29 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 106e5118-2551-554e-bab4-bc690e4d21ea
2026-03-29 20:14:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 106e5118-2551-554e-bab4-bc690e4d21ea, skipping ID generation
2026-03-29 20:14:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 106e5118-2551-554e-bab4-bc690e4d21ea with scrape type 1
2026-03-29 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 106e5118-2551-554e-bab4-bc690e4d21ea sending to next pipeline
2026-03-29 20:14:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 106e5118-2551-554e-bab4-bc690e4d21ea, identifier: 18293404
2026-03-29 20:14:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 106e5118-2551-554e-bab4-bc690e4d21ea with identifier: 18293404
2026-03-29 20:14:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 106e5118-2551-554e-bab4-bc690e4d21ea with identifier: 18293404
2026-03-29 20:14:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 106e5118-2551-554e-bab4-bc690e4d21ea with identifier: 18293404 to the API
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3404/18293404/interior_dashboard-1768304909451.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '106e5118-2551-554e-bab4-bc690e4d21ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'R33 AYJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18293404',
'listing': 'auction',
'location': 'Cumberland Workington',
'make': 'Audi',
'model': 'Q7',
'odometer': 66300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1359650,
'Height': 2455,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_front_driver-1768304687779.jpeg',
'Width': 3273},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1244164,
'Height': 2300,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_rear_driver-1768304740602.jpeg',
'Width': 3067},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1368449,
'Height': 2441,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_front_passenger-1768304697611.jpeg',
'Width': 3255},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1202206,
'Height': 2362,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3404/18293404/exterior_rear_passenger-1768304727532.jpeg',
'Width': 3149},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2960897,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3404/18293404/interior_front_seats-1768304762034.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2950422,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3404/18293404/interior_rear_seats-1768304868589.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4049122,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3404/18293404/interior_dashboard-1768304909451.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3649945,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3404/18293404/interior_boot-1768304982929.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111587,
'Height': 1359,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/3404/18293404/docs_service_history-1768312529195.jpeg?ixlib=js-3.8.0&auto=format&s=3afa2fb777ffb4e1174e67ff73067454',
'Width': 1023},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106e5118-2551-554e-bab4-bc690e4d21ea/106e5118-2551-554e-bab4-bc690e4d21ea_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3110751,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3404/18293404/damage_scratches-1768305349730.jpeg',
'Width': 4032}],
'price': 17421,
'price_includes_vat': False,
'registration_date': '2018-03-15',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q7 S Line TDI Quattro Auto',
'transmission': 'automatic',
'trim': 'S Line TDI Quattro Auto',
'vin': 'WAUZZZ4M4JD009659',
'year': 2018}
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718293404%27 HTTP/1.1" 200 None
2026-03-29 20:14:24 [motorway.uk] INFO: Saving data for 18293404: {'created_time': 1774815264.092186, 'last_price_update_time': 1774815264.092196, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18293404') HTTP/1.1" 204 0
2026-03-29 20:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_front_driver-1774711774965.jpg> (referer: None)
2026-03-29 20:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6288/5296288/interior_front_seats-1774700933328.jpg> (referer: None)
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d605e10>
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6288%252F5296288%252Finterior_rear_seats-1774700979858.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6288/5296288/interior_rear_seats-1774700979858.jpg saved to cache
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9e5b10>
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8052%252F20488052%252Fexterior_front_driver-1774711774965.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_front_driver-1774711774965.jpg saved to cache
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4908dfe-719a-5585-967f-d0d34e8ccc86
2026-03-29 20:14:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4908dfe-719a-5585-967f-d0d34e8ccc86, skipping ID generation
2026-03-29 20:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4908dfe-719a-5585-967f-d0d34e8ccc86 with scrape type 1
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4908dfe-719a-5585-967f-d0d34e8ccc86 sending to next pipeline
2026-03-29 20:14:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d4908dfe-719a-5585-967f-d0d34e8ccc86, identifier: 20488052
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d606bd0>
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6288%252F5296288%252Finterior_front_seats-1774700933328.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6288/5296288/interior_front_seats-1774700933328.jpg saved to cache
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75
2026-03-29 20:14:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75, skipping ID generation
2026-03-29 20:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75 with scrape type 1
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75 sending to next pipeline
2026-03-29 20:14:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75, identifier: 5296288
2026-03-29 20:14:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d4908dfe-719a-5585-967f-d0d34e8ccc86 with identifier: 20488052
2026-03-29 20:14:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d4908dfe-719a-5585-967f-d0d34e8ccc86 with identifier: 20488052
2026-03-29 20:14:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d4908dfe-719a-5585-967f-d0d34e8ccc86 with identifier: 20488052 to the API
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_front_driver-1774711774965.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd4908dfe-719a-5585-967f-d0d34e8ccc86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'M8 OCF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488052',
'listing': 'auction',
'location': 'South Yorkshire Doncaster',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 75421,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1179410,
'Height': 1940,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_front_driver-1774711774965.jpg',
'Width': 2586},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1417308,
'Height': 2240,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_rear_driver-1774711693681.jpg',
'Width': 2986},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2597275,
'Height': 2792,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_front_passenger-1774711718794.jpg',
'Width': 3723},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2107851,
'Height': 2766,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8052/20488052/exterior_rear_passenger-1774711706080.jpg',
'Width': 3688},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3720816,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8052/20488052/interior_front_seats-1774712194473.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4029967,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8052/20488052/interior_rear_seats-1774712214006.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2993687,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8052/20488052/interior_dashboard-1774778354173.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2203449,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8052/20488052/instrument_cluster-1774712297287.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4352201,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8052/20488052/interior_boot-1774712251742.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4908dfe-719a-5585-967f-d0d34e8ccc86/d4908dfe-719a-5585-967f-d0d34e8ccc86_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 865882,
'Height': 2499,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8052/20488052/docs_service_history-1774712520810.jpg?ixlib=js-3.8.0&auto=format&s=de20a1af63a218323773347648f7c72b',
'Width': 2548}],
'price': 2817,
'price_includes_vat': False,
'registration_date': '2015-09-01',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Zetec S',
'transmission': 'manual',
'trim': 'Zetec S',
'vin': 'WF0CXXGAKCFT39128',
'year': 2015}
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488052%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [motorway.uk] INFO: Saving data for 20488052: {'created_time': 1774815265.032494, 'last_price_update_time': 1774815265.032505, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488052') HTTP/1.1" 204 0
2026-03-29 20:14:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75 with identifier: 5296288
2026-03-29 20:14:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75 with identifier: 5296288
2026-03-29 20:14:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75 with identifier: 5296288 to the API
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6288/5296288/interior_front_seats-1774700933328.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SC66 PGZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/5296288',
'listing': 'auction',
'location': 'Worcestershire Redditch',
'make': 'Vauxhall',
'model': 'Insignia',
'odometer': 40400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 912278,
'Height': 2103,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_front_driver-1774700859823.jpg',
'Width': 2804},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651887,
'Height': 1943,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_rear_driver-1774700916120.jpg',
'Width': 2591},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510393,
'Height': 1992,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_front_passenger-1774700880599.jpg',
'Width': 2656},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 511003,
'Height': 1940,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6288/5296288/exterior_rear_passenger-1774700899789.jpg',
'Width': 2586},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1619413,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/6288/5296288/interior_front_seats-1774700933328.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 917797,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/6288/5296288/interior_rear_seats-1774700979858.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1335669,
'Height': 3000,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6288/5296288/interior_dashboard-1774701015282.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490067,
'Height': 1613,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6288/5296288/5296288-instrument_cluster-modified-1774702250321.jpeg',
'Width': 2150},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1058932,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/6288/5296288/interior_boot-1774701019406.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75/1e3e1d8e-8ff7-5fc6-b384-9cdb86c74e75_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 689744,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6288/5296288/docs_service_history-1774701473948.jpg?ixlib=js-3.8.0&auto=format&s=8ddf0101b3b437d6e78e8707eb533ea6',
'Width': 3000}],
'price': 5779,
'price_includes_vat': False,
'registration_date': '2016-12-19',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Insignia SRI NAV CDTI ecoFLEX SS',
'transmission': 'manual',
'trim': 'SRI NAV CDTI ecoFLEX SS',
'vin': 'W0LGS6E15G1142392',
'year': 2016}
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275296288%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [motorway.uk] INFO: Saving data for 5296288: {'created_time': 1774815265.409755, 'last_price_update_time': 1774815265.409767, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='5296288') HTTP/1.1" 204 0
2026-03-29 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8823/19488823/docs_service_history-1774627509119.jpg?ixlib=js-3.8.0&auto=format&s=c42291515b37dbe14683dc61ff5f70b4> (referer: None)
2026-03-29 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_rear_passenger-1774699271782.jpg> (referer: None)
2026-03-29 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8823/19488823/interior_front_seats-1774627227385.jpg> (referer: None)
2026-03-29 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_rear_driver-1774702112691.jpg> (referer: None)
2026-03-29 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_front_passenger-1774699281558.jpg> (referer: None)
2026-03-29 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_front_driver-1774711485762.jpg> (referer: None)
2026-03-29 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8823/19488823/interior_rear_seats-1774627225631.jpg> (referer: None)
2026-03-29 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_rear_driver-1774711508806.jpg> (referer: None)
2026-03-29 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_front_driver-1774699242094.jpg> (referer: None)
2026-03-29 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9878/19849878/docs_service_history-1774697937113.jpg?ixlib=js-3.8.0&auto=format&s=dc2c428de5eee82d264139ab7e2421f5> (referer: None)
2026-03-29 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9878/19849878/interior_front_seats-1774697633528.jpg> (referer: None)
2026-03-29 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0708/20200708/interior_front_seats-1774699790561.jpg> (referer: None)
2026-03-29 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_front_driver-1774701949296.jpeg> (referer: None)
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0d3910>
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8823%252F19488823%252Fdocs_service_history-1774627509119.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc42291515b37dbe14683dc61ff5f70b4') HTTP/1.1" 204 0
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8823/19488823/docs_service_history-1774627509119.jpg?ixlib=js-3.8.0&auto=format&s=c42291515b37dbe14683dc61ff5f70b4 saved to cache
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5aaa8302-e483-58d2-981c-e62c47996173
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cebf550>
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0708%252F20200708%252Fexterior_rear_passenger-1774699271782.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_rear_passenger-1774699271782.jpg saved to cache
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b1cc191-f87d-5209-9f0f-940489302e04
2026-03-29 20:14:25 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:14:25 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:14:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:14:25 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:27 15:55:48\x00'
2026-03-29 20:14:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:14:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:14:25 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:14:25 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:14:25 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:14:25 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:14:25 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:14:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:14:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd519d0>
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8823%252F19488823%252Finterior_front_seats-1774627227385.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8823/19488823/interior_front_seats-1774627227385.jpg saved to cache
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5aaa8302-e483-58d2-981c-e62c47996173
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca673d0>
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4645%252F18144645%252Fexterior_rear_driver-1774702112691.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_rear_driver-1774702112691.jpg saved to cache
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd084cca-2f4b-52f7-9ba7-5083bde7b724
2026-03-29 20:14:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd084cca-2f4b-52f7-9ba7-5083bde7b724, skipping ID generation
2026-03-29 20:14:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd084cca-2f4b-52f7-9ba7-5083bde7b724 with scrape type 1
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd084cca-2f4b-52f7-9ba7-5083bde7b724 sending to next pipeline
2026-03-29 20:14:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fd084cca-2f4b-52f7-9ba7-5083bde7b724, identifier: 18144645
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d47b9d0>
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0708%252F20200708%252Fexterior_front_passenger-1774699281558.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_front_passenger-1774699281558.jpg saved to cache
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b1cc191-f87d-5209-9f0f-940489302e04
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c646fd0>
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4475%252F10964475%252Fexterior_front_driver-1774711485762.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_front_driver-1774711485762.jpg saved to cache
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:27 15:56:55\x00'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f549f90>
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8823%252F19488823%252Finterior_rear_seats-1774627225631.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8823/19488823/interior_rear_seats-1774627225631.jpg saved to cache
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5aaa8302-e483-58d2-981c-e62c47996173
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca65810>
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4475%252F10964475%252Fexterior_rear_driver-1774711508806.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_rear_driver-1774711508806.jpg saved to cache
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b
2026-03-29 20:14:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b, skipping ID generation
2026-03-29 20:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b with scrape type 1
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b sending to next pipeline
2026-03-29 20:14:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b, identifier: 10964475
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de20c10>
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0708%252F20200708%252Fexterior_front_driver-1774699242094.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_front_driver-1774699242094.jpg saved to cache
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b1cc191-f87d-5209-9f0f-940489302e04
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5dea10>
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9878%252F19849878%252Fdocs_service_history-1774697937113.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddc2c428de5eee82d264139ab7e2421f5') HTTP/1.1" 204 0
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9878/19849878/docs_service_history-1774697937113.jpg?ixlib=js-3.8.0&auto=format&s=dc2c428de5eee82d264139ab7e2421f5 saved to cache
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 747c08ea-7ed8-5299-847c-922d249da7cc
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5dc450>
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9878%252F19849878%252Finterior_front_seats-1774697633528.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9878/19849878/interior_front_seats-1774697633528.jpg saved to cache
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 747c08ea-7ed8-5299-847c-922d249da7cc
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db6da10>
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0708%252F20200708%252Finterior_front_seats-1774699790561.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0708/20200708/interior_front_seats-1774699790561.jpg saved to cache
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b1cc191-f87d-5209-9f0f-940489302e04
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f549fd0>
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0283%252F19820283%252Fexterior_front_driver-1774701949296.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_front_driver-1774701949296.jpeg saved to cache
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df
2026-03-29 20:14:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df, skipping ID generation
2026-03-29 20:14:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df with scrape type 1
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df sending to next pipeline
2026-03-29 20:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df, identifier: 19820283
2026-03-29 20:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fd084cca-2f4b-52f7-9ba7-5083bde7b724 with identifier: 18144645
2026-03-29 20:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fd084cca-2f4b-52f7-9ba7-5083bde7b724 with identifier: 18144645
2026-03-29 20:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fd084cca-2f4b-52f7-9ba7-5083bde7b724 with identifier: 18144645 to the API
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_rear_driver-1774702112691.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'fd084cca-2f4b-52f7-9ba7-5083bde7b724',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FD15 VDF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18144645',
'listing': 'auction',
'location': 'North Lincolnshire Scunthorpe',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 73000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1252721,
'Height': 2293,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_front_driver-1774702192944.jpg',
'Width': 3057},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 860234,
'Height': 1859,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_rear_driver-1774702112691.jpg',
'Width': 2478},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1141786,
'Height': 2237,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_front_passenger-1774702215577.jpg',
'Width': 2983},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1277636,
'Height': 2299,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4645/18144645/exterior_rear_passenger-1774702090368.jpg',
'Width': 3065},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3508958,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4645/18144645/interior_front_seats-1774702481392.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2965508,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4645/18144645/interior_rear_seats-1774702538713.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2221742,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4645/18144645/interior_dashboard-1774702525911.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1241873,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4645/18144645/instrument_cluster-1774702587411.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3016427,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4645/18144645/interior_boot-1774702549595.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd084cca-2f4b-52f7-9ba7-5083bde7b724/fd084cca-2f4b-52f7-9ba7-5083bde7b724_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1385609,
'Height': 2590,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4645/18144645/docs_service_history-1774703814646.jpg?ixlib=js-3.8.0&auto=format&s=8fc67a3797654b40bdef59a23f483c0c',
'Width': 3453}],
'price': 5457,
'price_includes_vat': False,
'registration_date': '2015-06-29',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai N-Tec + DCI 4X4',
'transmission': 'manual',
'trim': 'N-Tec + DCI 4X4',
'vin': 'SJNFDNJ11U1433475',
'year': 2015}
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718144645%27 HTTP/1.1" 200 None
2026-03-29 20:14:27 [motorway.uk] INFO: Saving data for 18144645: {'created_time': 1774815267.547518, 'last_price_update_time': 1774815267.54753, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18144645') HTTP/1.1" 204 0
2026-03-29 20:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b with identifier: 10964475
2026-03-29 20:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b with identifier: 10964475
2026-03-29 20:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5a65b2b2-a54c-5e1d-8371-1cc3a51f627b with identifier: 10964475 to the API
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_rear_driver-1774711508806.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '5a65b2b2-a54c-5e1d-8371-1cc3a51f627b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'K44 RYW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10964475',
'listing': 'auction',
'location': 'Derbyshire Alfreton',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 86775,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 980596,
'Height': 1917,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_front_driver-1774711485762.jpg',
'Width': 2556},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1249266,
'Height': 2104,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_rear_driver-1774711508806.jpg',
'Width': 2805},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1062005,
'Height': 2257,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_front_passenger-1774711541898.jpg',
'Width': 3009},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1726348,
'Height': 2477,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4475/10964475/exterior_rear_passenger-1774711525015.jpg',
'Width': 3303},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3030056,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4475/10964475/interior_front_seats-1774712211572.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3416407,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4475/10964475/interior_rear_seats-1774712229647.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2145148,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4475/10964475/interior_dashboard-1774712262691.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528307,
'Height': 1763,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4475/10964475/instrument_cluster-1774715731789.jpg',
'Width': 2350},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3549515,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4475/10964475/interior_boot-1774712272183.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a65b2b2-a54c-5e1d-8371-1cc3a51f627b/5a65b2b2-a54c-5e1d-8371-1cc3a51f627b_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 16263039,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4475/10964475/docs_service_history-1774714933711.png?ixlib=js-3.8.0&auto=format&s=1a2b4cc14b3d51f466ef08c1055bbd0c',
'Width': 3024}],
'price': 13033,
'price_includes_vat': False,
'registration_date': '2019-07-29',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Tiguan R-LINE Tech TDI',
'transmission': 'manual',
'trim': 'R-LINE Tech TDI',
'vin': 'WVGZZZ5NZKW396504',
'year': 2019}
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710964475%27 HTTP/1.1" 200 None
2026-03-29 20:14:27 [motorway.uk] INFO: Saving data for 10964475: {'created_time': 1774815267.950607, 'last_price_update_time': 1774815267.950621, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10964475') HTTP/1.1" 204 0
2026-03-29 20:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df with identifier: 19820283
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Yellow HTTP/1.1" 200 None
2026-03-29 20:14:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df with identifier: 19820283
2026-03-29 20:14:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df with identifier: 19820283 to the API
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_front_driver-1774701949296.jpeg>
{'auction_title': '',
'category': None,
'color': 'Yellow',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VA60 WGF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19820283',
'listing': 'auction',
'location': 'Merseyside Saint Helens',
'make': 'MINI',
'model': 'One',
'odometer': 47053,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4625110,
'Height': 4806,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_front_driver-1774701949296.jpeg',
'Width': 6408},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3493266,
'Height': 4727,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_rear_driver-1774701994487.jpeg',
'Width': 6302},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4219740,
'Height': 4751,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_front_passenger-1774701965172.jpeg',
'Width': 6334},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5838968,
'Height': 5659,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0283/19820283/exterior_rear_passenger-1774701984944.jpeg',
'Width': 7545},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 10353218,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/0283/19820283/interior_front_seats-1774702231687.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 14951042,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/0283/19820283/interior_rear_seats-1774702165303.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3861803,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0283/19820283/interior_dashboard-1774702329132.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 8186711,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0283/19820283/instrument_cluster-1774702274397.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 9454992,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/0283/19820283/interior_boot-1774702214401.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df/46a16a1d-a7a8-5f36-a6b3-2bc92bb2b4df_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2405580,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0283/19820283/docs_service_history-1774703045369.jpeg?ixlib=js-3.8.0&auto=format&s=e65fe671a0ec6eecd76ce8d5510f7bf6',
'Width': 3024}],
'price': 2551,
'price_includes_vat': False,
'registration_date': '2010-09-08',
'seats_number': None,
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'vin': 'WMWSR32020T024227',
'year': 2010}
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719820283%27 HTTP/1.1" 200 None
2026-03-29 20:14:28 [motorway.uk] INFO: Saving data for 19820283: {'created_time': 1774815268.511011, 'last_price_update_time': 1774815268.511021, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19820283') HTTP/1.1" 204 0
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_rear_passenger-1774625625110.jpg> (referer: None)
2026-03-29 20:14:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_rear_passenger-1774697188304.jpg> (referer: None)
2026-03-29 20:14:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f21ab10>
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F19488823%252Fexterior_rear_passenger-1774625625110.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_rear_passenger-1774625625110.jpg saved to cache
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5aaa8302-e483-58d2-981c-e62c47996173
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cab8590>
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9878%252F19849878%252Fexterior_rear_passenger-1774697188304.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_rear_passenger-1774697188304.jpg saved to cache
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 747c08ea-7ed8-5299-847c-922d249da7cc
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_front_driver-1774625624520.jpg> (referer: None)
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_rear_driver-1774625626479.jpg> (referer: None)
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_rear_driver-1774699262005.jpg> (referer: None)
2026-03-29 20:14:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_front_driver-1774697182756.jpg> (referer: None)
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2059/10152059/interior_front_seats-1774690882315.jpg> (referer: None)
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_front_passenger-1774697177114.jpg> (referer: None)
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_front_passenger-1774625624720.jpg> (referer: None)
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2059/10152059/interior_dashboard-1774690924883.jpg> (referer: None)
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2059/10152059/interior_rear_seats-1774690889230.jpg> (referer: None)
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2412/17242412/interior_front_seats-1772125398212.jpg> (referer: None)
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2412/17242412/interior_rear_seats-1772125452903.jpg> (referer: None)
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_rear_driver-1774697185788.jpg> (referer: None)
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8875d0>
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F19488823%252Fexterior_front_driver-1774625624520.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_front_driver-1774625624520.jpg saved to cache
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5aaa8302-e483-58d2-981c-e62c47996173
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7fa950>
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F19488823%252Fexterior_rear_driver-1774625626479.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_rear_driver-1774625626479.jpg saved to cache
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5aaa8302-e483-58d2-981c-e62c47996173
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e16d610>
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0708%252F20200708%252Fexterior_rear_driver-1774699262005.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_rear_driver-1774699262005.jpg saved to cache
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b1cc191-f87d-5209-9f0f-940489302e04
2026-03-29 20:14:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b1cc191-f87d-5209-9f0f-940489302e04, skipping ID generation
2026-03-29 20:14:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b1cc191-f87d-5209-9f0f-940489302e04 with scrape type 1
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b1cc191-f87d-5209-9f0f-940489302e04 sending to next pipeline
2026-03-29 20:14:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2b1cc191-f87d-5209-9f0f-940489302e04, identifier: 20200708
2026-03-29 20:14:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2b1cc191-f87d-5209-9f0f-940489302e04 with identifier: 20200708
2026-03-29 20:14:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2b1cc191-f87d-5209-9f0f-940489302e04 with identifier: 20200708
2026-03-29 20:14:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2b1cc191-f87d-5209-9f0f-940489302e04 with identifier: 20200708 to the API
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_rear_driver-1774699262005.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '2b1cc191-f87d-5209-9f0f-940489302e04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CE14 EHJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20200708',
'listing': 'auction',
'location': 'Essex Benfleet',
'make': 'MINI',
'model': 'Cooper',
'odometer': 38223,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1734227,
'Height': 2785,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_front_driver-1774699242094.jpg',
'Width': 3713},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1341467,
'Height': 2589,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_rear_driver-1774699262005.jpg',
'Width': 3452},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1442350,
'Height': 2585,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_front_passenger-1774699281558.jpg',
'Width': 3446},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1427310,
'Height': 2515,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0708/20200708/exterior_rear_passenger-1774699271782.jpg',
'Width': 3353},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3775903,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0708/20200708/interior_front_seats-1774699790561.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3344342,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0708/20200708/interior_rear_seats-1774699815046.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1813357,
'Height': 2473,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0708/20200708/interior_dashboard-1774708745349.jpg',
'Width': 3297},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2355206,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0708/20200708/instrument_cluster-1774699835479.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4426958,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0708/20200708/interior_boot-1774699866334.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1cc191-f87d-5209-9f0f-940489302e04/2b1cc191-f87d-5209-9f0f-940489302e04_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1864037,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0708/20200708/damage_dents-1774699463996.jpg',
'Width': 4032}],
'price': 4453,
'price_includes_vat': False,
'registration_date': '2014-03-05',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper Clubman D',
'transmission': 'manual',
'trim': 'Clubman D',
'vin': 'WMWZH52060T704399',
'year': 2014}
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720200708%27 HTTP/1.1" 200 None
2026-03-29 20:14:29 [motorway.uk] INFO: Saving data for 20200708: {'created_time': 1774815269.998419, 'last_price_update_time': 1774815269.998435, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20200708') HTTP/1.1" 204 0
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4b8bd0>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9878%252F19849878%252Fexterior_front_driver-1774697182756.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_front_driver-1774697182756.jpg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 747c08ea-7ed8-5299-847c-922d249da7cc
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f26d8d0>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2059%252F10152059%252Finterior_front_seats-1774690882315.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2059/10152059/interior_front_seats-1774690882315.jpg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f269dd0>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9878%252F19849878%252Fexterior_front_passenger-1774697177114.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_front_passenger-1774697177114.jpg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 747c08ea-7ed8-5299-847c-922d249da7cc
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d1ce890>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F19488823%252Fexterior_front_passenger-1774625624720.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_front_passenger-1774625624720.jpg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5aaa8302-e483-58d2-981c-e62c47996173
2026-03-29 20:14:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5aaa8302-e483-58d2-981c-e62c47996173, skipping ID generation
2026-03-29 20:14:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aaa8302-e483-58d2-981c-e62c47996173 with scrape type 1
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5aaa8302-e483-58d2-981c-e62c47996173 sending to next pipeline
2026-03-29 20:14:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5aaa8302-e483-58d2-981c-e62c47996173, identifier: 19488823
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dab7c90>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2059%252F10152059%252Finterior_dashboard-1774690924883.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2059/10152059/interior_dashboard-1774690924883.jpg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5aea10>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2059%252F10152059%252Finterior_rear_seats-1774690889230.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2059/10152059/interior_rear_seats-1774690889230.jpg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f269110>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2412%252F17242412%252Finterior_front_seats-1772125398212.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2412/17242412/interior_front_seats-1772125398212.jpg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd2000a4-db25-557c-ad30-4f556614595b
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d184ed0>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2412%252F17242412%252Finterior_rear_seats-1772125452903.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2412/17242412/interior_rear_seats-1772125452903.jpg saved to cache
2026-03-29 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd2000a4-db25-557c-ad30-4f556614595b
2026-03-29 20:14:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dab4fd0>
2026-03-29 20:14:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9878%252F19849878%252Fexterior_rear_driver-1774697185788.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_rear_driver-1774697185788.jpg saved to cache
2026-03-29 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 747c08ea-7ed8-5299-847c-922d249da7cc
2026-03-29 20:14:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 747c08ea-7ed8-5299-847c-922d249da7cc, skipping ID generation
2026-03-29 20:14:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747c08ea-7ed8-5299-847c-922d249da7cc with scrape type 1
2026-03-29 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 747c08ea-7ed8-5299-847c-922d249da7cc sending to next pipeline
2026-03-29 20:14:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 747c08ea-7ed8-5299-847c-922d249da7cc, identifier: 19849878
2026-03-29 20:14:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5aaa8302-e483-58d2-981c-e62c47996173 with identifier: 19488823
2026-03-29 20:14:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5aaa8302-e483-58d2-981c-e62c47996173 with identifier: 19488823
2026-03-29 20:14:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5aaa8302-e483-58d2-981c-e62c47996173 with identifier: 19488823 to the API
2026-03-29 20:14:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_front_passenger-1774625624720.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '5aaa8302-e483-58d2-981c-e62c47996173',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SC14 MYK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19488823',
'listing': 'auction',
'location': 'South Lanarkshire Hamilton',
'make': 'Volkswagen',
'model': 'Phaeton',
'odometer': 94857,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316110,
'Height': 1010,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_front_driver-1774625624520.jpg',
'Width': 1346},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245054,
'Height': 1003,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_rear_driver-1774625626479.jpg',
'Width': 1337},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325866,
'Height': 1078,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_front_passenger-1774625624720.jpg',
'Width': 1437},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257134,
'Height': 1038,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8823/19488823/exterior_rear_passenger-1774625625110.jpg',
'Width': 1384},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 909463,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/8823/19488823/interior_front_seats-1774627227385.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 982208,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/8823/19488823/interior_rear_seats-1774627225631.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243031,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8823/19488823/interior_dashboard-1774627240918.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112638,
'Height': 783,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8823/19488823/interior_boot-1774629509160.jpg',
'Width': 1044},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158356,
'Height': 1080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8823/19488823/docs_service_history-1774627509119.jpg?ixlib=js-3.8.0&auto=format&s=c42291515b37dbe14683dc61ff5f70b4',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aaa8302-e483-58d2-981c-e62c47996173/5aaa8302-e483-58d2-981c-e62c47996173_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 772684,
'Height': 1080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8823/19488823/docs_service_history-1774627541289.jpg?ixlib=js-3.8.0&auto=format&s=0d50a99f4b959e928ba86dc91806063a',
'Width': 1440}],
'price': 5238,
'price_includes_vat': False,
'registration_date': '2014-05-16',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Phaeton V6 4MOTION TDI Auto',
'transmission': 'automatic',
'trim': 'V6 4MOTION TDI Auto',
'vin': 'WVWZZZ3DZE8004164',
'year': 2014}
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719488823%27 HTTP/1.1" 200 None
2026-03-29 20:14:32 [motorway.uk] INFO: Saving data for 19488823: {'created_time': 1774815272.863147, 'last_price_update_time': 1774815272.863157, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19488823') HTTP/1.1" 204 0
2026-03-29 20:14:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 747c08ea-7ed8-5299-847c-922d249da7cc with identifier: 19849878
2026-03-29 20:14:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 747c08ea-7ed8-5299-847c-922d249da7cc with identifier: 19849878
2026-03-29 20:14:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 747c08ea-7ed8-5299-847c-922d249da7cc with identifier: 19849878 to the API
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_rear_driver-1774697185788.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '747c08ea-7ed8-5299-847c-922d249da7cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB65 UKO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19849878',
'listing': 'auction',
'location': 'Dundee City Council Dundee',
'make': 'Vauxhall',
'model': 'Adam',
'odometer': 43050,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 975174,
'Height': 2051,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_front_driver-1774697182756.jpg',
'Width': 2735},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 690744,
'Height': 1777,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_rear_driver-1774697185788.jpg',
'Width': 2369},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 578743,
'Height': 1785,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_front_passenger-1774697177114.jpg',
'Width': 2380},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632624,
'Height': 2171,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9878/19849878/exterior_rear_passenger-1774697188304.jpg',
'Width': 2894},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2273605,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9878/19849878/interior_front_seats-1774697633528.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2410631,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9878/19849878/interior_rear_seats-1774697708832.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1767066,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9878/19849878/interior_dashboard-1774697800426.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1940551,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9878/19849878/interior_boot-1774697539796.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1731278,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9878/19849878/docs_service_history-1774697937113.jpg?ixlib=js-3.8.0&auto=format&s=dc2c428de5eee82d264139ab7e2421f5',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c08ea-7ed8-5299-847c-922d249da7cc/747c08ea-7ed8-5299-847c-922d249da7cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1784478,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9878/19849878/docs_service_history-1774697967054.jpg?ixlib=js-3.8.0&auto=format&s=6977cd62d4587203ee078cda87e140f1',
'Width': 3840}],
'price': 4212,
'price_includes_vat': False,
'registration_date': '2015-11-02',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Adam Rocks',
'transmission': 'manual',
'trim': 'Rocks',
'vin': 'W0L0MAP08F6053142',
'year': 2015}
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719849878%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [motorway.uk] INFO: Saving data for 19849878: {'created_time': 1774815273.287422, 'last_price_update_time': 1774815273.287434, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19849878') HTTP/1.1" 204 0
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_rear_passenger-1774690253942.jpg> (referer: None)
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_rear_driver-1774690259587.jpg> (referer: None)
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_rear_driver-1772125601986.jpg> (referer: None)
2026-03-29 20:14:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_front_passenger-1772125565718.jpg> (referer: None)
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_rear_passenger-1772125587502.jpg> (referer: None)
2026-03-29 20:14:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_front_driver-1772125546533.jpg> (referer: None)
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_front_driver-1774690263525.jpg> (referer: None)
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d855bd0>
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2059%252F10152059%252Fexterior_rear_passenger-1774690253942.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_rear_passenger-1774690253942.jpg saved to cache
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_front_driver-1774009497099.jpg> (referer: None)
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de99510>
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2059%252F10152059%252Fexterior_rear_driver-1774690259587.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_rear_driver-1774690259587.jpg saved to cache
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9b43d0>
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2412%252F17242412%252Fexterior_rear_driver-1772125601986.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_rear_driver-1772125601986.jpg saved to cache
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd2000a4-db25-557c-ad30-4f556614595b
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ce8e290>
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2412%252F17242412%252Fexterior_front_passenger-1772125565718.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_front_passenger-1772125565718.jpg saved to cache
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd2000a4-db25-557c-ad30-4f556614595b
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de9ac90>
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2412%252F17242412%252Fexterior_rear_passenger-1772125587502.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_rear_passenger-1772125587502.jpg saved to cache
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd2000a4-db25-557c-ad30-4f556614595b
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5b4d90>
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2412%252F17242412%252Fexterior_front_driver-1772125546533.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_front_driver-1772125546533.jpg saved to cache
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd2000a4-db25-557c-ad30-4f556614595b
2026-03-29 20:14:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd2000a4-db25-557c-ad30-4f556614595b, skipping ID generation
2026-03-29 20:14:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd2000a4-db25-557c-ad30-4f556614595b with scrape type 1
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd2000a4-db25-557c-ad30-4f556614595b sending to next pipeline
2026-03-29 20:14:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bd2000a4-db25-557c-ad30-4f556614595b, identifier: 17242412
2026-03-29 20:14:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bd2000a4-db25-557c-ad30-4f556614595b with identifier: 17242412
2026-03-29 20:14:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bd2000a4-db25-557c-ad30-4f556614595b with identifier: 17242412
2026-03-29 20:14:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bd2000a4-db25-557c-ad30-4f556614595b with identifier: 17242412 to the API
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_front_driver-1772125546533.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bd2000a4-db25-557c-ad30-4f556614595b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB69 VGC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17242412',
'listing': 'auction',
'location': 'Falkirk Falkirk',
'make': 'MINI',
'model': 'Cooper',
'odometer': 37000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1306292,
'Height': 2540,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_front_driver-1772125546533.jpg',
'Width': 3386},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673274,
'Height': 1814,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_rear_driver-1772125601986.jpg',
'Width': 2419},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1172355,
'Height': 2522,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_front_passenger-1772125565718.jpg',
'Width': 3363},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1138870,
'Height': 2421,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2412/17242412/exterior_rear_passenger-1772125587502.jpg',
'Width': 3228},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2007162,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2412/17242412/interior_front_seats-1772125398212.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1624617,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2412/17242412/interior_rear_seats-1772125452903.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1627460,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2412/17242412/interior_dashboard-1772125854922.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1867233,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2412/17242412/interior_boot-1772384603744.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 12917,
'Height': 242,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2412/17242412/17242412-damage_missing_trims-modified-1772444097823.jpeg',
'Width': 323},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2000a4-db25-557c-ad30-4f556614595b/bd2000a4-db25-557c-ad30-4f556614595b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342983,
'Height': 1419,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2412/17242412/wheels_front_driver-1772125611110.jpg',
'Width': 1892}],
'price': 9653,
'price_includes_vat': False,
'registration_date': '2020-01-30',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper S Classic',
'transmission': 'manual',
'trim': 'S Classic',
'vin': 'WMWXR520702M54181',
'year': 2020}
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717242412%27 HTTP/1.1" 200 None
2026-03-29 20:14:34 [motorway.uk] INFO: Saving data for 17242412: {'created_time': 1774815274.461274, 'last_price_update_time': 1774815274.461284, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17242412') HTTP/1.1" 204 0
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c91b1d0>
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2059%252F10152059%252Fexterior_front_driver-1774690263525.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_front_driver-1774690263525.jpg saved to cache
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05
2026-03-29 20:14:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05, skipping ID generation
2026-03-29 20:14:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05 with scrape type 1
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05 sending to next pipeline
2026-03-29 20:14:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05, identifier: 10152059
2026-03-29 20:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_rear_driver-1774009501110.jpg> (referer: None)
2026-03-29 20:14:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05 with identifier: 10152059
2026-03-29 20:14:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05 with identifier: 10152059
2026-03-29 20:14:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6e96f6f8-aa47-5a22-a3ac-125b32dc0c05 with identifier: 10152059 to the API
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_front_driver-1774690263525.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6e96f6f8-aa47-5a22-a3ac-125b32dc0c05',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KX13 LYV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10152059',
'listing': 'auction',
'location': 'Monmouthshire Abergavenny',
'make': 'SEAT',
'model': 'Ibiza',
'odometer': 93269,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 896053,
'Height': 2105,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_front_driver-1774690263525.jpg',
'Width': 2807},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464961,
'Height': 2224,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_rear_driver-1774690259587.jpg',
'Width': 2965},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489228,
'Height': 1947,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_front_passenger-1774690300956.jpg',
'Width': 2596},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512278,
'Height': 2266,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2059/10152059/exterior_rear_passenger-1774690253942.jpg',
'Width': 3021},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1242050,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/2059/10152059/interior_front_seats-1774690882315.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1627889,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/2059/10152059/interior_rear_seats-1774690889230.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1062401,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2059/10152059/interior_dashboard-1774690924883.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534666,
'Height': 2206,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2059/10152059/instrument_cluster-1774714854851.jpg',
'Width': 2941},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1112811,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/2059/10152059/interior_boot-1774690885713.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e96f6f8-aa47-5a22-a3ac-125b32dc0c05/6e96f6f8-aa47-5a22-a3ac-125b32dc0c05_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1213826,
'Height': 3072,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2059/10152059/docs_service_history-1774692744135.jpg?ixlib=js-3.8.0&auto=format&s=bd632658dd61603c6a26d834c505695f',
'Width': 4080}],
'price': 3199,
'price_includes_vat': False,
'registration_date': '2013-03-01',
'seats_number': None,
'seller_name': None,
'title': 'SEAT Ibiza FR TSI S-A',
'transmission': 'automatic',
'trim': 'FR TSI S-A',
'vin': 'VSSZZZ6JZDR132269',
'year': 2013}
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710152059%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [motorway.uk] INFO: Saving data for 10152059: {'created_time': 1774815275.288103, 'last_price_update_time': 1774815275.288117, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10152059') HTTP/1.1" 204 0
2026-03-29 20:14:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c4dc750>
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6573%252F20296573%252Fexterior_front_driver-1774009497099.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_front_driver-1774009497099.jpg saved to cache
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56
2026-03-29 20:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20501873.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db8bb90>
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6573%252F20296573%252Fexterior_rear_driver-1774009501110.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_rear_driver-1774009501110.jpg saved to cache
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56
2026-03-29 20:14:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 484fe803-6f2f-5ca0-aa2c-8d0e42308b56, skipping ID generation
2026-03-29 20:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56 with scrape type 1
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 484fe803-6f2f-5ca0-aa2c-8d0e42308b56 sending to next pipeline
2026-03-29 20:14:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 484fe803-6f2f-5ca0-aa2c-8d0e42308b56, identifier: 20296573
2026-03-29 20:14:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 484fe803-6f2f-5ca0-aa2c-8d0e42308b56 with identifier: 20296573
2026-03-29 20:14:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 484fe803-6f2f-5ca0-aa2c-8d0e42308b56 with identifier: 20296573
2026-03-29 20:14:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 484fe803-6f2f-5ca0-aa2c-8d0e42308b56 with identifier: 20296573 to the API
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_rear_driver-1774009501110.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '484fe803-6f2f-5ca0-aa2c-8d0e42308b56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML05 ODK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20296573',
'listing': 'auction',
'location': 'Greater Manchester Manchester',
'make': 'MINI',
'model': 'Cooper',
'odometer': 51287,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106580,
'Height': 681,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_front_driver-1774009497099.jpg',
'Width': 908},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122461,
'Height': 677,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_rear_driver-1774009501110.jpg',
'Width': 903},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90486,
'Height': 644,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_front_passenger-1774009502248.jpg',
'Width': 859},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99566,
'Height': 686,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6573/20296573/exterior_rear_passenger-1774009498175.jpg',
'Width': 914},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147492,
'Height': 768,
'OriginUrl': 'https://motorway-photos.imgix.net/6573/20296573/interior_front_seats-1774011549403.jpg',
'Width': 1020},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176735,
'Height': 768,
'OriginUrl': 'https://motorway-photos.imgix.net/6573/20296573/interior_rear_seats-1774011437834.jpg',
'Width': 1020},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120536,
'Height': 768,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6573/20296573/interior_dashboard-1774011450105.jpg',
'Width': 1020},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37867,
'Height': 379,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6573/20296573/instrument_cluster-1774691665409.jpg',
'Width': 505},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123542,
'Height': 768,
'OriginUrl': 'https://motorway-photos.imgix.net/6573/20296573/interior_boot-1774011440302.jpg',
'Width': 1020},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_484fe803-6f2f-5ca0-aa2c-8d0e42308b56/484fe803-6f2f-5ca0-aa2c-8d0e42308b56_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77194,
'Height': 768,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6573/20296573/docs_service_history-1774012483622.jpg?ixlib=js-3.8.0&auto=format&s=31b50a438ce6e77b7a845c5572aa90ad',
'Width': 1020}],
'price': 1439,
'price_includes_vat': False,
'registration_date': '2005-04-11',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'vin': 'WMWRC320X0TG57397',
'year': 2005}
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720296573%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [motorway.uk] INFO: Saving data for 20296573: {'created_time': 1774815275.90251, 'last_price_update_time': 1774815275.902521, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20296573') HTTP/1.1" 204 0
2026-03-29 20:14:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec66446d-b8d8-5987-9729-84bbb7985dc6 with identifier: 20501873
2026-03-29 20:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec66446d-b8d8-5987-9729-84bbb7985dc6 with scrape type 1
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec66446d-b8d8-5987-9729-84bbb7985dc6
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1873%252F20501873%252Fexterior_front_driver-1774783785523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_front_driver-1774783785523.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1873%252F20501873%252Fexterior_rear_driver-1774783823831.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_rear_driver-1774783823831.jpg not downloaded yet
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1873%252F20501873%252Fexterior_front_passenger-1774783840899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_front_passenger-1774783840899.jpg not downloaded yet
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1873%252F20501873%252Fexterior_rear_passenger-1774783830405.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_rear_passenger-1774783830405.jpg not downloaded yet
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1873%252F20501873%252Finterior_front_seats-1774784116870.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1873/20501873/interior_front_seats-1774784116870.jpg not downloaded yet
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1873%252F20501873%252Finterior_rear_seats-1774784130919.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1873/20501873/interior_rear_seats-1774784130919.jpg not downloaded yet
2026-03-29 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8400/10468400/docs_service_history-1774199173752.jpg?ixlib=js-3.8.0&auto=format&s=f0a2a2cca4f50ff52309a141e87718ea> (referer: None)
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1873%252F20501873%252Finterior_dashboard-1774784157444.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1873/20501873/interior_dashboard-1774784157444.jpg not downloaded yet
2026-03-29 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8400/10468400/docs_service_history-1774198842305.jpg?ixlib=js-3.8.0&auto=format&s=56bbd0df3c3c660436f0bb847c5a732d> (referer: None)
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1873%252F20501873%252Finstrument_cluster-1774784229250.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1873/20501873/instrument_cluster-1774784229250.jpg not downloaded yet
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1873%252F20501873%252Finterior_boot-1774784171953.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1873/20501873/interior_boot-1774784171953.jpg not downloaded yet
2026-03-29 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5263/20465263/docs_service_history-1774776636580.jpg?ixlib=js-3.8.0&auto=format&s=1b8e1d4ec3054809d693db345f86e1a8> (referer: None)
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1873%252F20501873%252Fdocs_service_history-1774784335981.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D508c9515e602ffb4e3476ebe51fef7c6%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1873/20501873/docs_service_history-1774784335981.jpg?ixlib=js-3.8.0&auto=format&s=508c9515e602ffb4e3476ebe51fef7c6 not downloaded yet
2026-03-29 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9574/20499574/20499574-interior_dashboard-modified-1774775764898.jpeg> (referer: None)
2026-03-29 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3132/20493132/interior_rear_seats-1774789833095.jpg> (referer: None)
2026-03-29 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9574/20499574/interior_rear_seats-1774773279941.jpeg> (referer: None)
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5fbdd0>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8400%252F10468400%252Fdocs_service_history-1774199173752.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df0a2a2cca4f50ff52309a141e87718ea') HTTP/1.1" 204 0
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8400/10468400/docs_service_history-1774199173752.jpg?ixlib=js-3.8.0&auto=format&s=f0a2a2cca4f50ff52309a141e87718ea saved to cache
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd
2026-03-29 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3132/20493132/interior_boot-1774789621494.jpg> (referer: None)
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc7cd50>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8400%252F10468400%252Fdocs_service_history-1774198842305.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D56bbd0df3c3c660436f0bb847c5a732d') HTTP/1.1" 204 0
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8400/10468400/docs_service_history-1774198842305.jpg?ixlib=js-3.8.0&auto=format&s=56bbd0df3c3c660436f0bb847c5a732d saved to cache
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5f9810>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5263%252F20465263%252Fdocs_service_history-1774776636580.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1b8e1d4ec3054809d693db345f86e1a8') HTTP/1.1" 204 0
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5263/20465263/docs_service_history-1774776636580.jpg?ixlib=js-3.8.0&auto=format&s=1b8e1d4ec3054809d693db345f86e1a8 saved to cache
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d4064e2-a7b1-5519-aacc-b721c07abb14
2026-03-29 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9574/20499574/docs_service_history-1774773644445.jpeg?ixlib=js-3.8.0&auto=format&s=a8272c3a669f1569d48690c18f835283> (referer: None)
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c76a2d0>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9574%252F20499574%252F20499574-interior_dashboard-modified-1774775764898.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9574/20499574/20499574-interior_dashboard-modified-1774775764898.jpeg saved to cache
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c617631-d477-53f0-9013-04dac1b260d1
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0af610>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3132%252F20493132%252Finterior_rear_seats-1774789833095.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3132/20493132/interior_rear_seats-1774789833095.jpg saved to cache
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d6de18a-54a0-510f-9318-0376c613b6ed
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003\x17@\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02S\x8f\x003\r8\x00\x00\x00\x00'
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c507d90>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9574%252F20499574%252Finterior_rear_seats-1774773279941.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9574/20499574/interior_rear_seats-1774773279941.jpeg saved to cache
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c617631-d477-53f0-9013-04dac1b260d1
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d434510>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3132%252F20493132%252Finterior_boot-1774789621494.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3132/20493132/interior_boot-1774789621494.jpg saved to cache
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d6de18a-54a0-510f-9318-0376c613b6ed
2026-03-29 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9574/20499574/interior_boot-1774773320947.jpeg> (referer: None)
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cebd690>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9574%252F20499574%252Fdocs_service_history-1774773644445.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da8272c3a669f1569d48690c18f835283') HTTP/1.1" 204 0
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9574/20499574/docs_service_history-1774773644445.jpeg?ixlib=js-3.8.0&auto=format&s=a8272c3a669f1569d48690c18f835283 saved to cache
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c617631-d477-53f0-9013-04dac1b260d1
2026-03-29 20:14:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00>\xf6\x7f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03H\xd0\x00>\xecw\x00\x00\x00\x00'
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d605d90>
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9574%252F20499574%252Finterior_boot-1774773320947.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9574/20499574/interior_boot-1774773320947.jpeg saved to cache
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c617631-d477-53f0-9013-04dac1b260d1
2026-03-29 20:14:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c617631-d477-53f0-9013-04dac1b260d1, skipping ID generation
2026-03-29 20:14:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c617631-d477-53f0-9013-04dac1b260d1 with scrape type 1
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c617631-d477-53f0-9013-04dac1b260d1 sending to next pipeline
2026-03-29 20:14:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7c617631-d477-53f0-9013-04dac1b260d1, identifier: 20499574
2026-03-29 20:14:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7c617631-d477-53f0-9013-04dac1b260d1 with identifier: 20499574
2026-03-29 20:14:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7c617631-d477-53f0-9013-04dac1b260d1 with identifier: 20499574
2026-03-29 20:14:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7c617631-d477-53f0-9013-04dac1b260d1 with identifier: 20499574 to the API
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9574/20499574/interior_boot-1774773320947.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7c617631-d477-53f0-9013-04dac1b260d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'M70 DLR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20499574',
'listing': 'auction',
'location': 'Aberdeenshire Stonehaven',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 26149,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2332199,
'Height': 2439,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9574/20499574/exterior_front_driver-1774773142762.jpeg',
'Width': 3252},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2865196,
'Height': 2663,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9574/20499574/exterior_rear_driver-1774773233639.jpeg',
'Width': 3551},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3320767,
'Height': 2656,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9574/20499574/20499574-exterior_front_passenger-modified-1774775787070.jpeg',
'Width': 3541},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2743753,
'Height': 2609,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9574/20499574/exterior_rear_passenger-1774773217421.jpeg',
'Width': 3479},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3329300,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9574/20499574/20499574-interior_front_seats-modified-1774775774630.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3500751,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9574/20499574/interior_rear_seats-1774773279941.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2587355,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9574/20499574/20499574-interior_dashboard-modified-1774775764898.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4341583,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9574/20499574/interior_boot-1774773320947.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3864731,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9574/20499574/docs_service_history-1774773644445.jpeg?ixlib=js-3.8.0&auto=format&s=a8272c3a669f1569d48690c18f835283',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c617631-d477-53f0-9013-04dac1b260d1/7c617631-d477-53f0-9013-04dac1b260d1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1047566,
'Height': 1912,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9574/20499574/wheels_front_driver-1774773364969.jpeg',
'Width': 2549}],
'price': 14099,
'price_includes_vat': False,
'registration_date': '2024-01-30',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Karoq SE Drive TSI',
'transmission': 'manual',
'trim': 'SE Drive TSI',
'vin': 'TMBKP7NUXP5091140',
'year': 2024}
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499574%27 HTTP/1.1" 200 None
2026-03-29 20:14:37 [motorway.uk] INFO: Saving data for 20499574: {'created_time': 1774815277.765678, 'last_price_update_time': 1774815277.765689, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20499574') HTTP/1.1" 204 0
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3132/20493132/interior_front_seats-1774793868340.jpg> (referer: None)
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_front_passenger-1774783840899.jpg> (referer: None)
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_rear_passenger-1774783830405.jpg> (referer: None)
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_rear_driver-1774783823831.jpg> (referer: None)
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1873/20501873/interior_boot-1774784171953.jpg> (referer: None)
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1873/20501873/docs_service_history-1774784335981.jpg?ixlib=js-3.8.0&auto=format&s=508c9515e602ffb4e3476ebe51fef7c6> (referer: None)
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1873/20501873/interior_front_seats-1774784116870.jpg> (referer: None)
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1873/20501873/interior_rear_seats-1774784130919.jpg> (referer: None)
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1873/20501873/interior_dashboard-1774784157444.jpg> (referer: None)
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dccee50>
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3132%252F20493132%252Finterior_front_seats-1774793868340.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3132/20493132/interior_front_seats-1774793868340.jpg saved to cache
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d6de18a-54a0-510f-9318-0376c613b6ed
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d91e5d0>
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1873%252F20501873%252Fexterior_front_passenger-1774783840899.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_front_passenger-1774783840899.jpg saved to cache
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec66446d-b8d8-5987-9729-84bbb7985dc6
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f38cf10>
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1873%252F20501873%252Fexterior_rear_passenger-1774783830405.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_rear_passenger-1774783830405.jpg saved to cache
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec66446d-b8d8-5987-9729-84bbb7985dc6
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3e22d0>
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1873%252F20501873%252Fexterior_rear_driver-1774783823831.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_rear_driver-1774783823831.jpg saved to cache
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec66446d-b8d8-5987-9729-84bbb7985dc6
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f26aed0>
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1873%252F20501873%252Finterior_boot-1774784171953.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1873/20501873/interior_boot-1774784171953.jpg saved to cache
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec66446d-b8d8-5987-9729-84bbb7985dc6
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d91cc50>
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1873%252F20501873%252Fdocs_service_history-1774784335981.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D508c9515e602ffb4e3476ebe51fef7c6') HTTP/1.1" 204 0
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1873/20501873/docs_service_history-1774784335981.jpg?ixlib=js-3.8.0&auto=format&s=508c9515e602ffb4e3476ebe51fef7c6 saved to cache
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec66446d-b8d8-5987-9729-84bbb7985dc6
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de0ce90>
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1873%252F20501873%252Finterior_front_seats-1774784116870.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1873/20501873/interior_front_seats-1774784116870.jpg saved to cache
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec66446d-b8d8-5987-9729-84bbb7985dc6
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db87710>
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1873%252F20501873%252Finterior_rear_seats-1774784130919.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1873/20501873/interior_rear_seats-1774784130919.jpg saved to cache
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec66446d-b8d8-5987-9729-84bbb7985dc6
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6800d0>
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1873%252F20501873%252Finterior_dashboard-1774784157444.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1873/20501873/interior_dashboard-1774784157444.jpg saved to cache
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec66446d-b8d8-5987-9729-84bbb7985dc6
2026-03-29 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1873/20501873/instrument_cluster-1774784229250.jpg> (referer: None)
2026-03-29 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_front_driver-1774783785523.jpg> (referer: None)
2026-03-29 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_rear_passenger-1774788734996.jpg> (referer: None)
2026-03-29 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8400/10468400/interior_boot-1774198662165.jpg> (referer: None)
2026-03-29 20:14:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d479b90>
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1873%252F20501873%252Finstrument_cluster-1774784229250.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1873/20501873/instrument_cluster-1774784229250.jpg saved to cache
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec66446d-b8d8-5987-9729-84bbb7985dc6
2026-03-29 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18634070.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd37cd0>
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1873%252F20501873%252Fexterior_front_driver-1774783785523.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_front_driver-1774783785523.jpg saved to cache
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec66446d-b8d8-5987-9729-84bbb7985dc6
2026-03-29 20:14:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec66446d-b8d8-5987-9729-84bbb7985dc6, skipping ID generation
2026-03-29 20:14:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec66446d-b8d8-5987-9729-84bbb7985dc6 with scrape type 1
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec66446d-b8d8-5987-9729-84bbb7985dc6 sending to next pipeline
2026-03-29 20:14:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ec66446d-b8d8-5987-9729-84bbb7985dc6, identifier: 20501873
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d47b4d0>
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3132%252F20493132%252Fexterior_rear_passenger-1774788734996.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_rear_passenger-1774788734996.jpg saved to cache
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d6de18a-54a0-510f-9318-0376c613b6ed
2026-03-29 20:14:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4de450>
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8400%252F10468400%252Finterior_boot-1774198662165.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8400/10468400/interior_boot-1774198662165.jpg saved to cache
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd
2026-03-29 20:14:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ec66446d-b8d8-5987-9729-84bbb7985dc6 with identifier: 20501873
2026-03-29 20:14:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ec66446d-b8d8-5987-9729-84bbb7985dc6 with identifier: 20501873
2026-03-29 20:14:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ec66446d-b8d8-5987-9729-84bbb7985dc6 with identifier: 20501873 to the API
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_front_driver-1774783785523.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ec66446d-b8d8-5987-9729-84bbb7985dc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV17 ZHL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20501873',
'listing': 'auction',
'location': 'Dumfries and Galloway Annan',
'make': 'Audi',
'model': 'A3',
'odometer': 66400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1538126,
'Height': 2468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_front_driver-1774783785523.jpg',
'Width': 3291},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1263193,
'Height': 2304,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_rear_driver-1774783823831.jpg',
'Width': 3072},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1212415,
'Height': 2413,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_front_passenger-1774783840899.jpg',
'Width': 3217},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1441300,
'Height': 2557,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1873/20501873/exterior_rear_passenger-1774783830405.jpg',
'Width': 3409},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4156905,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1873/20501873/interior_front_seats-1774784116870.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4444759,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1873/20501873/interior_rear_seats-1774784130919.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3811973,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1873/20501873/interior_dashboard-1774784157444.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2777070,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1873/20501873/instrument_cluster-1774784229250.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3231786,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1873/20501873/interior_boot-1774784171953.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec66446d-b8d8-5987-9729-84bbb7985dc6/ec66446d-b8d8-5987-9729-84bbb7985dc6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3422318,
'Height': 3403,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1873/20501873/docs_service_history-1774784335981.jpg?ixlib=js-3.8.0&auto=format&s=508c9515e602ffb4e3476ebe51fef7c6',
'Width': 2203}],
'price': 8818,
'price_includes_vat': False,
'registration_date': '2017-04-26',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 S Line Black Edition TDI',
'transmission': 'manual',
'trim': 'S Line Black Edition TDI',
'vin': 'WAUZZZ8V4HA123787',
'year': 2017}
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720501873%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [motorway.uk] INFO: Saving data for 20501873: {'created_time': 1774815280.334251, 'last_price_update_time': 1774815280.334262, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20501873') HTTP/1.1" 204 0
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5263/20465263/docs_service_history-1774776543516.jpg?ixlib=js-3.8.0&auto=format&s=3e4cb6f5de24816ad3aed5ec1f032e09> (referer: None)
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1800&page=50&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae1f849a-ea8e-5713-a9ad-0ce436446430 with identifier: 18634070
2026-03-29 20:14:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae1f849a-ea8e-5713-a9ad-0ce436446430 with scrape type 1
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae1f849a-ea8e-5713-a9ad-0ce436446430
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F18634070%252Fexterior_front_driver-1774451924506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/18634070/exterior_front_driver-1774451924506.jpg not downloaded yet
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F18634070%252Fexterior_rear_driver-1774451951790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/18634070/exterior_rear_driver-1774451951790.jpg not downloaded yet
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F18634070%252Fexterior_front_passenger-1774451951167.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/18634070/exterior_front_passenger-1774451951167.jpg not downloaded yet
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F18634070%252Fexterior_rear_passenger-1774451939379.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/18634070/exterior_rear_passenger-1774451939379.jpg not downloaded yet
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4070%252F18634070%252Finterior_front_seats-1774452375694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4070/18634070/interior_front_seats-1774452375694.jpg not downloaded yet
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9c71d0>
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5263%252F20465263%252Fdocs_service_history-1774776543516.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3e4cb6f5de24816ad3aed5ec1f032e09') HTTP/1.1" 204 0
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5263/20465263/docs_service_history-1774776543516.jpg?ixlib=js-3.8.0&auto=format&s=3e4cb6f5de24816ad3aed5ec1f032e09 saved to cache
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d4064e2-a7b1-5519-aacc-b721c07abb14
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4070%252F18634070%252Finterior_rear_seats-1774452387711.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4070/18634070/interior_rear_seats-1774452387711.jpg not downloaded yet
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F18634070%252Finterior_dashboard-1774452410786.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/18634070/interior_dashboard-1774452410786.jpg not downloaded yet
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 19659206
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719659206%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [motorway.uk] INFO: Scrape type for 19659206: 1
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_front_passenger-1774788746390.jpg> (referer: None)
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F18634070%252Finstrument_cluster-1774452414091.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/18634070/instrument_cluster-1774452414091.jpg not downloaded yet
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20486301
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 13628188
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20499822
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499822%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [motorway.uk] INFO: Scrape type for 20499822: 1
2026-03-29 20:14:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4070%252F18634070%252Finterior_boot-1774452419001.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4070/18634070/interior_boot-1774452419001.jpg not downloaded yet
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20445729
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 14604546
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20390558
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 15355035
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20327715
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720327715%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [motorway.uk] INFO: Scrape type for 20327715: 1
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F18634070%252Fwheels_front_driver-1774452021632.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/18634070/wheels_front_driver-1774452021632.jpg not downloaded yet
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20153651
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720153651%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [motorway.uk] INFO: Scrape type for 20153651: 1
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 19271642
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20411548
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720411548%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [motorway.uk] INFO: Scrape type for 20411548: 1
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6c1250>
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3132%252F20493132%252Fexterior_front_passenger-1774788746390.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_front_passenger-1774788746390.jpg saved to cache
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d6de18a-54a0-510f-9318-0376c613b6ed
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 11207891
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711207891%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [motorway.uk] INFO: Scrape type for 11207891: 1
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8400/10468400/interior_front_seats-1774630411116.jpg> (referer: None)
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20495052
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 9228073
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20303426
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720303426%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [motorway.uk] INFO: Scrape type for 20303426: 1
2026-03-29 20:14:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_rear_driver-1774788730487.jpg> (referer: None)
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20423847
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 8941905
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 13648789
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713648789%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [motorway.uk] INFO: Scrape type for 13648789: 1
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20482465
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20467456
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20495694
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720495694%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [motorway.uk] INFO: Scrape type for 20495694: 1
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 12555928
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 19119674
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20427329
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720427329%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [motorway.uk] INFO: Scrape type for 20427329: 1
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7137/20457137/interior_rear_seats-1774711235827.jpg> (referer: None)
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 18206476
2026-03-29 20:14:40 [motorway.uk] INFO: Found listing with ID: 20489914
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489914%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [motorway.uk] INFO: Scrape type for 20489914: 1
2026-03-29 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_front_driver-1774775328401.jpg> (referer: None)
2026-03-29 20:14:41 [motorway.uk] INFO: Found listing with ID: 20445502
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720445502%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [motorway.uk] INFO: Scrape type for 20445502: 1
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d08c650>
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8400%252F10468400%252Finterior_front_seats-1774630411116.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8400/10468400/interior_front_seats-1774630411116.jpg saved to cache
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd
2026-03-29 20:14:41 [motorway.uk] INFO: Found listing with ID: 20454302
2026-03-29 20:14:41 [motorway.uk] INFO: Found listing with ID: 18721041
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718721041%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [motorway.uk] INFO: Scrape type for 18721041: 1
2026-03-29 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19211859.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20446457.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d483290>
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3132%252F20493132%252Fexterior_rear_driver-1774788730487.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_rear_driver-1774788730487.jpg saved to cache
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d6de18a-54a0-510f-9318-0376c613b6ed
2026-03-29 20:14:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d6de18a-54a0-510f-9318-0376c613b6ed, skipping ID generation
2026-03-29 20:14:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d6de18a-54a0-510f-9318-0376c613b6ed with scrape type 1
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d6de18a-54a0-510f-9318-0376c613b6ed sending to next pipeline
2026-03-29 20:14:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6d6de18a-54a0-510f-9318-0376c613b6ed, identifier: 20493132
2026-03-29 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2067/17822067/interior_dashboard-1774512869945.jpg> (referer: None)
2026-03-29 20:14:41 [motorway.uk] INFO: Found listing with ID: 13280903
2026-03-29 20:14:41 [motorway.uk] INFO: Found listing with ID: 20417440
2026-03-29 20:14:41 [motorway.uk] INFO: Found listing with ID: 12910832
2026-03-29 20:14:41 [motorway.uk] INFO: Found listing with ID: 19849552
2026-03-29 20:14:41 [motorway.uk] INFO: Found listing with ID: 19683133
2026-03-29 20:14:41 [motorway.uk] INFO: Found listing with ID: 17791322
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717791322%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [motorway.uk] INFO: Scrape type for 17791322: 1
2026-03-29 20:14:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6d6de18a-54a0-510f-9318-0376c613b6ed with identifier: 20493132
2026-03-29 20:14:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6d6de18a-54a0-510f-9318-0376c613b6ed with identifier: 20493132
2026-03-29 20:14:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6d6de18a-54a0-510f-9318-0376c613b6ed with identifier: 20493132 to the API
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_rear_driver-1774788730487.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6d6de18a-54a0-510f-9318-0376c613b6ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT13 XWZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20493132',
'listing': 'auction',
'location': 'Hertfordshire Hoddesdon',
'make': 'BMW',
'model': '1 Series',
'odometer': 75000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1889281,
'Height': 2413,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_front_driver-1774788755085.jpg',
'Width': 3217},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3031504,
'Height': 2974,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_rear_driver-1774788730487.jpg',
'Width': 3965},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1314156,
'Height': 2273,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_front_passenger-1774788746390.jpg',
'Width': 3031},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1881511,
'Height': 2624,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3132/20493132/exterior_rear_passenger-1774788734996.jpg',
'Width': 3498},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1517934,
'Height': 2229,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3132/20493132/interior_front_seats-1774793868340.jpg',
'Width': 2972},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2990107,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3132/20493132/interior_rear_seats-1774789833095.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3513192,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3132/20493132/interior_dashboard-1774792236984.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4354415,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3132/20493132/interior_boot-1774789621494.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442026,
'Height': 2193,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3132/20493132/docs_service_history-1774790416243.jpg?ixlib=js-3.8.0&auto=format&s=1d5ae5f6a1e79adb350f9d934a228f88',
'Width': 1645},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6de18a-54a0-510f-9318-0376c613b6ed/6d6de18a-54a0-510f-9318-0376c613b6ed_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 624143,
'Height': 2193,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3132/20493132/docs_service_history-1774790744831.jpg?ixlib=js-3.8.0&auto=format&s=7d75913bd2c01946aa08781a1c0b3db7',
'Width': 1645}],
'price': 2821,
'price_includes_vat': False,
'registration_date': '2013-03-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW 114I Sport',
'transmission': 'manual',
'trim': '114I Sport',
'vin': 'WBA1P12000J157781',
'year': 2013}
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720493132%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [motorway.uk] INFO: Saving data for 20493132: {'created_time': 1774815281.908735, 'last_price_update_time': 1774815281.908749, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20493132') HTTP/1.1" 204 0
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0508d0>
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ab5cb8-930a-5d56-9684-1a95377f97dd/c5ab5cb8-930a-5d56-9684-1a95377f97dd_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7137%252F20457137%252Finterior_rear_seats-1774711235827.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7137/20457137/interior_rear_seats-1774711235827.jpg saved to cache
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5ab5cb8-930a-5d56-9684-1a95377f97dd
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7ea8d0>
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5263%252F20465263%252Fexterior_front_driver-1774775328401.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_front_driver-1774775328401.jpg saved to cache
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d4064e2-a7b1-5519-aacc-b721c07abb14
2026-03-29 20:14:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efe991eb-4e50-5425-bd46-011e05d0fbd5 with identifier: 19211859
2026-03-29 20:14:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe991eb-4e50-5425-bd46-011e05d0fbd5 with scrape type 1
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efe991eb-4e50-5425-bd46-011e05d0fbd5
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1859%252F19211859%252Fexterior_front_driver-1774781232081.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1859/19211859/exterior_front_driver-1774781232081.jpg not downloaded yet
2026-03-29 20:14:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47 with identifier: 20446457
2026-03-29 20:14:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47 with scrape type 1
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6457%252F20446457%252Fexterior_front_driver-1774702645890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_front_driver-1774702645890.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1859%252F19211859%252Fexterior_rear_driver-1774778908399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1859/19211859/exterior_rear_driver-1774778908399.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6457%252F20446457%252Fexterior_rear_driver-1774702667106.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_rear_driver-1774702667106.jpg not downloaded yet
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db89490>
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_678c912c-4955-5d44-a7da-001f6794bc22/678c912c-4955-5d44-a7da-001f6794bc22_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2067%252F17822067%252Finterior_dashboard-1774512869945.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2067/17822067/interior_dashboard-1774512869945.jpg saved to cache
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 678c912c-4955-5d44-a7da-001f6794bc22
2026-03-29 20:14:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1859%252F19211859%252Fexterior_front_passenger-1774778957086.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1859/19211859/exterior_front_passenger-1774778957086.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6457%252F20446457%252Fexterior_front_passenger-1774702711369.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_front_passenger-1774702711369.jpg not downloaded yet
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5263/20465263/interior_dashboard-1774776085669.jpg> (referer: None)
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8400/10468400/interior_dashboard-1774198576932.jpg> (referer: None)
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1859%252F19211859%252Fexterior_rear_passenger-1774778918873.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1859/19211859/exterior_rear_passenger-1774778918873.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6457%252F20446457%252Fexterior_rear_passenger-1774702681198.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_rear_passenger-1774702681198.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1859%252F19211859%252Finterior_front_seats-1774779573109.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1859/19211859/interior_front_seats-1774779573109.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6457%252F20446457%252Finterior_front_seats-1774703248445.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6457/20446457/interior_front_seats-1774703248445.jpg not downloaded yet
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8400/10468400/interior_rear_seats-1774198381026.jpg> (referer: None)
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1859%252F19211859%252Finterior_rear_seats-1774779593646.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1859/19211859/interior_rear_seats-1774779593646.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6457%252F20446457%252Finterior_rear_seats-1774703260952.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6457/20446457/interior_rear_seats-1774703260952.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1859%252F19211859%252Finterior_dashboard-1774781188065.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1859/19211859/interior_dashboard-1774781188065.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6457%252F20446457%252Finterior_dashboard-1774703392513.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6457/20446457/interior_dashboard-1774703392513.jpg not downloaded yet
2026-03-29 20:14:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d47bc90>
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5263%252F20465263%252Finterior_dashboard-1774776085669.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5263/20465263/interior_dashboard-1774776085669.jpg saved to cache
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d4064e2-a7b1-5519-aacc-b721c07abb14
2026-03-29 20:14:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d586ad0>
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8400%252F10468400%252Finterior_dashboard-1774198576932.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8400/10468400/interior_dashboard-1774198576932.jpg saved to cache
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5263/20465263/interior_boot-1774776016307.jpg> (referer: None)
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1859%252F19211859%252Finstrument_cluster-1774779682918.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1859/19211859/instrument_cluster-1774779682918.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6457%252F20446457%252Finterior_boot-1774703348137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6457/20446457/interior_boot-1774703348137.jpg not downloaded yet
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1859%252F19211859%252Finterior_boot-1774779615803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1859/19211859/interior_boot-1774779615803.jpg not downloaded yet
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6457%252F20446457%252Fdocs_service_history-1774704033760.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D684a9a23da6315cf5316e30111b917de%27 HTTP/1.1" 200 None
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6457/20446457/docs_service_history-1774704033760.jpg?ixlib=js-3.8.0&auto=format&s=684a9a23da6315cf5316e30111b917de not downloaded yet
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1859%252F19211859%252Fdocs_service_history-1774780040909.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D23a62db8ba97472e11dd3f787b99ee94%27 HTTP/1.1" 200 None
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1859/19211859/docs_service_history-1774780040909.jpg?ixlib=js-3.8.0&auto=format&s=23a62db8ba97472e11dd3f787b99ee94 not downloaded yet
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6457%252F20446457%252F20446457-damage_scratches-modified-1774705024389.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6457/20446457/20446457-damage_scratches-modified-1774705024389.jpeg not downloaded yet
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e039510>
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8400%252F10468400%252Finterior_rear_seats-1774198381026.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8400/10468400/interior_rear_seats-1774198381026.jpg saved to cache
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd
2026-03-29 20:14:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9b6f9e5-6c76-5bed-9137-08543c44d2bd, skipping ID generation
2026-03-29 20:14:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd with scrape type 1
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9b6f9e5-6c76-5bed-9137-08543c44d2bd sending to next pipeline
2026-03-29 20:14:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f9b6f9e5-6c76-5bed-9137-08543c44d2bd, identifier: 10468400
2026-03-29 20:14:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f9b6f9e5-6c76-5bed-9137-08543c44d2bd with identifier: 10468400
2026-03-29 20:14:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f9b6f9e5-6c76-5bed-9137-08543c44d2bd with identifier: 10468400
2026-03-29 20:14:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f9b6f9e5-6c76-5bed-9137-08543c44d2bd with identifier: 10468400 to the API
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8400/10468400/interior_rear_seats-1774198381026.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f9b6f9e5-6c76-5bed-9137-08543c44d2bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'PE57 YRX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10468400',
'listing': 'auction',
'location': 'Borough of Halton Widnes',
'make': 'Honda',
'model': 'Civic',
'odometer': 81348,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2861958,
'Height': 3015,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8400/10468400/exterior_front_driver-1774629755797.jpg',
'Width': 4020},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2869704,
'Height': 2928,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8400/10468400/exterior_rear_driver-1774630362689.jpg',
'Width': 3904},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1840628,
'Height': 2810,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8400/10468400/exterior_front_passenger-1774197287298.jpg',
'Width': 3747},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1988575,
'Height': 2875,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8400/10468400/exterior_rear_passenger-1774197213026.jpg',
'Width': 3833},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2969753,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8400/10468400/interior_front_seats-1774630411116.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3695839,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8400/10468400/interior_rear_seats-1774198381026.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3145611,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8400/10468400/interior_dashboard-1774198576932.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4220068,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8400/10468400/interior_boot-1774198662165.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 941200,
'Height': 2107,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8400/10468400/docs_service_history-1774198842305.jpg?ixlib=js-3.8.0&auto=format&s=56bbd0df3c3c660436f0bb847c5a732d',
'Width': 2907},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6f9e5-6c76-5bed-9137-08543c44d2bd/f9b6f9e5-6c76-5bed-9137-08543c44d2bd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 853380,
'Height': 3167,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8400/10468400/docs_service_history-1774199173752.jpg?ixlib=js-3.8.0&auto=format&s=f0a2a2cca4f50ff52309a141e87718ea',
'Width': 2134}],
'price': 5134,
'price_includes_vat': False,
'registration_date': '2007-09-25',
'seats_number': None,
'seller_name': None,
'title': 'Honda Civic TYPE-R GT I-VTEC',
'transmission': 'manual',
'trim': 'TYPE-R GT I-VTEC',
'vin': 'SHHFN23607U007192',
'year': 2007}
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710468400%27 HTTP/1.1" 200 None
2026-03-29 20:14:43 [motorway.uk] INFO: Saving data for 10468400: {'created_time': 1774815283.71448, 'last_price_update_time': 1774815283.714492, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10468400') HTTP/1.1" 204 0
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d13e910>
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5263%252F20465263%252Finterior_boot-1774776016307.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5263/20465263/interior_boot-1774776016307.jpg saved to cache
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d4064e2-a7b1-5519-aacc-b721c07abb14
2026-03-29 20:14:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d4064e2-a7b1-5519-aacc-b721c07abb14, skipping ID generation
2026-03-29 20:14:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4064e2-a7b1-5519-aacc-b721c07abb14 with scrape type 1
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d4064e2-a7b1-5519-aacc-b721c07abb14 sending to next pipeline
2026-03-29 20:14:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2d4064e2-a7b1-5519-aacc-b721c07abb14, identifier: 20465263
2026-03-29 20:14:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2d4064e2-a7b1-5519-aacc-b721c07abb14 with identifier: 20465263
2026-03-29 20:14:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2d4064e2-a7b1-5519-aacc-b721c07abb14 with identifier: 20465263
2026-03-29 20:14:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2d4064e2-a7b1-5519-aacc-b721c07abb14 with identifier: 20465263 to the API
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/5263/20465263/interior_boot-1774776016307.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2d4064e2-a7b1-5519-aacc-b721c07abb14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VO61 HMJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20465263',
'listing': 'auction',
'location': 'West Midlands Coventry',
'make': 'Toyota',
'model': 'Verso',
'odometer': 43200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1588962,
'Height': 2495,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_front_driver-1774775328401.jpg',
'Width': 3327},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 978554,
'Height': 2212,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_rear_driver-1774775360475.jpg',
'Width': 2949},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2024240,
'Height': 2505,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_front_passenger-1774775397942.jpg',
'Width': 3340},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1116639,
'Height': 2190,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5263/20465263/exterior_rear_passenger-1774775374955.jpg',
'Width': 2920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3929416,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5263/20465263/interior_front_seats-1774775953957.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2972333,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5263/20465263/interior_rear_seats-1774775970919.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3236500,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5263/20465263/interior_dashboard-1774776085669.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3862121,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5263/20465263/interior_boot-1774776016307.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 146390,
'Height': 2048,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5263/20465263/docs_service_history-1774776543516.jpg?ixlib=js-3.8.0&auto=format&s=3e4cb6f5de24816ad3aed5ec1f032e09',
'Width': 1334},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d4064e2-a7b1-5519-aacc-b721c07abb14/2d4064e2-a7b1-5519-aacc-b721c07abb14_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133161,
'Height': 1762,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5263/20465263/docs_service_history-1774776636580.jpg?ixlib=js-3.8.0&auto=format&s=1b8e1d4ec3054809d693db345f86e1a8',
'Width': 1323}],
'price': 3920,
'price_includes_vat': False,
'registration_date': '2011-12-30',
'seats_number': None,
'seller_name': None,
'title': 'Toyota VERSO-S T Spirit VVT-i CVT',
'transmission': 'automatic',
'trim': 'VERSO-S T Spirit VVT-i CVT',
'vin': 'JTDKJ3C3401023899',
'year': 2011}
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720465263%27 HTTP/1.1" 200 None
2026-03-29 20:14:44 [motorway.uk] INFO: Saving data for 20465263: {'created_time': 1774815284.363619, 'last_price_update_time': 1774815284.363634, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20465263') HTTP/1.1" 204 0
2026-03-29 20:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5497/19525497/interior_dashboard-1774185111435.jpg> (referer: None)
2026-03-29 20:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0126/20080126/interior_dashboard-1774712060395.jpg> (referer: None)
2026-03-29 20:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_front_driver-1774702645890.jpg> (referer: None)
2026-03-29 20:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1859/19211859/exterior_front_driver-1774781232081.jpg> (referer: None)
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d090c90>
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_280a30ed-6030-571b-a4a7-77d327c87731/280a30ed-6030-571b-a4a7-77d327c87731_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F19525497%252Finterior_dashboard-1774185111435.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/19525497/interior_dashboard-1774185111435.jpg saved to cache
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 280a30ed-6030-571b-a4a7-77d327c87731
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb0b190>
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a9492c-7a05-56b9-8aa5-35718b68c8d4/e2a9492c-7a05-56b9-8aa5-35718b68c8d4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0126%252F20080126%252Finterior_dashboard-1774712060395.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0126/20080126/interior_dashboard-1774712060395.jpg saved to cache
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2a9492c-7a05-56b9-8aa5-35718b68c8d4
2026-03-29 20:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6457/20446457/20446457-damage_scratches-modified-1774705024389.jpeg> (referer: None)
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dce6150>
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6457%252F20446457%252Fexterior_front_driver-1774702645890.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_front_driver-1774702645890.jpg saved to cache
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5d8350>
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1859%252F19211859%252Fexterior_front_driver-1774781232081.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1859/19211859/exterior_front_driver-1774781232081.jpg saved to cache
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efe991eb-4e50-5425-bd46-011e05d0fbd5
2026-03-29 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6457/20446457/docs_service_history-1774704033760.jpg?ixlib=js-3.8.0&auto=format&s=684a9a23da6315cf5316e30111b917de> (referer: None)
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da62750>
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6457%252F20446457%252F20446457-damage_scratches-modified-1774705024389.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6457/20446457/20446457-damage_scratches-modified-1774705024389.jpeg saved to cache
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47
2026-03-29 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1859/19211859/docs_service_history-1774780040909.jpg?ixlib=js-3.8.0&auto=format&s=23a62db8ba97472e11dd3f787b99ee94> (referer: None)
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d012e50>
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6457%252F20446457%252Fdocs_service_history-1774704033760.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D684a9a23da6315cf5316e30111b917de') HTTP/1.1" 204 0
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6457/20446457/docs_service_history-1774704033760.jpg?ixlib=js-3.8.0&auto=format&s=684a9a23da6315cf5316e30111b917de saved to cache
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d569e10>
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1859%252F19211859%252Fdocs_service_history-1774780040909.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D23a62db8ba97472e11dd3f787b99ee94') HTTP/1.1" 204 0
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1859/19211859/docs_service_history-1774780040909.jpg?ixlib=js-3.8.0&auto=format&s=23a62db8ba97472e11dd3f787b99ee94 saved to cache
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item efe991eb-4e50-5425-bd46-011e05d0fbd5
2026-03-29 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1859/19211859/interior_boot-1774779615803.jpg> (referer: None)
2026-03-29 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1859/19211859/instrument_cluster-1774779682918.jpg> (referer: None)
2026-03-29 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1859/19211859/interior_dashboard-1774781188065.jpg> (referer: None)
2026-03-29 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6457/20446457/interior_rear_seats-1774703260952.jpg> (referer: None)
2026-03-29 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6457/20446457/interior_dashboard-1774703392513.jpg> (referer: None)
2026-03-29 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6457/20446457/interior_boot-1774703348137.jpg> (referer: None)
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d093e10>
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1859%252F19211859%252Finterior_boot-1774779615803.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1859/19211859/interior_boot-1774779615803.jpg saved to cache
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item efe991eb-4e50-5425-bd46-011e05d0fbd5
2026-03-29 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1836&page=51&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4af290>
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1859%252F19211859%252Finstrument_cluster-1774779682918.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1859/19211859/instrument_cluster-1774779682918.jpg saved to cache
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efe991eb-4e50-5425-bd46-011e05d0fbd5
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c4bd0>
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1859%252F19211859%252Finterior_dashboard-1774781188065.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1859/19211859/interior_dashboard-1774781188065.jpg saved to cache
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efe991eb-4e50-5425-bd46-011e05d0fbd5
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da8a2d0>
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6457%252F20446457%252Finterior_rear_seats-1774703260952.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6457/20446457/interior_rear_seats-1774703260952.jpg saved to cache
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd8b850>
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6457%252F20446457%252Finterior_dashboard-1774703392513.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6457/20446457/interior_dashboard-1774703392513.jpg saved to cache
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da884d0>
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6457%252F20446457%252Finterior_boot-1774703348137.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6457/20446457/interior_boot-1774703348137.jpg saved to cache
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 9487324
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 19865604
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719865604%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [motorway.uk] INFO: Scrape type for 19865604: 1
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 18686856
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 10791383
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20478477
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 17256840
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717256840%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [motorway.uk] INFO: Scrape type for 17256840: 1
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20362883
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20396872
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20446617
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 19960160
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719960160%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [motorway.uk] INFO: Scrape type for 19960160: 1
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 19102029
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719102029%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [motorway.uk] INFO: Scrape type for 19102029: 1
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 13264381
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 6935357
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276935357%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [motorway.uk] INFO: Scrape type for 6935357: 1
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 19563438
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 16699614
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716699614%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [motorway.uk] INFO: Scrape type for 16699614: 1
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 18659064
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 10323885
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20310150
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20477603
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720477603%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [motorway.uk] INFO: Scrape type for 20477603: 1
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20430561
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 16452108
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 19553862
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 14075759
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20486420
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 19882415
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20445453
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20492600
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 6381818
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 17812597
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20385846
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720385846%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [motorway.uk] INFO: Scrape type for 20385846: 1
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20486514
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486514%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [motorway.uk] INFO: Scrape type for 20486514: 1
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20489259
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20466957
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 11609337
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20241656
2026-03-29 20:14:46 [motorway.uk] INFO: Found listing with ID: 20356416
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20043341.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6457/20446457/interior_front_seats-1774703248445.jpg> (referer: None)
2026-03-29 20:14:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1859/19211859/interior_front_seats-1774779573109.jpg> (referer: None)
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1859/19211859/interior_rear_seats-1774779593646.jpg> (referer: None)
2026-03-29 20:14:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a719c89f-c2d7-58dd-8f58-4d57a5381947 with identifier: 20043341
2026-03-29 20:14:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a719c89f-c2d7-58dd-8f58-4d57a5381947 with scrape type 1
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a719c89f-c2d7-58dd-8f58-4d57a5381947
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3341%252F20043341%252Fexterior_front_driver-1772359154294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3341/20043341/exterior_front_driver-1772359154294.jpg already downloaded
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3341%252F20043341%252Fexterior_rear_driver-1772359172395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3341/20043341/exterior_rear_driver-1772359172395.jpg already downloaded
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3341%252F20043341%252Fexterior_front_passenger-1772359191886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3341/20043341/exterior_front_passenger-1772359191886.jpg already downloaded
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3341%252F20043341%252Fexterior_rear_passenger-1772359185248.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3341/20043341/exterior_rear_passenger-1772359185248.jpg already downloaded
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3341%252F20043341%252Finterior_front_seats-1772359690169.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3341/20043341/interior_front_seats-1772359690169.jpg already downloaded
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3341%252F20043341%252Finterior_rear_seats-1772359744956.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3341/20043341/interior_rear_seats-1772359744956.jpg already downloaded
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3341%252F20043341%252Finterior_dashboard-1773493455279.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3341/20043341/interior_dashboard-1773493455279.jpg already downloaded
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3341%252F20043341%252Finstrument_cluster-1773585114676.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3341/20043341/instrument_cluster-1773585114676.jpg already downloaded
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3341%252F20043341%252Finterior_boot-1772359857042.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3341/20043341/interior_boot-1772359857042.jpg already downloaded
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F3341%252F20043341%252Fdocs_service_history-1772361841221.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3a3f6b3c3aff0b0cbd20f589d552f5fa%27 HTTP/1.1" 200 None
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/3341/20043341/docs_service_history-1772361841221.jpg?ixlib=js-3.8.0&auto=format&s=3a3f6b3c3aff0b0cbd20f589d552f5fa already downloaded
2026-03-29 20:14:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a719c89f-c2d7-58dd-8f58-4d57a5381947, identifier: 20043341
2026-03-29 20:14:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a719c89f-c2d7-58dd-8f58-4d57a5381947 with identifier: 20043341
2026-03-29 20:14:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a719c89f-c2d7-58dd-8f58-4d57a5381947 with identifier: 20043341
2026-03-29 20:14:47 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a719c89f-c2d7-58dd-8f58-4d57a5381947 with identifier: 20043341 to the API
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20043341.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a719c89f-c2d7-58dd-8f58-4d57a5381947',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'V4 LGM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20043341',
'listing': 'auction',
'location': 'Highland Portree',
'make': 'Skoda',
'model': 'Superb',
'odometer': 47500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/3341/20043341/exterior_front_driver-1772359154294.jpg',
'https://motorway-photos-redacted.imgix.net/3341/20043341/exterior_rear_driver-1772359172395.jpg',
'https://motorway-photos-redacted.imgix.net/3341/20043341/exterior_front_passenger-1772359191886.jpg',
'https://motorway-photos-redacted.imgix.net/3341/20043341/exterior_rear_passenger-1772359185248.jpg',
'https://motorway-photos.imgix.net/3341/20043341/interior_front_seats-1772359690169.jpg',
'https://motorway-photos.imgix.net/3341/20043341/interior_rear_seats-1772359744956.jpg',
'https://motorway-photos-modified.imgix.net/3341/20043341/interior_dashboard-1773493455279.jpg',
'https://motorway-photos-redacted.imgix.net/3341/20043341/instrument_cluster-1773585114676.jpg',
'https://motorway-photos.imgix.net/3341/20043341/interior_boot-1772359857042.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/3341/20043341/docs_service_history-1772361841221.jpg?ixlib=js-3.8.0&auto=format&s=3a3f6b3c3aff0b0cbd20f589d552f5fa'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652d8fe3-9ae2-5868-bdfd-c5e3ed921c20/652d8fe3-9ae2-5868-bdfd-c5e3ed921c20_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1626558,
'Height': 2486,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3341/20043341/exterior_front_driver-1772359154294.jpg',
'Width': 3315},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652d8fe3-9ae2-5868-bdfd-c5e3ed921c20/652d8fe3-9ae2-5868-bdfd-c5e3ed921c20_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2571986,
'Height': 2925,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3341/20043341/exterior_rear_driver-1772359172395.jpg',
'Width': 3900},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652d8fe3-9ae2-5868-bdfd-c5e3ed921c20/652d8fe3-9ae2-5868-bdfd-c5e3ed921c20_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1674129,
'Height': 2531,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3341/20043341/exterior_front_passenger-1772359191886.jpg',
'Width': 3374},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652d8fe3-9ae2-5868-bdfd-c5e3ed921c20/652d8fe3-9ae2-5868-bdfd-c5e3ed921c20_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2427542,
'Height': 2989,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3341/20043341/exterior_rear_passenger-1772359185248.jpg',
'Width': 3985},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652d8fe3-9ae2-5868-bdfd-c5e3ed921c20/652d8fe3-9ae2-5868-bdfd-c5e3ed921c20_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3236228,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3341/20043341/interior_front_seats-1772359690169.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652d8fe3-9ae2-5868-bdfd-c5e3ed921c20/652d8fe3-9ae2-5868-bdfd-c5e3ed921c20_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3268200,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3341/20043341/interior_rear_seats-1772359744956.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652d8fe3-9ae2-5868-bdfd-c5e3ed921c20/652d8fe3-9ae2-5868-bdfd-c5e3ed921c20_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2265572,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3341/20043341/interior_dashboard-1773493455279.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652d8fe3-9ae2-5868-bdfd-c5e3ed921c20/652d8fe3-9ae2-5868-bdfd-c5e3ed921c20_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2141290,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3341/20043341/instrument_cluster-1773585114676.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652d8fe3-9ae2-5868-bdfd-c5e3ed921c20/652d8fe3-9ae2-5868-bdfd-c5e3ed921c20_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3300609,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3341/20043341/interior_boot-1772359857042.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652d8fe3-9ae2-5868-bdfd-c5e3ed921c20/652d8fe3-9ae2-5868-bdfd-c5e3ed921c20_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 519254,
'Height': 1284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/3341/20043341/docs_service_history-1772361841221.jpg?ixlib=js-3.8.0&auto=format&s=3a3f6b3c3aff0b0cbd20f589d552f5fa',
'Width': 2778}],
'price': 16800,
'price_includes_vat': False,
'registration_date': '2021-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Superb Sportline + TSI S-A',
'transmission': 'automatic',
'trim': 'Sportline + TSI S-A',
'vin': 'TMBBM7NP2M7010831',
'year': 2021}
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720043341%27 HTTP/1.1" 200 None
2026-03-29 20:14:47 [motorway.uk] INFO: Saving data for 20043341: {'created_time': 1774815287.432388, 'last_price_update_time': 1774815287.432399, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20043341') HTTP/1.1" 204 0
2026-03-29 20:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20419362.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1859/19211859/exterior_rear_passenger-1774778918873.jpg> (referer: None)
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6915d0>
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6457%252F20446457%252Finterior_front_seats-1774703248445.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6457/20446457/interior_front_seats-1774703248445.jpg saved to cache
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d59ced0>
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1859%252F19211859%252Finterior_front_seats-1774779573109.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1859/19211859/interior_front_seats-1774779573109.jpg saved to cache
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efe991eb-4e50-5425-bd46-011e05d0fbd5
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca604d0>
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1859%252F19211859%252Finterior_rear_seats-1774779593646.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1859/19211859/interior_rear_seats-1774779593646.jpg saved to cache
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efe991eb-4e50-5425-bd46-011e05d0fbd5
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17791322.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18721041.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4adf5b85-8cbd-56a5-bbe0-df1d9ae559ab with identifier: 20419362
2026-03-29 20:14:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4adf5b85-8cbd-56a5-bbe0-df1d9ae559ab with scrape type 1
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4adf5b85-8cbd-56a5-bbe0-df1d9ae559ab
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9362%252F20419362%252Fexterior_front_driver-1774699136220.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9362/20419362/exterior_front_driver-1774699136220.jpg not downloaded yet
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d690750>
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1859%252F19211859%252Fexterior_rear_passenger-1774778918873.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1859/19211859/exterior_rear_passenger-1774778918873.jpg saved to cache
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efe991eb-4e50-5425-bd46-011e05d0fbd5
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9362%252F20419362%252Fexterior_rear_driver-1774699070570.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9362/20419362/exterior_rear_driver-1774699070570.jpg not downloaded yet
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9362%252F20419362%252Fexterior_front_passenger-1774699113466.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9362/20419362/exterior_front_passenger-1774699113466.jpg not downloaded yet
2026-03-29 20:14:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff57b4f1-34ae-597b-b0ef-80346d087cf1 with identifier: 17791322
2026-03-29 20:14:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff57b4f1-34ae-597b-b0ef-80346d087cf1 with scrape type 1
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff57b4f1-34ae-597b-b0ef-80346d087cf1
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1322%252F17791322%252Fexterior_front_driver-1774709058614.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1322/17791322/exterior_front_driver-1774709058614.jpeg not downloaded yet
2026-03-29 20:14:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9abcf1ea-074f-5fd9-b0d0-4d77d62f26de with identifier: 18721041
2026-03-29 20:14:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9abcf1ea-074f-5fd9-b0d0-4d77d62f26de with scrape type 1
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9abcf1ea-074f-5fd9-b0d0-4d77d62f26de
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1041%252F18721041%252Fexterior_front_driver-1772210601658.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1041/18721041/exterior_front_driver-1772210601658.jpeg already downloaded
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1041%252F18721041%252Fexterior_rear_driver-1772210648033.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1041/18721041/exterior_rear_driver-1772210648033.jpeg already downloaded
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1041%252F18721041%252Fexterior_front_passenger-1772210699489.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1041/18721041/exterior_front_passenger-1772210699489.jpeg already downloaded
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1041%252F18721041%252Fexterior_rear_passenger-1767103253111.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1041/18721041/exterior_rear_passenger-1767103253111.jpeg already downloaded
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1041%252F18721041%252Finterior_front_seats-1767103360038.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1041/18721041/interior_front_seats-1767103360038.jpeg already downloaded
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1041%252F18721041%252Finterior_rear_seats-1767103299990.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1041/18721041/interior_rear_seats-1767103299990.jpeg already downloaded
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1041%252F18721041%252Finterior_dashboard-1767103320129.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1041/18721041/interior_dashboard-1767103320129.jpeg already downloaded
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1041%252F18721041%252Finstrument_cluster-1772139588198.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1041/18721041/instrument_cluster-1772139588198.jpeg already downloaded
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1041%252F18721041%252Finterior_boot-1767103335117.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1041/18721041/interior_boot-1767103335117.jpeg already downloaded
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1041%252F18721041%252F18721041-docs_service_history-modified-1772183729905.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D52b35d92551eadff7a1fad331fc29d91%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1041/18721041/18721041-docs_service_history-modified-1772183729905.jpeg?ixlib=js-3.8.0&auto=format&s=52b35d92551eadff7a1fad331fc29d91 already downloaded
2026-03-29 20:14:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9abcf1ea-074f-5fd9-b0d0-4d77d62f26de, identifier: 18721041
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9362%252F20419362%252Fexterior_rear_passenger-1774699084208.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9362/20419362/exterior_rear_passenger-1774699084208.jpg not downloaded yet
2026-03-29 20:14:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9abcf1ea-074f-5fd9-b0d0-4d77d62f26de with identifier: 18721041
2026-03-29 20:14:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9abcf1ea-074f-5fd9-b0d0-4d77d62f26de with identifier: 18721041
2026-03-29 20:14:48 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9abcf1ea-074f-5fd9-b0d0-4d77d62f26de with identifier: 18721041 to the API
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18721041.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '9abcf1ea-074f-5fd9-b0d0-4d77d62f26de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'NJ65 PXK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18721041',
'listing': 'auction',
'location': 'Aberdeen City Aberdeen',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 119732,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/1041/18721041/exterior_front_driver-1772210601658.jpeg',
'https://motorway-photos-redacted.imgix.net/1041/18721041/exterior_rear_driver-1772210648033.jpeg',
'https://motorway-photos-redacted.imgix.net/1041/18721041/exterior_front_passenger-1772210699489.jpeg',
'https://motorway-photos-redacted.imgix.net/1041/18721041/exterior_rear_passenger-1767103253111.jpeg',
'https://motorway-photos.imgix.net/1041/18721041/interior_front_seats-1767103360038.jpeg',
'https://motorway-photos.imgix.net/1041/18721041/interior_rear_seats-1767103299990.jpeg',
'https://motorway-photos.imgix.net/1041/18721041/interior_dashboard-1767103320129.jpeg',
'https://motorway-photos-redacted.imgix.net/1041/18721041/instrument_cluster-1772139588198.jpeg',
'https://motorway-photos.imgix.net/1041/18721041/interior_boot-1767103335117.jpeg',
'https://motorway-service-history-photos.imgix.net/modified/1041/18721041/18721041-docs_service_history-modified-1772183729905.jpeg?ixlib=js-3.8.0&auto=format&s=52b35d92551eadff7a1fad331fc29d91'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e1ebff7-6779-5f3b-954f-43a027436651/1e1ebff7-6779-5f3b-954f-43a027436651_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1641423,
'Height': 2726,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1041/18721041/exterior_front_driver-1772210601658.jpeg',
'Width': 3634},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e1ebff7-6779-5f3b-954f-43a027436651/1e1ebff7-6779-5f3b-954f-43a027436651_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1347595,
'Height': 2435,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1041/18721041/exterior_rear_driver-1772210648033.jpeg',
'Width': 3247},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e1ebff7-6779-5f3b-954f-43a027436651/1e1ebff7-6779-5f3b-954f-43a027436651_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1407809,
'Height': 2427,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1041/18721041/exterior_front_passenger-1772210699489.jpeg',
'Width': 3236},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e1ebff7-6779-5f3b-954f-43a027436651/1e1ebff7-6779-5f3b-954f-43a027436651_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 931480,
'Height': 2171,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1041/18721041/exterior_rear_passenger-1767103253111.jpeg',
'Width': 2895},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e1ebff7-6779-5f3b-954f-43a027436651/1e1ebff7-6779-5f3b-954f-43a027436651_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3604829,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1041/18721041/interior_front_seats-1767103360038.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e1ebff7-6779-5f3b-954f-43a027436651/1e1ebff7-6779-5f3b-954f-43a027436651_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3415674,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1041/18721041/interior_rear_seats-1767103299990.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e1ebff7-6779-5f3b-954f-43a027436651/1e1ebff7-6779-5f3b-954f-43a027436651_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4617053,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1041/18721041/interior_dashboard-1767103320129.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e1ebff7-6779-5f3b-954f-43a027436651/1e1ebff7-6779-5f3b-954f-43a027436651_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1927588,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1041/18721041/instrument_cluster-1772139588198.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e1ebff7-6779-5f3b-954f-43a027436651/1e1ebff7-6779-5f3b-954f-43a027436651_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3604472,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1041/18721041/interior_boot-1767103335117.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e1ebff7-6779-5f3b-954f-43a027436651/1e1ebff7-6779-5f3b-954f-43a027436651_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103224,
'Height': 1608,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1041/18721041/18721041-docs_service_history-modified-1772183729905.jpeg?ixlib=js-3.8.0&auto=format&s=52b35d92551eadff7a1fad331fc29d91',
'Width': 1206}],
'price': 3825,
'price_includes_vat': False,
'registration_date': '2015-10-15',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Yeti Outdoor SE TDI SCR 4X4',
'transmission': 'manual',
'trim': 'Outdoor SE TDI SCR 4X4',
'vin': 'TMBMD75L0G6023187',
'year': 2015}
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718721041%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [motorway.uk] INFO: Saving data for 18721041: {'created_time': 1774815289.111403, 'last_price_update_time': 1774815289.111413, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18721041') HTTP/1.1" 204 0
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1322%252F17791322%252Fexterior_rear_driver-1774709118681.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1322/17791322/exterior_rear_driver-1774709118681.jpeg not downloaded yet
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9362%252F20419362%252Finterior_front_seats-1774699715153.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9362/20419362/interior_front_seats-1774699715153.jpg not downloaded yet
2026-03-29 20:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1859/19211859/exterior_rear_driver-1774778908399.jpg> (referer: None)
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1322%252F17791322%252Fexterior_front_passenger-1774709090250.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1322/17791322/exterior_front_passenger-1774709090250.jpeg not downloaded yet
2026-03-29 20:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1859/19211859/exterior_front_passenger-1774778957086.jpg> (referer: None)
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9362%252F20419362%252Finterior_rear_seats-1774699661754.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9362/20419362/interior_rear_seats-1774699661754.jpg not downloaded yet
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1322%252F17791322%252Fexterior_rear_passenger-1774709109737.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1322/17791322/exterior_rear_passenger-1774709109737.jpeg not downloaded yet
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9362%252F20419362%252Finterior_dashboard-1774699691348.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9362/20419362/interior_dashboard-1774699691348.jpg not downloaded yet
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1322%252F17791322%252Finterior_front_seats-1774705051073.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1322/17791322/interior_front_seats-1774705051073.jpeg not downloaded yet
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9362%252F20419362%252Finstrument_cluster-1774699754623.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9362/20419362/instrument_cluster-1774699754623.jpg not downloaded yet
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1322%252F17791322%252Finterior_rear_seats-1774704709347.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1322/17791322/interior_rear_seats-1774704709347.jpeg not downloaded yet
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9362%252F20419362%252Finterior_boot-1774699705084.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9362/20419362/interior_boot-1774699705084.jpg not downloaded yet
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1322%252F17791322%252Finterior_dashboard-1774704963795.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1322/17791322/interior_dashboard-1774704963795.jpeg not downloaded yet
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c915cd0>
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1859%252F19211859%252Fexterior_rear_driver-1774778908399.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1859/19211859/exterior_rear_driver-1774778908399.jpg saved to cache
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efe991eb-4e50-5425-bd46-011e05d0fbd5
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f419b90>
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1859%252F19211859%252Fexterior_front_passenger-1774778957086.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1859/19211859/exterior_front_passenger-1774778957086.jpg saved to cache
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efe991eb-4e50-5425-bd46-011e05d0fbd5
2026-03-29 20:14:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efe991eb-4e50-5425-bd46-011e05d0fbd5, skipping ID generation
2026-03-29 20:14:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe991eb-4e50-5425-bd46-011e05d0fbd5 with scrape type 1
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efe991eb-4e50-5425-bd46-011e05d0fbd5 sending to next pipeline
2026-03-29 20:14:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: efe991eb-4e50-5425-bd46-011e05d0fbd5, identifier: 19211859
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9362%252F20419362%252Fdocs_service_history-1774700204050.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4a7bff14f4f04dc221e4756032f0ce5c%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9362/20419362/docs_service_history-1774700204050.jpg?ixlib=js-3.8.0&auto=format&s=4a7bff14f4f04dc221e4756032f0ce5c not downloaded yet
2026-03-29 20:14:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: efe991eb-4e50-5425-bd46-011e05d0fbd5 with identifier: 19211859
2026-03-29 20:14:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: efe991eb-4e50-5425-bd46-011e05d0fbd5 with identifier: 19211859
2026-03-29 20:14:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: efe991eb-4e50-5425-bd46-011e05d0fbd5 with identifier: 19211859 to the API
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1859/19211859/exterior_front_passenger-1774778957086.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'efe991eb-4e50-5425-bd46-011e05d0fbd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DY68 JYJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19211859',
'listing': 'auction',
'location': 'Shropshire Shrewsbury',
'make': 'MINI',
'model': 'Cooper',
'odometer': 102051,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1747891,
'Height': 2276,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1859/19211859/exterior_front_driver-1774781232081.jpg',
'Width': 3035},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1202400,
'Height': 2340,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1859/19211859/exterior_rear_driver-1774778908399.jpg',
'Width': 3120},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1392517,
'Height': 2268,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1859/19211859/exterior_front_passenger-1774778957086.jpg',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1128686,
'Height': 2224,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1859/19211859/exterior_rear_passenger-1774778918873.jpg',
'Width': 2965},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4036985,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1859/19211859/interior_front_seats-1774779573109.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4644756,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1859/19211859/interior_rear_seats-1774779593646.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2212745,
'Height': 2766,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1859/19211859/interior_dashboard-1774781188065.jpg',
'Width': 3688},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2360846,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1859/19211859/instrument_cluster-1774779682918.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4365948,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1859/19211859/interior_boot-1774779615803.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe991eb-4e50-5425-bd46-011e05d0fbd5/efe991eb-4e50-5425-bd46-011e05d0fbd5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1475595,
'Height': 1075,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1859/19211859/docs_service_history-1774780040909.jpg?ixlib=js-3.8.0&auto=format&s=23a62db8ba97472e11dd3f787b99ee94',
'Width': 1616}],
'price': 4719,
'price_includes_vat': False,
'registration_date': '2018-09-11',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'manual',
'trim': 'S',
'vin': 'WMWXR52090TM85359',
'year': 2018}
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719211859%27 HTTP/1.1" 200 None
2026-03-29 20:14:50 [motorway.uk] INFO: Saving data for 19211859: {'created_time': 1774815290.083162, 'last_price_update_time': 1774815290.083173, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19211859') HTTP/1.1" 204 0
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1322%252F17791322%252Finterior_boot-1774704986978.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1322/17791322/interior_boot-1774704986978.jpeg not downloaded yet
2026-03-29 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20445502.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_front_passenger-1774702711369.jpg> (referer: None)
2026-03-29 20:14:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_rear_passenger-1774702681198.jpg> (referer: None)
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1322%252F17791322%252Fdocs_service_history-1774710589249.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De4fa1cc47cb0f13d7e1d7ed4d08b0feb%27 HTTP/1.1" 200 None
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1322/17791322/docs_service_history-1774710589249.jpeg?ixlib=js-3.8.0&auto=format&s=e4fa1cc47cb0f13d7e1d7ed4d08b0feb not downloaded yet
2026-03-29 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1872&page=52&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_rear_driver-1774702667106.jpg> (referer: None)
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1322%252F17791322%252Fdamage_scratches-1774709840249.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1322/17791322/damage_scratches-1774709840249.jpeg not downloaded yet
2026-03-29 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1322/17791322/exterior_rear_driver-1774709118681.jpeg> (referer: None)
2026-03-29 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9362/20419362/interior_front_seats-1774699715153.jpg> (referer: None)
2026-03-29 20:14:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799d45b0-fd0e-537a-9d8f-a1e9b9d98a3d with identifier: 20445502
2026-03-29 20:14:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799d45b0-fd0e-537a-9d8f-a1e9b9d98a3d with scrape type 1
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 799d45b0-fd0e-537a-9d8f-a1e9b9d98a3d
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5502%252F20445502%252Fexterior_front_driver-1774702621179.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5502/20445502/exterior_front_driver-1774702621179.jpg not downloaded yet
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5502%252F20445502%252Fexterior_rear_driver-1774702601727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5502/20445502/exterior_rear_driver-1774702601727.jpg not downloaded yet
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5502%252F20445502%252Fexterior_front_passenger-1774702637214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5502/20445502/exterior_front_passenger-1774702637214.jpg not downloaded yet
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f418e10>
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6457%252F20446457%252Fexterior_front_passenger-1774702711369.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_front_passenger-1774702711369.jpg saved to cache
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f2f7390>
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6457%252F20446457%252Fexterior_rear_passenger-1774702681198.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_rear_passenger-1774702681198.jpg saved to cache
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5502%252F20445502%252Fexterior_rear_passenger-1774702659627.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5502/20445502/exterior_rear_passenger-1774702659627.jpg not downloaded yet
2026-03-29 20:14:50 [motorway.uk] INFO: Found listing with ID: 20343787
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720343787%27 HTTP/1.1" 200 None
2026-03-29 20:14:50 [motorway.uk] INFO: Scrape type for 20343787: 2
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0e61d0>
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6457%252F20446457%252Fexterior_rear_driver-1774702667106.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_rear_driver-1774702667106.jpg saved to cache
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47
2026-03-29 20:14:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47, skipping ID generation
2026-03-29 20:14:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47 with scrape type 1
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47 sending to next pipeline
2026-03-29 20:14:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47, identifier: 20446457
2026-03-29 20:14:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47 with identifier: 20446457
2026-03-29 20:14:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47 with identifier: 20446457
2026-03-29 20:14:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47 with identifier: 20446457 to the API
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_rear_driver-1774702667106.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HN65 ZMZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20446457',
'listing': 'auction',
'location': 'Dorset Wareham',
'make': 'Mercedes',
'model': 'GLC',
'odometer': 90720,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2093428,
'Height': 2667,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_front_driver-1774702645890.jpg',
'Width': 3556},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2027791,
'Height': 2540,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_rear_driver-1774702667106.jpg',
'Width': 3386},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1888470,
'Height': 2453,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_front_passenger-1774702711369.jpg',
'Width': 3271},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2824562,
'Height': 2806,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6457/20446457/exterior_rear_passenger-1774702681198.jpg',
'Width': 3741},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2754518,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6457/20446457/interior_front_seats-1774703248445.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3308111,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6457/20446457/interior_rear_seats-1774703260952.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3913836,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6457/20446457/interior_dashboard-1774703392513.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3790853,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6457/20446457/interior_boot-1774703348137.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516117,
'Height': 3096,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6457/20446457/docs_service_history-1774704033760.jpg?ixlib=js-3.8.0&auto=format&s=684a9a23da6315cf5316e30111b917de',
'Width': 2221},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47/fdcd4cf0-56ba-56f2-9154-1d2eaa2ebf47_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54977,
'Height': 488,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6457/20446457/20446457-damage_scratches-modified-1774705024389.jpeg',
'Width': 651}],
'price': 10651,
'price_includes_vat': False,
'registration_date': '2015-11-17',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLC 220 D 4M AMG Line Prem + A',
'transmission': 'automatic',
'trim': '220 D 4M AMG Line Prem + A',
'vin': 'WDC2539052F006606',
'year': 2015}
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720446457%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [motorway.uk] INFO: Saving data for 20446457: {'created_time': 1774815291.275163, 'last_price_update_time': 1774815291.275177, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20446457') HTTP/1.1" 204 0
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5502%252F20445502%252Finterior_front_seats-1774703557143.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5502/20445502/interior_front_seats-1774703557143.jpg not downloaded yet
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20467775
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467775%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [motorway.uk] INFO: Scrape type for 20467775: 1
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d27cc90>
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff57b4f1-34ae-597b-b0ef-80346d087cf1/ff57b4f1-34ae-597b-b0ef-80346d087cf1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1322%252F17791322%252Fexterior_rear_driver-1774709118681.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1322/17791322/exterior_rear_driver-1774709118681.jpeg saved to cache
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff57b4f1-34ae-597b-b0ef-80346d087cf1
2026-03-29 20:14:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de3a750>
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4adf5b85-8cbd-56a5-bbe0-df1d9ae559ab/4adf5b85-8cbd-56a5-bbe0-df1d9ae559ab_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9362%252F20419362%252Finterior_front_seats-1774699715153.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9362/20419362/interior_front_seats-1774699715153.jpg saved to cache
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4adf5b85-8cbd-56a5-bbe0-df1d9ae559ab
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5502%252F20445502%252Finterior_rear_seats-1774703544002.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5502/20445502/interior_rear_seats-1774703544002.jpg not downloaded yet
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 14487162
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20178495
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720178495%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [motorway.uk] INFO: Scrape type for 20178495: 1
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5502%252F20445502%252Finterior_dashboard-1774703558922.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5502/20445502/interior_dashboard-1774703558922.jpg not downloaded yet
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 1809812
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20438968
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720438968%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [motorway.uk] INFO: Scrape type for 20438968: 1
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5502%252F20445502%252Finterior_boot-1774703552806.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5502/20445502/interior_boot-1774703552806.jpg not downloaded yet
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20491701
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20426969
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 12048529
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20237139
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 13997498
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713997498%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [motorway.uk] INFO: Scrape type for 13997498: 1
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5502%252F20445502%252Fdamage_scratches-1774702749608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5502/20445502/damage_scratches-1774702749608.jpg not downloaded yet
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20470699
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20376526
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 19311094
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 18596024
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20391231
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720391231%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [motorway.uk] INFO: Scrape type for 20391231: 1
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5502%252F20445502%252Fdamage_scratches-1774702876336.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5502/20445502/damage_scratches-1774702876336.jpg not downloaded yet
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20500889
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 10739202
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710739202%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [motorway.uk] INFO: Scrape type for 10739202: 1
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20450918
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 17131472
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 16030569
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716030569%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [motorway.uk] INFO: Scrape type for 16030569: 1
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20485243
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20464032
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720464032%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [motorway.uk] INFO: Scrape type for 20464032: 1
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 6326009
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276326009%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [motorway.uk] INFO: Scrape type for 6326009: 2
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20468243
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 19307478
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719307478%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [motorway.uk] INFO: Scrape type for 19307478: 1
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20374512
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20389122
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20445992
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20459100
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20476210
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 19731701
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 9209977
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 13542137
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 6911158
2026-03-29 20:14:51 [motorway.uk] INFO: Found listing with ID: 20050309
2026-03-29 20:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9362/20419362/docs_service_history-1774700204050.jpg?ixlib=js-3.8.0&auto=format&s=4a7bff14f4f04dc221e4756032f0ce5c> (referer: None)
2026-03-29 20:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1322/17791322/interior_dashboard-1774704963795.jpeg> (referer: None)
2026-03-29 20:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5502/20445502/interior_rear_seats-1774703544002.jpg> (referer: None)
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2da8ae50>
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4adf5b85-8cbd-56a5-bbe0-df1d9ae559ab/4adf5b85-8cbd-56a5-bbe0-df1d9ae559ab_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9362%252F20419362%252Fdocs_service_history-1774700204050.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4a7bff14f4f04dc221e4756032f0ce5c') HTTP/1.1" 204 0
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9362/20419362/docs_service_history-1774700204050.jpg?ixlib=js-3.8.0&auto=format&s=4a7bff14f4f04dc221e4756032f0ce5c saved to cache
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4adf5b85-8cbd-56a5-bbe0-df1d9ae559ab
2026-03-29 20:14:52 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:52 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:52 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b"\x00\x03\x00\x00\x003\xdf\xed\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02a'\x003\xd5\x93\x00\x00\x00\x00"
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1e7b90>
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff57b4f1-34ae-597b-b0ef-80346d087cf1/ff57b4f1-34ae-597b-b0ef-80346d087cf1_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1322%252F17791322%252Finterior_dashboard-1774704963795.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1322/17791322/interior_dashboard-1774704963795.jpeg saved to cache
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff57b4f1-34ae-597b-b0ef-80346d087cf1
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d8aa590>
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799d45b0-fd0e-537a-9d8f-a1e9b9d98a3d/799d45b0-fd0e-537a-9d8f-a1e9b9d98a3d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5502%252F20445502%252Finterior_rear_seats-1774703544002.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5502/20445502/interior_rear_seats-1774703544002.jpg saved to cache
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 799d45b0-fd0e-537a-9d8f-a1e9b9d98a3d
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5502/20445502/interior_front_seats-1774703557143.jpg> (referer: None)
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c646710>
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799d45b0-fd0e-537a-9d8f-a1e9b9d98a3d/799d45b0-fd0e-537a-9d8f-a1e9b9d98a3d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5502%252F20445502%252Finterior_front_seats-1774703557143.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5502/20445502/interior_front_seats-1774703557143.jpg saved to cache
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 799d45b0-fd0e-537a-9d8f-a1e9b9d98a3d
2026-03-29 20:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486514.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 666d2b7f-cde5-5a99-866b-238c4ddbc91e with identifier: 20486514
2026-03-29 20:14:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 666d2b7f-cde5-5a99-866b-238c4ddbc91e with scrape type 1
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 666d2b7f-cde5-5a99-866b-238c4ddbc91e
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20486514%252Fexterior_front_driver-1774705603420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20486514/exterior_front_driver-1774705603420.jpg not downloaded yet
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20486514%252Fexterior_rear_driver-1774705617560.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20486514/exterior_rear_driver-1774705617560.jpg not downloaded yet
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20486514%252Fexterior_front_passenger-1774705634366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20486514/exterior_front_passenger-1774705634366.jpg not downloaded yet
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20486514%252Fexterior_rear_passenger-1774705646174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20486514/exterior_rear_passenger-1774705646174.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6514%252F20486514%252Finterior_front_seats-1774703029131.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6514/20486514/interior_front_seats-1774703029131.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6514%252F20486514%252Finterior_rear_seats-1774703056418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6514/20486514/interior_rear_seats-1774703056418.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20486514%252Finterior_dashboard-1774705749539.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20486514/interior_dashboard-1774705749539.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6514%252F20486514%252Finstrument_cluster-1774703033285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6514/20486514/instrument_cluster-1774703033285.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20486514%252Finterior_boot-1774705749528.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20486514/interior_boot-1774705749528.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6514%252F20486514%252Fdocs_service_history-1774706086873.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc20f88e2e0484216b0fd48da522e0eca%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6514/20486514/docs_service_history-1774706086873.jpg?ixlib=js-3.8.0&auto=format&s=c20f88e2e0484216b0fd48da522e0eca not downloaded yet
2026-03-29 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19102029.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f390739-ddb2-5347-9f90-c6d918e7acf5 with identifier: 19102029
2026-03-29 20:14:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f390739-ddb2-5347-9f90-c6d918e7acf5 with scrape type 1
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f390739-ddb2-5347-9f90-c6d918e7acf5
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2029%252F19102029%252Fexterior_front_driver-1774696145240.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2029/19102029/exterior_front_driver-1774696145240.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2029%252F19102029%252Fexterior_rear_driver-1774696163816.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2029/19102029/exterior_rear_driver-1774696163816.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2029%252F19102029%252Fexterior_front_passenger-1774696930317.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2029/19102029/exterior_front_passenger-1774696930317.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2029%252F19102029%252Fexterior_rear_passenger-1774696176215.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2029/19102029/exterior_rear_passenger-1774696176215.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2029%252F19102029%252Finterior_front_seats-1774696919513.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2029/19102029/interior_front_seats-1774696919513.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2029%252F19102029%252Finterior_rear_seats-1774696660168.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2029/19102029/interior_rear_seats-1774696660168.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2029%252F19102029%252Finterior_dashboard-1774696932435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2029/19102029/interior_dashboard-1774696932435.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2029%252F19102029%252Finstrument_cluster-1774696719602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2029/19102029/instrument_cluster-1774696719602.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2029%252F19102029%252Finterior_boot-1774696692378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2029/19102029/interior_boot-1774696692378.jpg not downloaded yet
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2029%252F19102029%252Fdocs_service_history-1774696877691.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De69f9b712127d27ed7d2c0b7450f9828%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2029/19102029/docs_service_history-1774696877691.jpg?ixlib=js-3.8.0&auto=format&s=e69f9b712127d27ed7d2c0b7450f9828 not downloaded yet
2026-03-29 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6514/20486514/docs_service_history-1774706086873.jpg?ixlib=js-3.8.0&auto=format&s=c20f88e2e0484216b0fd48da522e0eca> (referer: None)
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db7f190>
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666d2b7f-cde5-5a99-866b-238c4ddbc91e/666d2b7f-cde5-5a99-866b-238c4ddbc91e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6514%252F20486514%252Fdocs_service_history-1774706086873.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc20f88e2e0484216b0fd48da522e0eca') HTTP/1.1" 204 0
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6514/20486514/docs_service_history-1774706086873.jpg?ixlib=js-3.8.0&auto=format&s=c20f88e2e0484216b0fd48da522e0eca saved to cache
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 666d2b7f-cde5-5a99-866b-238c4ddbc91e
2026-03-29 20:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20477603.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4ba5c87-308b-57b1-8bd4-0d06a5e0a7aa with identifier: 20477603
2026-03-29 20:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4ba5c87-308b-57b1-8bd4-0d06a5e0a7aa with scrape type 1
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4ba5c87-308b-57b1-8bd4-0d06a5e0a7aa
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7603%252F20477603%252Fexterior_front_driver-1774779198411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7603/20477603/exterior_front_driver-1774779198411.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7603%252F20477603%252Fexterior_rear_driver-1774779359329.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7603/20477603/exterior_rear_driver-1774779359329.jpg not downloaded yet
2026-03-29 20:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19659206.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16699614.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7603%252F20477603%252Fexterior_front_passenger-1774779390795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7603/20477603/exterior_front_passenger-1774779390795.jpg not downloaded yet
2026-03-29 20:14:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7603%252F20477603%252Fexterior_rear_passenger-1774779377753.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7603/20477603/exterior_rear_passenger-1774779377753.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7603%252F20477603%252Finterior_front_seats-1774780143435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7603/20477603/interior_front_seats-1774780143435.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7603%252F20477603%252Finterior_rear_seats-1774780160974.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7603/20477603/interior_rear_seats-1774780160974.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7603%252F20477603%252Finterior_dashboard-1774780226777.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7603/20477603/interior_dashboard-1774780226777.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7603%252F20477603%252Finstrument_cluster-1774780242712.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7603/20477603/instrument_cluster-1774780242712.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7603%252F20477603%252Finterior_boot-1774780234211.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7603/20477603/interior_boot-1774780234211.jpg not downloaded yet
2026-03-29 20:14:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0437239-6b5f-5225-baec-5c0383863cab with identifier: 19659206
2026-03-29 20:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0437239-6b5f-5225-baec-5c0383863cab with scrape type 1
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0437239-6b5f-5225-baec-5c0383863cab
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9206%252F19659206%252Fexterior_front_driver-1774447353567.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9206/19659206/exterior_front_driver-1774447353567.jpeg not downloaded yet
2026-03-29 20:14:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da6636d6-8900-59b7-98cb-ae3ad9e0f626 with identifier: 16699614
2026-03-29 20:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da6636d6-8900-59b7-98cb-ae3ad9e0f626 with scrape type 1
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da6636d6-8900-59b7-98cb-ae3ad9e0f626
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9614%252F16699614%252Fexterior_front_driver-1774615826806.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9614/16699614/exterior_front_driver-1774615826806.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7603%252F20477603%252Fdocs_service_history-1774780495923.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D92f033db6469af56e094e1c85e8e97ae%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7603/20477603/docs_service_history-1774780495923.jpg?ixlib=js-3.8.0&auto=format&s=92f033db6469af56e094e1c85e8e97ae not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9206%252F19659206%252Fexterior_rear_driver-1774447405186.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9206/19659206/exterior_rear_driver-1774447405186.jpeg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9614%252F16699614%252Fexterior_rear_driver-1774615846363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9614/16699614/exterior_rear_driver-1774615846363.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9206%252F19659206%252Fexterior_front_passenger-1774447383170.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9206/19659206/exterior_front_passenger-1774447383170.jpeg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9614%252F16699614%252Fexterior_front_passenger-1774618920642.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9614/16699614/exterior_front_passenger-1774618920642.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9206%252F19659206%252Fexterior_rear_passenger-1774447396860.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9206/19659206/exterior_rear_passenger-1774447396860.jpeg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9614%252F16699614%252Fexterior_rear_passenger-1774618943566.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9614/16699614/exterior_rear_passenger-1774618943566.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9206%252F19659206%252Finterior_front_seats-1774447421625.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9206/19659206/interior_front_seats-1774447421625.jpeg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9614%252F16699614%252Finterior_front_seats-1774616574189.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9614/16699614/interior_front_seats-1774616574189.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9206%252F19659206%252Finterior_rear_seats-1774447552307.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9206/19659206/interior_rear_seats-1774447552307.jpeg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9614%252F16699614%252Finterior_rear_seats-1774616604884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9614/16699614/interior_rear_seats-1774616604884.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9206%252F19659206%252Finterior_dashboard-1774447682423.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9206/19659206/interior_dashboard-1774447682423.jpeg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9614%252F16699614%252Finterior_dashboard-1774617869653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9614/16699614/interior_dashboard-1774617869653.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9206%252F19659206%252Finstrument_cluster-1774447643068.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9206/19659206/instrument_cluster-1774447643068.jpeg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9614%252F16699614%252Finstrument_cluster-1774616636823.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9614/16699614/instrument_cluster-1774616636823.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9206%252F19659206%252Finterior_boot-1774447648717.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9206/19659206/interior_boot-1774447648717.jpeg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9614%252F16699614%252Finterior_boot-1774616664253.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9614/16699614/interior_boot-1774616664253.jpg not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9206%252F19659206%252F19659206-docs_service_history-modified-1774694333225.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D55e3b2697e713865fa52dd50efabdd09%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9206/19659206/19659206-docs_service_history-modified-1774694333225.jpeg?ixlib=js-3.8.0&auto=format&s=55e3b2697e713865fa52dd50efabdd09 not downloaded yet
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9614%252F16699614%252Fdocs_service_history-1774617104909.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D139c24549d912d153f46a149cad761d8%27 HTTP/1.1" 200 None
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9614/16699614/docs_service_history-1774617104909.jpg?ixlib=js-3.8.0&auto=format&s=139c24549d912d153f46a149cad761d8 not downloaded yet
2026-03-29 20:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7603/20477603/exterior_front_driver-1774779198411.jpg> (referer: None)
2026-03-29 20:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7603/20477603/exterior_rear_driver-1774779359329.jpg> (referer: None)
2026-03-29 20:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2029/19102029/interior_boot-1774696692378.jpg> (referer: None)
2026-03-29 20:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2029/19102029/docs_service_history-1774696877691.jpg?ixlib=js-3.8.0&auto=format&s=e69f9b712127d27ed7d2c0b7450f9828> (referer: None)
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c735c50>
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ba5c87-308b-57b1-8bd4-0d06a5e0a7aa/f4ba5c87-308b-57b1-8bd4-0d06a5e0a7aa_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7603%252F20477603%252Fexterior_front_driver-1774779198411.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7603/20477603/exterior_front_driver-1774779198411.jpg saved to cache
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4ba5c87-308b-57b1-8bd4-0d06a5e0a7aa
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d666290>
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ba5c87-308b-57b1-8bd4-0d06a5e0a7aa/f4ba5c87-308b-57b1-8bd4-0d06a5e0a7aa_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7603%252F20477603%252Fexterior_rear_driver-1774779359329.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7603/20477603/exterior_rear_driver-1774779359329.jpg saved to cache
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4ba5c87-308b-57b1-8bd4-0d06a5e0a7aa
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db56f90>
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f390739-ddb2-5347-9f90-c6d918e7acf5/7f390739-ddb2-5347-9f90-c6d918e7acf5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2029%252F19102029%252Finterior_boot-1774696692378.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2029/19102029/interior_boot-1774696692378.jpg saved to cache
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f390739-ddb2-5347-9f90-c6d918e7acf5
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2caec750>
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f390739-ddb2-5347-9f90-c6d918e7acf5/7f390739-ddb2-5347-9f90-c6d918e7acf5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2029%252F19102029%252Fdocs_service_history-1774696877691.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De69f9b712127d27ed7d2c0b7450f9828') HTTP/1.1" 204 0
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2029/19102029/docs_service_history-1774696877691.jpg?ixlib=js-3.8.0&auto=format&s=e69f9b712127d27ed7d2c0b7450f9828 saved to cache
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f390739-ddb2-5347-9f90-c6d918e7acf5
2026-03-29 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9614/16699614/docs_service_history-1774617104909.jpg?ixlib=js-3.8.0&auto=format&s=139c24549d912d153f46a149cad761d8> (referer: None)
2026-03-29 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9206/19659206/19659206-docs_service_history-modified-1774694333225.jpeg?ixlib=js-3.8.0&auto=format&s=55e3b2697e713865fa52dd50efabdd09> (referer: None)
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f6c2ed0>
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da6636d6-8900-59b7-98cb-ae3ad9e0f626/da6636d6-8900-59b7-98cb-ae3ad9e0f626_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9614%252F16699614%252Fdocs_service_history-1774617104909.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D139c24549d912d153f46a149cad761d8') HTTP/1.1" 204 0
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9614/16699614/docs_service_history-1774617104909.jpg?ixlib=js-3.8.0&auto=format&s=139c24549d912d153f46a149cad761d8 saved to cache
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da6636d6-8900-59b7-98cb-ae3ad9e0f626
2026-03-29 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19960160.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11207891.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb8fc10>
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0437239-6b5f-5225-baec-5c0383863cab/b0437239-6b5f-5225-baec-5c0383863cab_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9206%252F19659206%252F19659206-docs_service_history-modified-1774694333225.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D55e3b2697e713865fa52dd50efabdd09') HTTP/1.1" 204 0
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9206/19659206/19659206-docs_service_history-modified-1774694333225.jpeg?ixlib=js-3.8.0&auto=format&s=55e3b2697e713865fa52dd50efabdd09 saved to cache
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0437239-6b5f-5225-baec-5c0383863cab
2026-03-29 20:14:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7000352d-e8d6-55b5-a8b1-6ebc11b3bb5d with identifier: 19960160
2026-03-29 20:14:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7000352d-e8d6-55b5-a8b1-6ebc11b3bb5d with scrape type 1
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7000352d-e8d6-55b5-a8b1-6ebc11b3bb5d
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0160%252F19960160%252Fexterior_front_driver-1774786077533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0160/19960160/exterior_front_driver-1774786077533.jpg not downloaded yet
2026-03-29 20:14:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e78991d1-295f-5d71-ae8d-f0a4a9e7fe52 with identifier: 11207891
2026-03-29 20:14:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78991d1-295f-5d71-ae8d-f0a4a9e7fe52 with scrape type 1
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e78991d1-295f-5d71-ae8d-f0a4a9e7fe52
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7891%252F11207891%252Fexterior_front_driver-1774710018201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7891/11207891/exterior_front_driver-1774710018201.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0160%252F19960160%252Fexterior_rear_driver-1774786102260.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0160/19960160/exterior_rear_driver-1774786102260.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7891%252F11207891%252Fexterior_rear_driver-1774710073117.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7891/11207891/exterior_rear_driver-1774710073117.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0160%252F19960160%252Fexterior_front_passenger-1774786172667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0160/19960160/exterior_front_passenger-1774786172667.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7891%252F11207891%252Fexterior_front_passenger-1774710048869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7891/11207891/exterior_front_passenger-1774710048869.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0160%252F19960160%252Fexterior_rear_passenger-1774786117042.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0160/19960160/exterior_rear_passenger-1774786117042.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7891%252F11207891%252Fexterior_rear_passenger-1774710108119.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7891/11207891/exterior_rear_passenger-1774710108119.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0160%252F19960160%252Finterior_front_seats-1774786832029.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0160/19960160/interior_front_seats-1774786832029.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7891%252F11207891%252Finterior_front_seats-1774776968256.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7891/11207891/interior_front_seats-1774776968256.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0160%252F19960160%252Finterior_rear_seats-1774786879835.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0160/19960160/interior_rear_seats-1774786879835.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7891%252F11207891%252Finterior_rear_seats-1774613012253.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7891/11207891/interior_rear_seats-1774613012253.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0160%252F19960160%252Finterior_dashboard-1774786905236.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0160/19960160/interior_dashboard-1774786905236.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7891%252F11207891%252Finterior_dashboard-1774777216670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7891/11207891/interior_dashboard-1774777216670.jpg not downloaded yet
2026-03-29 20:14:57 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12742555) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9206/19659206/interior_boot-1774447648717.jpeg>.
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0160%252F19960160%252Finstrument_cluster-1774786921359.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0160/19960160/instrument_cluster-1774786921359.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7891%252F11207891%252Finstrument_cluster-1774613372484.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7891/11207891/instrument_cluster-1774613372484.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0160%252F19960160%252Finterior_boot-1774786959277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0160/19960160/interior_boot-1774786959277.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7891%252F11207891%252Finterior_boot-1774613448101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7891/11207891/interior_boot-1774613448101.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0160%252F19960160%252Fdocs_service_history-1774787180267.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De11368f228d89adc28b9b10672c03317%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0160/19960160/docs_service_history-1774787180267.jpg?ixlib=js-3.8.0&auto=format&s=e11368f228d89adc28b9b10672c03317 not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7891%252F11207891%252Fdocs_service_history-1774613887667.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddbd20fc7e3980901a686640f3d481c92%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7891/11207891/docs_service_history-1774613887667.jpg?ixlib=js-3.8.0&auto=format&s=dbd20fc7e3980901a686640f3d481c92 not downloaded yet
2026-03-29 20:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9614/16699614/instrument_cluster-1774616636823.jpg> (referer: None)
2026-03-29 20:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9614/16699614/interior_dashboard-1774617869653.jpg> (referer: None)
2026-03-29 20:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9614/16699614/interior_boot-1774616664253.jpg> (referer: None)
2026-03-29 20:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9206/19659206/interior_dashboard-1774447682423.jpeg> (referer: None)
2026-03-29 20:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7891/11207891/docs_service_history-1774613887667.jpg?ixlib=js-3.8.0&auto=format&s=dbd20fc7e3980901a686640f3d481c92> (referer: None)
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db6f4d0>
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da6636d6-8900-59b7-98cb-ae3ad9e0f626/da6636d6-8900-59b7-98cb-ae3ad9e0f626_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9614%252F16699614%252Finstrument_cluster-1774616636823.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9614/16699614/instrument_cluster-1774616636823.jpg saved to cache
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da6636d6-8900-59b7-98cb-ae3ad9e0f626
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cb7fa90>
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da6636d6-8900-59b7-98cb-ae3ad9e0f626/da6636d6-8900-59b7-98cb-ae3ad9e0f626_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9614%252F16699614%252Finterior_dashboard-1774617869653.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9614/16699614/interior_dashboard-1774617869653.jpg saved to cache
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da6636d6-8900-59b7-98cb-ae3ad9e0f626
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c786ed0>
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da6636d6-8900-59b7-98cb-ae3ad9e0f626/da6636d6-8900-59b7-98cb-ae3ad9e0f626_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9614%252F16699614%252Finterior_boot-1774616664253.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9614/16699614/interior_boot-1774616664253.jpg saved to cache
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da6636d6-8900-59b7-98cb-ae3ad9e0f626
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd64510>
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0437239-6b5f-5225-baec-5c0383863cab/b0437239-6b5f-5225-baec-5c0383863cab_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9206%252F19659206%252Finterior_dashboard-1774447682423.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9206/19659206/interior_dashboard-1774447682423.jpeg saved to cache
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0437239-6b5f-5225-baec-5c0383863cab
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f3c3bd0>
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78991d1-295f-5d71-ae8d-f0a4a9e7fe52/e78991d1-295f-5d71-ae8d-f0a4a9e7fe52_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7891%252F11207891%252Fdocs_service_history-1774613887667.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddbd20fc7e3980901a686640f3d481c92') HTTP/1.1" 204 0
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7891/11207891/docs_service_history-1774613887667.jpg?ixlib=js-3.8.0&auto=format&s=dbd20fc7e3980901a686640f3d481c92 saved to cache
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e78991d1-295f-5d71-ae8d-f0a4a9e7fe52
2026-03-29 20:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1908&page=53&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9206/19659206/instrument_cluster-1774447643068.jpeg> (referer: None)
2026-03-29 20:14:58 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9206/19659206/interior_boot-1774447648717.jpeg>.
2026-03-29 20:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9206/19659206/interior_boot-1774447648717.jpeg> (referer: None)
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 9062152
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 19954609
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 12359384
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712359384%27 HTTP/1.1" 200 None
2026-03-29 20:14:58 [motorway.uk] INFO: Scrape type for 12359384: 1
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 14847848
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714847848%27 HTTP/1.1" 200 None
2026-03-29 20:14:58 [motorway.uk] INFO: Scrape type for 14847848: 0
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 12755614
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 18679301
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 19373219
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20373120
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20482025
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20426695
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20459280
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20471330
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 5242305
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20489878
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20459194
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20361581
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 7629441
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277629441%27 HTTP/1.1" 200 None
2026-03-29 20:14:58 [motorway.uk] INFO: Scrape type for 7629441: 1
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 16803128
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 19648978
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 19596595
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20469217
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20419457
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 6138860
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 19989117
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719989117%27 HTTP/1.1" 200 None
2026-03-29 20:14:58 [motorway.uk] INFO: Scrape type for 19989117: 1
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x8c`\x1e\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\xf2\x89\x00\x8cU\x8e\x00\x00\x00\x00'
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd66810>
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0437239-6b5f-5225-baec-5c0383863cab/b0437239-6b5f-5225-baec-5c0383863cab_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9206%252F19659206%252Finstrument_cluster-1774447643068.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9206/19659206/instrument_cluster-1774447643068.jpeg saved to cache
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0437239-6b5f-5225-baec-5c0383863cab
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 19392405
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719392405%27 HTTP/1.1" 200 None
2026-03-29 20:14:58 [motorway.uk] INFO: Scrape type for 19392405: 1
2026-03-29 20:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0160/19960160/docs_service_history-1774787180267.jpg?ixlib=js-3.8.0&auto=format&s=e11368f228d89adc28b9b10672c03317> (referer: None)
2026-03-29 20:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/6935357.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xbbb\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07\x0c\xdb\x00\xbbX0\x00\x00\x00\x00'
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de35710>
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0437239-6b5f-5225-baec-5c0383863cab/b0437239-6b5f-5225-baec-5c0383863cab_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9206%252F19659206%252Finterior_boot-1774447648717.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9206/19659206/interior_boot-1774447648717.jpeg saved to cache
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0437239-6b5f-5225-baec-5c0383863cab
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20474362
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 1060711
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20490214
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 18643660
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20430885
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 3094669
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 4051163
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274051163%27 HTTP/1.1" 200 None
2026-03-29 20:14:58 [motorway.uk] INFO: Scrape type for 4051163: 1
2026-03-29 20:14:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20486494
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 10305678
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 172417
2026-03-29 20:14:58 [motorway.uk] INFO: Found listing with ID: 20393095
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720393095%27 HTTP/1.1" 200 None
2026-03-29 20:14:58 [motorway.uk] INFO: Scrape type for 20393095: 1
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0b5e50>
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7000352d-e8d6-55b5-a8b1-6ebc11b3bb5d/7000352d-e8d6-55b5-a8b1-6ebc11b3bb5d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0160%252F19960160%252Fdocs_service_history-1774787180267.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De11368f228d89adc28b9b10672c03317') HTTP/1.1" 204 0
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0160/19960160/docs_service_history-1774787180267.jpg?ixlib=js-3.8.0&auto=format&s=e11368f228d89adc28b9b10672c03317 saved to cache
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7000352d-e8d6-55b5-a8b1-6ebc11b3bb5d
2026-03-29 20:14:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c545100-88dc-5019-9e85-92708936c95c with identifier: 6935357
2026-03-29 20:14:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c545100-88dc-5019-9e85-92708936c95c with scrape type 1
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c545100-88dc-5019-9e85-92708936c95c
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5357%252F6935357%252Fexterior_front_driver-1774696850277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5357/6935357/exterior_front_driver-1774696850277.jpg not downloaded yet
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5357%252F6935357%252Fexterior_rear_driver-1774696874387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5357/6935357/exterior_rear_driver-1774696874387.jpg not downloaded yet
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5357%252F6935357%252Fexterior_front_passenger-1774696933890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5357/6935357/exterior_front_passenger-1774696933890.jpg not downloaded yet
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5357%252F6935357%252Fexterior_rear_passenger-1774696902101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5357/6935357/exterior_rear_passenger-1774696902101.jpg not downloaded yet
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5357%252F6935357%252Finterior_front_seats-1774697085793.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5357/6935357/interior_front_seats-1774697085793.jpg not downloaded yet
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5357%252F6935357%252Finterior_rear_seats-1774697328184.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5357/6935357/interior_rear_seats-1774697328184.jpg not downloaded yet
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5357%252F6935357%252Finterior_dashboard-1774697127320.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5357/6935357/interior_dashboard-1774697127320.jpg not downloaded yet
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5357%252F6935357%252Finstrument_cluster-1774699586833.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5357/6935357/instrument_cluster-1774699586833.jpg not downloaded yet
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5357%252F6935357%252Finterior_boot-1774697116872.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5357/6935357/interior_boot-1774697116872.jpg not downloaded yet
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5357%252F6935357%252Fwheels_front_driver-1774696933036.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5357/6935357/wheels_front_driver-1774696933036.jpg not downloaded yet
2026-03-29 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7891/11207891/instrument_cluster-1774613372484.jpg> (referer: None)
2026-03-29 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7891/11207891/interior_boot-1774613448101.jpg> (referer: None)
2026-03-29 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0160/19960160/instrument_cluster-1774786921359.jpg> (referer: None)
2026-03-29 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0160/19960160/interior_boot-1774786959277.jpg> (referer: None)
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc701d0>
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78991d1-295f-5d71-ae8d-f0a4a9e7fe52/e78991d1-295f-5d71-ae8d-f0a4a9e7fe52_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7891%252F11207891%252Finstrument_cluster-1774613372484.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7891/11207891/instrument_cluster-1774613372484.jpg saved to cache
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e78991d1-295f-5d71-ae8d-f0a4a9e7fe52
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f608910>
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78991d1-295f-5d71-ae8d-f0a4a9e7fe52/e78991d1-295f-5d71-ae8d-f0a4a9e7fe52_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7891%252F11207891%252Finterior_boot-1774613448101.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7891/11207891/interior_boot-1774613448101.jpg saved to cache
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e78991d1-295f-5d71-ae8d-f0a4a9e7fe52
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7f0e10>
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7000352d-e8d6-55b5-a8b1-6ebc11b3bb5d/7000352d-e8d6-55b5-a8b1-6ebc11b3bb5d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0160%252F19960160%252Finstrument_cluster-1774786921359.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0160/19960160/instrument_cluster-1774786921359.jpg saved to cache
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7000352d-e8d6-55b5-a8b1-6ebc11b3bb5d
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca0a190>
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7000352d-e8d6-55b5-a8b1-6ebc11b3bb5d/7000352d-e8d6-55b5-a8b1-6ebc11b3bb5d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0160%252F19960160%252Finterior_boot-1774786959277.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0160/19960160/interior_boot-1774786959277.jpg saved to cache
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7000352d-e8d6-55b5-a8b1-6ebc11b3bb5d
2026-03-29 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20385846.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5357/6935357/wheels_front_driver-1774696933036.jpg> (referer: None)
2026-03-29 20:15:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7d2c267-0952-587d-a674-ac08884d3587 with identifier: 20385846
2026-03-29 20:15:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d2c267-0952-587d-a674-ac08884d3587 with scrape type 1
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7d2c267-0952-587d-a674-ac08884d3587
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5846%252F20385846%252Fexterior_front_driver-1774710981422.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_front_driver-1774710981422.jpg not downloaded yet
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5846%252F20385846%252Fexterior_rear_driver-1774710618469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_rear_driver-1774710618469.jpg not downloaded yet
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5846%252F20385846%252Fexterior_front_passenger-1774710956144.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_front_passenger-1774710956144.jpg not downloaded yet
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f419610>
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c545100-88dc-5019-9e85-92708936c95c/6c545100-88dc-5019-9e85-92708936c95c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5357%252F6935357%252Fwheels_front_driver-1774696933036.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5357/6935357/wheels_front_driver-1774696933036.jpg saved to cache
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c545100-88dc-5019-9e85-92708936c95c
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5846%252F20385846%252Fexterior_rear_passenger-1774710629222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_rear_passenger-1774710629222.jpg not downloaded yet
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5846%252F20385846%252Finterior_front_seats-1774725520375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5846/20385846/interior_front_seats-1774725520375.jpg not downloaded yet
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5846%252F20385846%252Finterior_rear_seats-1774711448322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5846/20385846/interior_rear_seats-1774711448322.jpg not downloaded yet
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5846%252F20385846%252Finterior_dashboard-1774711617084.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5846/20385846/interior_dashboard-1774711617084.jpg not downloaded yet
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5846%252F20385846%252Finterior_boot-1774711500516.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5846/20385846/interior_boot-1774711500516.jpg not downloaded yet
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5846%252F20385846%252Fdocs_service_history-1774712167220.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D119cd40b992a0ace5621ba2d9c18611c%27 HTTP/1.1" 200 None
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5846/20385846/docs_service_history-1774712167220.jpg?ixlib=js-3.8.0&auto=format&s=119cd40b992a0ace5621ba2d9c18611c not downloaded yet
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5846%252F20385846%252Fdocs_service_history-1774712169019.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbfb78215bdd2105322127128ab7c32a2%27 HTTP/1.1" 200 None
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5846/20385846/docs_service_history-1774712169019.jpg?ixlib=js-3.8.0&auto=format&s=bfb78215bdd2105322127128ab7c32a2 not downloaded yet
2026-03-29 20:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5357/6935357/interior_boot-1774697116872.jpg> (referer: None)
2026-03-29 20:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5357/6935357/interior_dashboard-1774697127320.jpg> (referer: None)
2026-03-29 20:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5357/6935357/interior_rear_seats-1774697328184.jpg> (referer: None)
2026-03-29 20:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5357/6935357/interior_front_seats-1774697085793.jpg> (referer: None)
2026-03-29 20:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5357/6935357/instrument_cluster-1774699586833.jpg> (referer: None)
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f389550>
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c545100-88dc-5019-9e85-92708936c95c/6c545100-88dc-5019-9e85-92708936c95c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5357%252F6935357%252Finterior_boot-1774697116872.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5357/6935357/interior_boot-1774697116872.jpg saved to cache
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c545100-88dc-5019-9e85-92708936c95c
2026-03-29 20:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20343787.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d718b10>
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c545100-88dc-5019-9e85-92708936c95c/6c545100-88dc-5019-9e85-92708936c95c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5357%252F6935357%252Finterior_dashboard-1774697127320.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5357/6935357/interior_dashboard-1774697127320.jpg saved to cache
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c545100-88dc-5019-9e85-92708936c95c
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d748710>
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c545100-88dc-5019-9e85-92708936c95c/6c545100-88dc-5019-9e85-92708936c95c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5357%252F6935357%252Finterior_rear_seats-1774697328184.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5357/6935357/interior_rear_seats-1774697328184.jpg saved to cache
2026-03-29 20:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c545100-88dc-5019-9e85-92708936c95c
2026-03-29 20:15:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d4c5c50>
2026-03-29 20:15:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c545100-88dc-5019-9e85-92708936c95c/6c545100-88dc-5019-9e85-92708936c95c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5357%252F6935357%252Finterior_front_seats-1774697085793.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5357/6935357/interior_front_seats-1774697085793.jpg saved to cache
2026-03-29 20:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c545100-88dc-5019-9e85-92708936c95c
2026-03-29 20:15:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c907a10>
2026-03-29 20:15:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c545100-88dc-5019-9e85-92708936c95c/6c545100-88dc-5019-9e85-92708936c95c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5357%252F6935357%252Finstrument_cluster-1774699586833.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5357/6935357/instrument_cluster-1774699586833.jpg saved to cache
2026-03-29 20:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c545100-88dc-5019-9e85-92708936c95c
2026-03-29 20:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5846/20385846/docs_service_history-1774712169019.jpg?ixlib=js-3.8.0&auto=format&s=bfb78215bdd2105322127128ab7c32a2> (referer: None)
2026-03-29 20:15:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db45070b-febd-5f28-91e9-25d12a7e2d3d with identifier: 20343787
2026-03-29 20:15:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db45070b-febd-5f28-91e9-25d12a7e2d3d with scrape type 2
2026-03-29 20:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db45070b-febd-5f28-91e9-25d12a7e2d3d with scrape type 2
2026-03-29 20:15:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: db45070b-febd-5f28-91e9-25d12a7e2d3d, identifier: 20343787
2026-03-29 20:15:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: db45070b-febd-5f28-91e9-25d12a7e2d3d with identifier: 20343787
2026-03-29 20:15:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: db45070b-febd-5f28-91e9-25d12a7e2d3d with identifier: 20343787
2026-03-29 20:15:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: db45070b-febd-5f28-91e9-25d12a7e2d3d with identifier: 20343787 to the API
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20343787.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '0.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'db45070b-febd-5f28-91e9-25d12a7e2d3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RJ19 UDW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20343787',
'listing': 'auction',
'location': 'Perth and Kinross Perth',
'make': 'Fiat',
'model': 'Panda',
'odometer': 67445,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 6248,
'price_includes_vat': False,
'registration_date': '2019-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Fiat Panda Waze Edition Twinair 4X4',
'transmission': 'manual',
'trim': 'Waze Edition Twinair 4X4',
'vin': 'ZFA31200003C33261',
'year': 2019}
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720343787%27 HTTP/1.1" 200 None
2026-03-29 20:15:02 [motorway.uk] INFO: Saving data for 20343787: {'auction_closing_time': 1774884600.0, 'created_time': 1774556509.151934, 'last_price_update_time': 1774815302.409521}
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20343787') HTTP/1.1" 204 0
2026-03-29 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20467775.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2db23950>
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5846%252F20385846%252Fdocs_service_history-1774712169019.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbfb78215bdd2105322127128ab7c32a2') HTTP/1.1" 204 0
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5846/20385846/docs_service_history-1774712169019.jpg?ixlib=js-3.8.0&auto=format&s=bfb78215bdd2105322127128ab7c32a2 saved to cache
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7d2c267-0952-587d-a674-ac08884d3587
2026-03-29 20:15:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5846/20385846/docs_service_history-1774712167220.jpg?ixlib=js-3.8.0&auto=format&s=119cd40b992a0ace5621ba2d9c18611c> (referer: None)
2026-03-29 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5846/20385846/interior_front_seats-1774725520375.jpg> (referer: None)
2026-03-29 20:15:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d876861-e41b-5176-a0d5-179b4c20700e with identifier: 20467775
2026-03-29 20:15:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d876861-e41b-5176-a0d5-179b4c20700e with scrape type 1
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d876861-e41b-5176-a0d5-179b4c20700e
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7775%252F20467775%252Fexterior_front_driver-1774697828901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7775/20467775/exterior_front_driver-1774697828901.jpg not downloaded yet
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7775%252F20467775%252Fexterior_rear_driver-1774697829710.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7775/20467775/exterior_rear_driver-1774697829710.jpg not downloaded yet
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7775%252F20467775%252Fexterior_front_passenger-1774697824790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7775/20467775/exterior_front_passenger-1774697824790.jpg not downloaded yet
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7775%252F20467775%252Fexterior_rear_passenger-1774697825366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7775/20467775/exterior_rear_passenger-1774697825366.jpg not downloaded yet
2026-03-29 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20178495.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d929350>
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5846%252F20385846%252Fdocs_service_history-1774712167220.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D119cd40b992a0ace5621ba2d9c18611c') HTTP/1.1" 204 0
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5846/20385846/docs_service_history-1774712167220.jpg?ixlib=js-3.8.0&auto=format&s=119cd40b992a0ace5621ba2d9c18611c saved to cache
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7d2c267-0952-587d-a674-ac08884d3587
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7775%252F20467775%252Finterior_front_seats-1774699971178.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7775/20467775/interior_front_seats-1774699971178.jpg not downloaded yet
2026-03-29 20:15:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5e3290>
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5846%252F20385846%252Finterior_front_seats-1774725520375.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5846/20385846/interior_front_seats-1774725520375.jpg saved to cache
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7d2c267-0952-587d-a674-ac08884d3587
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7775%252F20467775%252Finterior_rear_seats-1774699907072.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7775/20467775/interior_rear_seats-1774699907072.jpg not downloaded yet
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7775%252F20467775%252Finterior_dashboard-1774699648693.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7775/20467775/interior_dashboard-1774699648693.jpg not downloaded yet
2026-03-29 20:15:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f5f2ac-5511-5533-8bb0-82b3fcf9455f with identifier: 20178495
2026-03-29 20:15:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f5f2ac-5511-5533-8bb0-82b3fcf9455f with scrape type 1
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4f5f2ac-5511-5533-8bb0-82b3fcf9455f
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8495%252F20178495%252Fexterior_front_driver-1774713530726.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8495/20178495/exterior_front_driver-1774713530726.jpeg not downloaded yet
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7775%252F20467775%252Finterior_boot-1774699624009.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7775/20467775/interior_boot-1774699624009.jpg not downloaded yet
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8495%252F20178495%252Fexterior_rear_driver-1774713206216.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8495/20178495/exterior_rear_driver-1774713206216.jpeg not downloaded yet
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7775%252F20467775%252Fdocs_service_history-1774700523050.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D382c1993fe031b6f18ed8b0513f3bd98%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7775/20467775/docs_service_history-1774700523050.jpg?ixlib=js-3.8.0&auto=format&s=382c1993fe031b6f18ed8b0513f3bd98 not downloaded yet
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8495%252F20178495%252Fexterior_front_passenger-1774713581388.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8495/20178495/exterior_front_passenger-1774713581388.jpeg not downloaded yet
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7775%252F20467775%252Fdamage_scratches-1774698174425.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7775/20467775/damage_scratches-1774698174425.jpg not downloaded yet
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8495%252F20178495%252Fexterior_rear_passenger-1774712961174.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8495/20178495/exterior_rear_passenger-1774712961174.jpeg not downloaded yet
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8495%252F20178495%252Finterior_front_seats-1774713124591.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8495/20178495/interior_front_seats-1774713124591.jpeg not downloaded yet
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8495%252F20178495%252Finterior_rear_seats-1774713173085.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8495/20178495/interior_rear_seats-1774713173085.jpeg not downloaded yet
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8495%252F20178495%252Finterior_dashboard-1774713154303.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8495/20178495/interior_dashboard-1774713154303.jpeg not downloaded yet
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5846/20385846/interior_boot-1774711500516.jpg> (referer: None)
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8495%252F20178495%252Finstrument_cluster-1774713244901.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8495/20178495/instrument_cluster-1774713244901.jpeg not downloaded yet
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8495%252F20178495%252Finterior_boot-1774713155320.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8495/20178495/interior_boot-1774713155320.jpeg not downloaded yet
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5846/20385846/interior_rear_seats-1774711448322.jpg> (referer: None)
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8495%252F20178495%252Fdocs_service_history-1774714460684.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2b609df210e91f7d29ea65fb8f015c26%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8495/20178495/docs_service_history-1774714460684.jpeg?ixlib=js-3.8.0&auto=format&s=2b609df210e91f7d29ea65fb8f015c26 not downloaded yet
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5846/20385846/interior_dashboard-1774711617084.jpg> (referer: None)
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_rear_passenger-1774710629222.jpg> (referer: None)
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_front_driver-1774710981422.jpg> (referer: None)
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_rear_driver-1774710618469.jpg> (referer: None)
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c4ed110>
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5846%252F20385846%252Finterior_boot-1774711500516.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5846/20385846/interior_boot-1774711500516.jpg saved to cache
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7d2c267-0952-587d-a674-ac08884d3587
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_front_passenger-1774710956144.jpg> (referer: None)
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de9ad90>
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5846%252F20385846%252Finterior_rear_seats-1774711448322.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5846/20385846/interior_rear_seats-1774711448322.jpg saved to cache
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7d2c267-0952-587d-a674-ac08884d3587
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5dd850>
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5846%252F20385846%252Finterior_dashboard-1774711617084.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5846/20385846/interior_dashboard-1774711617084.jpg saved to cache
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7d2c267-0952-587d-a674-ac08884d3587
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2de297d0>
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5846%252F20385846%252Fexterior_rear_passenger-1774710629222.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_rear_passenger-1774710629222.jpg saved to cache
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7d2c267-0952-587d-a674-ac08884d3587
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f5ddfd0>
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5846%252F20385846%252Fexterior_front_driver-1774710981422.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_front_driver-1774710981422.jpg saved to cache
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7d2c267-0952-587d-a674-ac08884d3587
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5b5c50>
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5846%252F20385846%252Fexterior_rear_driver-1774710618469.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_rear_driver-1774710618469.jpg saved to cache
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7d2c267-0952-587d-a674-ac08884d3587
2026-03-29 20:15:04 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (13869191) larger than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/8495/20178495/interior_dashboard-1774713154303.jpeg>.
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4de8d0>
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5846%252F20385846%252Fexterior_front_passenger-1774710956144.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_front_passenger-1774710956144.jpg saved to cache
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7d2c267-0952-587d-a674-ac08884d3587
2026-03-29 20:15:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7d2c267-0952-587d-a674-ac08884d3587, skipping ID generation
2026-03-29 20:15:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d2c267-0952-587d-a674-ac08884d3587 with scrape type 1
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7d2c267-0952-587d-a674-ac08884d3587 sending to next pipeline
2026-03-29 20:15:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a7d2c267-0952-587d-a674-ac08884d3587, identifier: 20385846
2026-03-29 20:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7775/20467775/exterior_rear_passenger-1774697825366.jpg> (referer: None)
2026-03-29 20:15:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a7d2c267-0952-587d-a674-ac08884d3587 with identifier: 20385846
2026-03-29 20:15:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a7d2c267-0952-587d-a674-ac08884d3587 with identifier: 20385846
2026-03-29 20:15:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a7d2c267-0952-587d-a674-ac08884d3587 with identifier: 20385846 to the API
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_front_passenger-1774710956144.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '0.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a7d2c267-0952-587d-a674-ac08884d3587',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CP12 XRA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20385846',
'listing': 'auction',
'location': 'Herefordshire Ross-on-Wye',
'make': 'Fiat',
'model': 'Panda',
'odometer': 62759,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2093332,
'Height': 2833,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_front_driver-1774710981422.jpg',
'Width': 3777},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2012469,
'Height': 2969,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_rear_driver-1774710618469.jpg',
'Width': 3959},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2287153,
'Height': 3017,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_front_passenger-1774710956144.jpg',
'Width': 4022},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1884222,
'Height': 2793,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5846/20385846/exterior_rear_passenger-1774710629222.jpg',
'Width': 3724},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1387605,
'Height': 2466,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5846/20385846/interior_front_seats-1774725520375.jpg',
'Width': 3288},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3640527,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5846/20385846/interior_rear_seats-1774711448322.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3476749,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5846/20385846/interior_dashboard-1774711617084.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3444749,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5846/20385846/interior_boot-1774711500516.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 890793,
'Height': 1652,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5846/20385846/docs_service_history-1774712167220.jpg?ixlib=js-3.8.0&auto=format&s=119cd40b992a0ace5621ba2d9c18611c',
'Width': 1801},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d2c267-0952-587d-a674-ac08884d3587/a7d2c267-0952-587d-a674-ac08884d3587_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363190,
'Height': 1743,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5846/20385846/docs_service_history-1774712169019.jpg?ixlib=js-3.8.0&auto=format&s=bfb78215bdd2105322127128ab7c32a2',
'Width': 2457}],
'price': 3819,
'price_includes_vat': False,
'registration_date': '2012-08-02',
'seats_number': None,
'seller_name': None,
'title': 'Fiat Panda Easy Twinair S-A',
'transmission': 'automatic',
'trim': 'Easy Twinair S-A',
'vin': 'ZFA31200003054200',
'year': 2012}
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720385846%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [motorway.uk] INFO: Saving data for 20385846: {'created_time': 1774815305.022786, 'last_price_update_time': 1774815305.022857, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20385846') HTTP/1.1" 204 0
2026-03-29 20:15:05 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12110201) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8495/20178495/interior_boot-1774713155320.jpeg>.
2026-03-29 20:15:05 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12987228) larger than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/8495/20178495/instrument_cluster-1774713244901.jpeg>.
2026-03-29 20:15:05 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (15352646) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8495/20178495/interior_rear_seats-1774713173085.jpeg>.
2026-03-29 20:15:05 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (16348350) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8495/20178495/interior_front_seats-1774713124591.jpeg>.
2026-03-29 20:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16030569.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5f5850>
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d876861-e41b-5176-a0d5-179b4c20700e/6d876861-e41b-5176-a0d5-179b4c20700e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7775%252F20467775%252Fexterior_rear_passenger-1774697825366.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7775/20467775/exterior_rear_passenger-1774697825366.jpg saved to cache
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d876861-e41b-5176-a0d5-179b4c20700e
2026-03-29 20:15:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b95a642-2f31-520d-9774-c0007ed89972 with identifier: 16030569
2026-03-29 20:15:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b95a642-2f31-520d-9774-c0007ed89972 with scrape type 1
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b95a642-2f31-520d-9774-c0007ed89972
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0569%252F16030569%252Fexterior_front_driver-1774172714218.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0569/16030569/exterior_front_driver-1774172714218.jpg not downloaded yet
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0569%252F16030569%252Fexterior_rear_driver-1774172766537.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0569/16030569/exterior_rear_driver-1774172766537.jpg not downloaded yet
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0569%252F16030569%252Fexterior_front_passenger-1774172781099.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0569/16030569/exterior_front_passenger-1774172781099.jpg not downloaded yet
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0569%252F16030569%252Fexterior_rear_passenger-1774172766712.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0569/16030569/exterior_rear_passenger-1774172766712.jpg not downloaded yet
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0569%252F16030569%252Finterior_front_seats-1774607548769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0569/16030569/interior_front_seats-1774607548769.jpg not downloaded yet
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0569%252F16030569%252Finterior_rear_seats-1774607575273.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0569/16030569/interior_rear_seats-1774607575273.jpg not downloaded yet
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0569%252F16030569%252Finterior_dashboard-1774607645701.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0569/16030569/interior_dashboard-1774607645701.jpg not downloaded yet
2026-03-29 20:15:05 [scrapy.extensions.logstats] INFO: Crawled 423 pages (at 37 pages/min), scraped 215 items (at 28 items/min)
2026-03-29 20:15:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 302MiB
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0569%252F16030569%252Finstrument_cluster-1774607643424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0569/16030569/instrument_cluster-1774607643424.jpg not downloaded yet
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0569%252F16030569%252Finterior_boot-1774607648577.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0569/16030569/interior_boot-1774607648577.jpg not downloaded yet
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0569%252F16030569%252Fdamage_scratches-1774172853295.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0569/16030569/damage_scratches-1774172853295.jpg not downloaded yet
2026-03-29 20:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8495/20178495/docs_service_history-1774714460684.jpeg?ixlib=js-3.8.0&auto=format&s=2b609df210e91f7d29ea65fb8f015c26> (referer: None)
2026-03-29 20:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7775/20467775/damage_scratches-1774698174425.jpg> (referer: None)
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dd64990>
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f5f2ac-5511-5533-8bb0-82b3fcf9455f/a4f5f2ac-5511-5533-8bb0-82b3fcf9455f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8495%252F20178495%252Fdocs_service_history-1774714460684.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2b609df210e91f7d29ea65fb8f015c26') HTTP/1.1" 204 0
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8495/20178495/docs_service_history-1774714460684.jpeg?ixlib=js-3.8.0&auto=format&s=2b609df210e91f7d29ea65fb8f015c26 saved to cache
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a4f5f2ac-5511-5533-8bb0-82b3fcf9455f
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e0e1490>
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d876861-e41b-5176-a0d5-179b4c20700e/6d876861-e41b-5176-a0d5-179b4c20700e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7775%252F20467775%252Fdamage_scratches-1774698174425.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7775/20467775/damage_scratches-1774698174425.jpg saved to cache
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d876861-e41b-5176-a0d5-179b4c20700e
2026-03-29 20:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19392405.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8495/20178495/exterior_rear_passenger-1774712961174.jpeg> (referer: None)
2026-03-29 20:15:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c4466a7-add1-577c-a39a-c2123ae8cd76 with identifier: 19392405
2026-03-29 20:15:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c4466a7-add1-577c-a39a-c2123ae8cd76 with scrape type 1
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c4466a7-add1-577c-a39a-c2123ae8cd76
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2405%252F19392405%252Fexterior_front_driver-1774463244555.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2405/19392405/exterior_front_driver-1774463244555.jpg not downloaded yet
2026-03-29 20:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0569/16030569/damage_scratches-1774172853295.jpg> (referer: None)
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2405%252F19392405%252Fexterior_rear_driver-1774463216895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2405/19392405/exterior_rear_driver-1774463216895.jpg not downloaded yet
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2405%252F19392405%252Fexterior_front_passenger-1774463252490.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2405/19392405/exterior_front_passenger-1774463252490.jpg not downloaded yet
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ca4c490>
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f5f2ac-5511-5533-8bb0-82b3fcf9455f/a4f5f2ac-5511-5533-8bb0-82b3fcf9455f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8495%252F20178495%252Fexterior_rear_passenger-1774712961174.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8495/20178495/exterior_rear_passenger-1774712961174.jpeg saved to cache
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4f5f2ac-5511-5533-8bb0-82b3fcf9455f
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2405%252F19392405%252Fexterior_rear_passenger-1774463243665.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2405/19392405/exterior_rear_passenger-1774463243665.jpg not downloaded yet
2026-03-29 20:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4051163.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2405%252F19392405%252Finterior_front_seats-1774463422681.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2405/19392405/interior_front_seats-1774463422681.jpg not downloaded yet
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dde3690>
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b95a642-2f31-520d-9774-c0007ed89972/2b95a642-2f31-520d-9774-c0007ed89972_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0569%252F16030569%252Fdamage_scratches-1774172853295.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0569/16030569/damage_scratches-1774172853295.jpg saved to cache
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b95a642-2f31-520d-9774-c0007ed89972
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2405%252F19392405%252Finterior_rear_seats-1774463448385.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2405/19392405/interior_rear_seats-1774463448385.jpg not downloaded yet
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2405%252F19392405%252Finterior_dashboard-1774463605483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2405/19392405/interior_dashboard-1774463605483.jpg not downloaded yet
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2405%252F19392405%252Finstrument_cluster-1774463547464.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2405/19392405/instrument_cluster-1774463547464.jpg not downloaded yet
2026-03-29 20:15:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d37151f-4f42-5934-b4b7-b0a2489843ea with identifier: 4051163
2026-03-29 20:15:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d37151f-4f42-5934-b4b7-b0a2489843ea with scrape type 1
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d37151f-4f42-5934-b4b7-b0a2489843ea
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1163%252F4051163%252Fexterior_front_driver-1771951821482.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1163/4051163/exterior_front_driver-1771951821482.jpg not downloaded yet
2026-03-29 20:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19989117.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2405%252F19392405%252Finterior_boot-1774463842717.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2405/19392405/interior_boot-1774463842717.jpg not downloaded yet
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1163%252F4051163%252Fexterior_rear_driver-1771951842386.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1163/4051163/exterior_rear_driver-1771951842386.jpg not downloaded yet
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2405%252F19392405%252F19392405-docs_service_history-modified-1769012266785.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcbae150e5c8ea1ca27a75a1bb26f6b71%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2405/19392405/19392405-docs_service_history-modified-1769012266785.jpeg?ixlib=js-3.8.0&auto=format&s=cbae150e5c8ea1ca27a75a1bb26f6b71 not downloaded yet
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1163%252F4051163%252Fexterior_front_passenger-1771951859707.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1163/4051163/exterior_front_passenger-1771951859707.jpg not downloaded yet
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1163%252F4051163%252Fexterior_rear_passenger-1771951846136.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1163/4051163/exterior_rear_passenger-1771951846136.jpg not downloaded yet
2026-03-29 20:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19307478.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1163%252F4051163%252Finterior_front_seats-1774792931740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1163/4051163/interior_front_seats-1774792931740.jpg not downloaded yet
2026-03-29 20:15:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a99fbd6-f126-5bf6-9cb7-836d87bd1f98 with identifier: 19989117
2026-03-29 20:15:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a99fbd6-f126-5bf6-9cb7-836d87bd1f98 with scrape type 1
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a99fbd6-f126-5bf6-9cb7-836d87bd1f98
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9117%252F19989117%252Fexterior_front_driver-1774625904651.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9117/19989117/exterior_front_driver-1774625904651.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1163%252F4051163%252Finterior_rear_seats-1771952248137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1163/4051163/interior_rear_seats-1771952248137.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9117%252F19989117%252Fexterior_rear_driver-1774625927373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9117/19989117/exterior_rear_driver-1774625927373.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1163%252F4051163%252Finterior_dashboard-1771952118661.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1163/4051163/interior_dashboard-1771952118661.jpg not downloaded yet
2026-03-29 20:15:07 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/8495/20178495/interior_dashboard-1774713154303.jpeg>.
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9117%252F19989117%252Fexterior_front_passenger-1774625944964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9117/19989117/exterior_front_passenger-1774625944964.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1163%252F4051163%252Finstrument_cluster-1771952024606.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1163/4051163/instrument_cluster-1771952024606.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9117%252F19989117%252Fexterior_rear_passenger-1774625934620.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9117/19989117/exterior_rear_passenger-1774625934620.jpg not downloaded yet
2026-03-29 20:15:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cead681-97d8-57e7-bb91-86437a9d3b1d with identifier: 19307478
2026-03-29 20:15:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cead681-97d8-57e7-bb91-86437a9d3b1d with scrape type 1
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2cead681-97d8-57e7-bb91-86437a9d3b1d
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7478%252F19307478%252F19307478-exterior_front_driver-modified-1772559226728.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7478/19307478/19307478-exterior_front_driver-modified-1772559226728.jpeg already downloaded
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7478%252F19307478%252Fexterior_rear_driver-1772471034755.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7478/19307478/exterior_rear_driver-1772471034755.jpeg already downloaded
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7478%252F19307478%252F19307478-exterior_front_passenger-modified-1772559241742.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7478/19307478/19307478-exterior_front_passenger-modified-1772559241742.jpeg already downloaded
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7478%252F19307478%252F19307478-exterior_rear_passenger-modified-1772559249837.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7478/19307478/19307478-exterior_rear_passenger-modified-1772559249837.jpeg already downloaded
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7478%252F19307478%252F19307478-interior_front_seats-modified-1772559260082.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7478/19307478/19307478-interior_front_seats-modified-1772559260082.jpeg already downloaded
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7478%252F19307478%252F19307478-interior_rear_seats-modified-1772559267371.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7478/19307478/19307478-interior_rear_seats-modified-1772559267371.jpeg already downloaded
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7478%252F19307478%252Finterior_dashboard-1772471339637.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7478/19307478/interior_dashboard-1772471339637.jpeg already downloaded
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7478%252F19307478%252Finstrument_cluster-1772471257117.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7478/19307478/instrument_cluster-1772471257117.jpeg already downloaded
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7478%252F19307478%252Finterior_boot-1772471245240.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7478/19307478/interior_boot-1772471245240.jpeg already downloaded
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7478%252F19307478%252F19307478-docs_service_history-modified-1772559417279.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc82f25986ec744f213906462c7577d44%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7478/19307478/19307478-docs_service_history-modified-1772559417279.jpeg?ixlib=js-3.8.0&auto=format&s=c82f25986ec744f213906462c7577d44 already downloaded
2026-03-29 20:15:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2cead681-97d8-57e7-bb91-86437a9d3b1d, identifier: 19307478
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1163%252F4051163%252Finterior_boot-1771952116848.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1163/4051163/interior_boot-1771952116848.jpg not downloaded yet
2026-03-29 20:15:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2cead681-97d8-57e7-bb91-86437a9d3b1d with identifier: 19307478
2026-03-29 20:15:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2cead681-97d8-57e7-bb91-86437a9d3b1d with identifier: 19307478
2026-03-29 20:15:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2cead681-97d8-57e7-bb91-86437a9d3b1d with identifier: 19307478 to the API
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19307478.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '2cead681-97d8-57e7-bb91-86437a9d3b1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY15 AKN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19307478',
'listing': 'auction',
'location': 'Wiltshire Tidworth',
'make': 'SEAT',
'model': 'Leon',
'odometer': 91088,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photo_urls': ['https://motorway-photos-modified.imgix.net/7478/19307478/19307478-exterior_front_driver-modified-1772559226728.jpeg',
'https://motorway-photos-redacted.imgix.net/7478/19307478/exterior_rear_driver-1772471034755.jpeg',
'https://motorway-photos-modified.imgix.net/7478/19307478/19307478-exterior_front_passenger-modified-1772559241742.jpeg',
'https://motorway-photos-modified.imgix.net/7478/19307478/19307478-exterior_rear_passenger-modified-1772559249837.jpeg',
'https://motorway-photos-modified.imgix.net/7478/19307478/19307478-interior_front_seats-modified-1772559260082.jpeg',
'https://motorway-photos-modified.imgix.net/7478/19307478/19307478-interior_rear_seats-modified-1772559267371.jpeg',
'https://motorway-photos-redacted.imgix.net/7478/19307478/interior_dashboard-1772471339637.jpeg',
'https://motorway-photos-redacted.imgix.net/7478/19307478/instrument_cluster-1772471257117.jpeg',
'https://motorway-photos.imgix.net/7478/19307478/interior_boot-1772471245240.jpeg',
'https://motorway-service-history-photos.imgix.net/modified/7478/19307478/19307478-docs_service_history-modified-1772559417279.jpeg?ixlib=js-3.8.0&auto=format&s=c82f25986ec744f213906462c7577d44'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0679e5b-eed0-5105-a88a-be15ed701a9f/a0679e5b-eed0-5105-a88a-be15ed701a9f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1397944,
'Height': 2554,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7478/19307478/19307478-exterior_front_driver-modified-1772559226728.jpeg',
'Width': 3405},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0679e5b-eed0-5105-a88a-be15ed701a9f/a0679e5b-eed0-5105-a88a-be15ed701a9f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1611192,
'Height': 2783,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7478/19307478/exterior_rear_driver-1772471034755.jpeg',
'Width': 3710},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0679e5b-eed0-5105-a88a-be15ed701a9f/a0679e5b-eed0-5105-a88a-be15ed701a9f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2123510,
'Height': 3000,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7478/19307478/19307478-exterior_front_passenger-modified-1772559241742.jpeg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0679e5b-eed0-5105-a88a-be15ed701a9f/a0679e5b-eed0-5105-a88a-be15ed701a9f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1885059,
'Height': 2561,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7478/19307478/19307478-exterior_rear_passenger-modified-1772559249837.jpeg',
'Width': 3415},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0679e5b-eed0-5105-a88a-be15ed701a9f/a0679e5b-eed0-5105-a88a-be15ed701a9f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1320213,
'Height': 2447,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7478/19307478/19307478-interior_front_seats-modified-1772559260082.jpeg',
'Width': 3263},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0679e5b-eed0-5105-a88a-be15ed701a9f/a0679e5b-eed0-5105-a88a-be15ed701a9f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1416950,
'Height': 2639,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7478/19307478/19307478-interior_rear_seats-modified-1772559267371.jpeg',
'Width': 3519},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0679e5b-eed0-5105-a88a-be15ed701a9f/a0679e5b-eed0-5105-a88a-be15ed701a9f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1577548,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7478/19307478/interior_dashboard-1772471339637.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0679e5b-eed0-5105-a88a-be15ed701a9f/a0679e5b-eed0-5105-a88a-be15ed701a9f_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1848361,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7478/19307478/instrument_cluster-1772471257117.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0679e5b-eed0-5105-a88a-be15ed701a9f/a0679e5b-eed0-5105-a88a-be15ed701a9f_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3591473,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7478/19307478/interior_boot-1772471245240.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0679e5b-eed0-5105-a88a-be15ed701a9f/a0679e5b-eed0-5105-a88a-be15ed701a9f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 586543,
'Height': 1580,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7478/19307478/19307478-docs_service_history-modified-1772559417279.jpeg?ixlib=js-3.8.0&auto=format&s=c82f25986ec744f213906462c7577d44',
'Width': 2106}],
'price': 5187,
'price_includes_vat': False,
'registration_date': '2015-03-19',
'seats_number': None,
'seller_name': None,
'title': 'SEAT Leon SE Technology TDI S-A',
'transmission': 'automatic',
'trim': 'SE Technology TDI S-A',
'vin': 'VSSZZZ5FZFR116325',
'year': 2015}
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719307478%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [motorway.uk] INFO: Saving data for 19307478: {'created_time': 1774815308.064553, 'last_price_update_time': 1774815308.064565, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19307478') HTTP/1.1" 204 0
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9117%252F19989117%252Finterior_front_seats-1774626157823.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9117/19989117/interior_front_seats-1774626157823.jpg not downloaded yet
2026-03-29 20:15:08 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8495/20178495/interior_boot-1774713155320.jpeg>.
2026-03-29 20:15:08 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8495/20178495/interior_rear_seats-1774713173085.jpeg>.
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1163%252F4051163%252Fdocs_service_history-1774792849920.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D15dc84331c365f3fd5213b74fd6e1dac%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1163/4051163/docs_service_history-1774792849920.jpg?ixlib=js-3.8.0&auto=format&s=15dc84331c365f3fd5213b74fd6e1dac not downloaded yet
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/7629441.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20464032.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:08 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8495/20178495/interior_front_seats-1774713124591.jpeg>.
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9117%252F19989117%252Finterior_rear_seats-1774626171467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9117/19989117/interior_rear_seats-1774626171467.jpg not downloaded yet
2026-03-29 20:15:08 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/8495/20178495/instrument_cluster-1774713244901.jpeg>.
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2405/19392405/exterior_rear_driver-1774463216895.jpg> (referer: None)
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9117%252F19989117%252Finterior_dashboard-1774626214558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9117/19989117/interior_dashboard-1774626214558.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9117%252F19989117%252Finstrument_cluster-1774771792753.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9117/19989117/instrument_cluster-1774771792753.jpg not downloaded yet
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2405/19392405/exterior_rear_passenger-1774463243665.jpg> (referer: None)
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9117%252F19989117%252Finterior_boot-1774626211339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9117/19989117/interior_boot-1774626211339.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9117%252F19989117%252Fdamage_warning_lights-1774771648940.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9117/19989117/damage_warning_lights-1774771648940.jpg not downloaded yet
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2405/19392405/exterior_front_passenger-1774463252490.jpg> (referer: None)
2026-03-29 20:15:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6193654-b09e-586c-8783-6627265bfd2f with identifier: 7629441
2026-03-29 20:15:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6193654-b09e-586c-8783-6627265bfd2f with scrape type 1
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6193654-b09e-586c-8783-6627265bfd2f
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9441%252F7629441%252F7629441-exterior_front_driver-default-1774531393166.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-exterior_front_driver-default-1774531393166.jpg not downloaded yet
2026-03-29 20:15:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 476dd998-a5df-551f-98cc-22a675a72032 with identifier: 20464032
2026-03-29 20:15:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 476dd998-a5df-551f-98cc-22a675a72032 with scrape type 1
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 476dd998-a5df-551f-98cc-22a675a72032
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20464032%252Fexterior_front_driver-1774693516632.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_front_driver-1774693516632.jpg not downloaded yet
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c905890>
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c4466a7-add1-577c-a39a-c2123ae8cd76/6c4466a7-add1-577c-a39a-c2123ae8cd76_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2405%252F19392405%252Fexterior_rear_driver-1774463216895.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2405/19392405/exterior_rear_driver-1774463216895.jpg saved to cache
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c4466a7-add1-577c-a39a-c2123ae8cd76
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9441%252F7629441%252F7629441-exterior_rear_driver-default-1774531385812.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-exterior_rear_driver-default-1774531385812.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20464032%252Fexterior_rear_driver-1774693506460.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_rear_driver-1774693506460.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9441%252F7629441%252F7629441-exterior_front_passenger-default-1774531381115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-exterior_front_passenger-default-1774531381115.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20464032%252Fexterior_front_passenger-1774693503921.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_front_passenger-1774693503921.jpg not downloaded yet
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f52df90>
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c4466a7-add1-577c-a39a-c2123ae8cd76/6c4466a7-add1-577c-a39a-c2123ae8cd76_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2405%252F19392405%252Fexterior_rear_passenger-1774463243665.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2405/19392405/exterior_rear_passenger-1774463243665.jpg saved to cache
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c4466a7-add1-577c-a39a-c2123ae8cd76
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d970d90>
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c4466a7-add1-577c-a39a-c2123ae8cd76/6c4466a7-add1-577c-a39a-c2123ae8cd76_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2405%252F19392405%252Fexterior_front_passenger-1774463252490.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2405/19392405/exterior_front_passenger-1774463252490.jpg saved to cache
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c4466a7-add1-577c-a39a-c2123ae8cd76
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0569/16030569/instrument_cluster-1774607643424.jpg> (referer: None)
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8495/20178495/exterior_front_passenger-1774713581388.jpeg> (referer: None)
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1163/4051163/exterior_front_driver-1771951821482.jpg> (referer: None)
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9441%252F7629441%252F7629441-exterior_rear_passenger-default-1774531386029.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-exterior_rear_passenger-default-1774531386029.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20464032%252Fexterior_rear_passenger-1774693507699.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_rear_passenger-1774693507699.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9441%252F7629441%252F7629441-interior_front_seats-default-1774531356697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9441/7629441/7629441-interior_front_seats-default-1774531356697.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4032%252F20464032%252Finterior_front_seats-1774694222795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4032/20464032/interior_front_seats-1774694222795.jpg not downloaded yet
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9117/19989117/instrument_cluster-1774771792753.jpg> (referer: None)
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0569/16030569/interior_boot-1774607648577.jpg> (referer: None)
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9441%252F7629441%252F7629441-interior_rear_seats-default-1774531351666.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9441/7629441/7629441-interior_rear_seats-default-1774531351666.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4032%252F20464032%252Finterior_rear_seats-1774694223652.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4032/20464032/interior_rear_seats-1774694223652.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9441%252F7629441%252F7629441-interior_dashboard-modified-1774692306815.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9441/7629441/7629441-interior_dashboard-modified-1774692306815.jpeg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20464032%252Finterior_dashboard-1774694238387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20464032/interior_dashboard-1774694238387.jpg not downloaded yet
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8495/20178495/interior_boot-1774713155320.jpeg> (referer: None)
2026-03-29 20:15:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dc55910>
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b95a642-2f31-520d-9774-c0007ed89972/2b95a642-2f31-520d-9774-c0007ed89972_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0569%252F16030569%252Finstrument_cluster-1774607643424.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0569/16030569/instrument_cluster-1774607643424.jpg saved to cache
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b95a642-2f31-520d-9774-c0007ed89972
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2f4bb990>
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f5f2ac-5511-5533-8bb0-82b3fcf9455f/a4f5f2ac-5511-5533-8bb0-82b3fcf9455f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8495%252F20178495%252Fexterior_front_passenger-1774713581388.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8495/20178495/exterior_front_passenger-1774713581388.jpeg saved to cache
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4f5f2ac-5511-5533-8bb0-82b3fcf9455f
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7a6810>
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d37151f-4f42-5934-b4b7-b0a2489843ea/6d37151f-4f42-5934-b4b7-b0a2489843ea_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1163%252F4051163%252Fexterior_front_driver-1771951821482.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1163/4051163/exterior_front_driver-1771951821482.jpg saved to cache
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d37151f-4f42-5934-b4b7-b0a2489843ea
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9441%252F7629441%252F7629441-instrument_cluster-default-1774531470760.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-instrument_cluster-default-1774531470760.jpg not downloaded yet
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20464032%252Finstrument_cluster-1774694180559.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20464032/instrument_cluster-1774694180559.jpg not downloaded yet
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9441%252F7629441%252F7629441-interior_boot-modified-1774692316716.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9441/7629441/7629441-interior_boot-modified-1774692316716.jpeg not downloaded yet
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4032%252F20464032%252Finterior_boot-1774710823320.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4032/20464032/interior_boot-1774710823320.jpg not downloaded yet
2026-03-29 20:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1163/4051163/exterior_front_passenger-1771951859707.jpg> (referer: None)
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9441%252F7629441%252F7629441-docs_service_history-default-1774531553383.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2bcfc8c5f762697fa5074c6f1c51ada0%27 HTTP/1.1" 200 None
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9441/7629441/7629441-docs_service_history-default-1774531553383.jpg?ixlib=js-3.8.0&auto=format&s=2bcfc8c5f762697fa5074c6f1c51ada0 not downloaded yet
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4032%252F20464032%252Fdocs_service_history-1774695284957.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddeadff69e2c0c35c9dfc2e2ce66146ab%27 HTTP/1.1" 200 None
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4032/20464032/docs_service_history-1774695284957.jpg?ixlib=js-3.8.0&auto=format&s=deadff69e2c0c35c9dfc2e2ce66146ab not downloaded yet
2026-03-29 20:15:09 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:09 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:15:09 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x05i\xf9\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x9f\x8d\x00\x05W\x13\x00\x00\x00\x00'
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2cebff90>
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a99fbd6-f126-5bf6-9cb7-836d87bd1f98/0a99fbd6-f126-5bf6-9cb7-836d87bd1f98_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9117%252F19989117%252Finstrument_cluster-1774771792753.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9117/19989117/instrument_cluster-1774771792753.jpg saved to cache
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a99fbd6-f126-5bf6-9cb7-836d87bd1f98
2026-03-29 20:15:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d973c50>
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b95a642-2f31-520d-9774-c0007ed89972/2b95a642-2f31-520d-9774-c0007ed89972_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0569%252F16030569%252Finterior_boot-1774607648577.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0569/16030569/interior_boot-1774607648577.jpg saved to cache
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b95a642-2f31-520d-9774-c0007ed89972
2026-03-29 20:15:09 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:09 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:15:09 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xaf\xc9\x02\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\t\x00w\x00\xaf\xber\x00\x00\x00\x00'
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e100c50>
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f5f2ac-5511-5533-8bb0-82b3fcf9455f/a4f5f2ac-5511-5533-8bb0-82b3fcf9455f_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8495%252F20178495%252Finterior_boot-1774713155320.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8495/20178495/interior_boot-1774713155320.jpeg saved to cache
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a4f5f2ac-5511-5533-8bb0-82b3fcf9455f
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d892610>
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d37151f-4f42-5934-b4b7-b0a2489843ea/6d37151f-4f42-5934-b4b7-b0a2489843ea_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1163%252F4051163%252Fexterior_front_passenger-1771951859707.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1163/4051163/exterior_front_passenger-1771951859707.jpg saved to cache
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d37151f-4f42-5934-b4b7-b0a2489843ea
2026-03-29 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8495/20178495/instrument_cluster-1774713244901.jpeg> (referer: None)
2026-03-29 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8495/20178495/interior_dashboard-1774713154303.jpeg> (referer: None)
2026-03-29 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_front_driver-1774693516632.jpg> (referer: None)
2026-03-29 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1163/4051163/interior_boot-1771952116848.jpg> (referer: None)
2026-03-29 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9117/19989117/interior_rear_seats-1774626171467.jpg> (referer: None)
2026-03-29 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9117/19989117/interior_front_seats-1774626157823.jpg> (referer: None)
2026-03-29 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8495/20178495/interior_rear_seats-1774713173085.jpeg> (referer: None)
2026-03-29 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8495/20178495/interior_front_seats-1774713124591.jpeg> (referer: None)
2026-03-29 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4032/20464032/interior_boot-1774710823320.jpg> (referer: None)
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xc0\x11\x89\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06\x19\xd3\x00\xc0\x06\xf9\x00\x00\x00\x00'
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d891f50>
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f5f2ac-5511-5533-8bb0-82b3fcf9455f/a4f5f2ac-5511-5533-8bb0-82b3fcf9455f_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8495%252F20178495%252Finstrument_cluster-1774713244901.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8495/20178495/instrument_cluster-1774713244901.jpeg saved to cache
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4f5f2ac-5511-5533-8bb0-82b3fcf9455f
2026-03-29 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/6326009.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xca[\x0f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\tEx\x00\xcaP\x7f\x00\x00\x00\x00'
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d473f10>
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f5f2ac-5511-5533-8bb0-82b3fcf9455f/a4f5f2ac-5511-5533-8bb0-82b3fcf9455f_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8495%252F20178495%252Finterior_dashboard-1774713154303.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8495/20178495/interior_dashboard-1774713154303.jpeg saved to cache
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4f5f2ac-5511-5533-8bb0-82b3fcf9455f
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2ddbce50>
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20464032%252Fexterior_front_driver-1774693516632.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_front_driver-1774693516632.jpg saved to cache
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 476dd998-a5df-551f-98cc-22a675a72032
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d58c610>
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d37151f-4f42-5934-b4b7-b0a2489843ea/6d37151f-4f42-5934-b4b7-b0a2489843ea_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1163%252F4051163%252Finterior_boot-1771952116848.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1163/4051163/interior_boot-1771952116848.jpg saved to cache
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d37151f-4f42-5934-b4b7-b0a2489843ea
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0f8a50>
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a99fbd6-f126-5bf6-9cb7-836d87bd1f98/0a99fbd6-f126-5bf6-9cb7-836d87bd1f98_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9117%252F19989117%252Finterior_rear_seats-1774626171467.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9117/19989117/interior_rear_seats-1774626171467.jpg saved to cache
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a99fbd6-f126-5bf6-9cb7-836d87bd1f98
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6ee0d0>
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a99fbd6-f126-5bf6-9cb7-836d87bd1f98/0a99fbd6-f126-5bf6-9cb7-836d87bd1f98_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9117%252F19989117%252Finterior_front_seats-1774626157823.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9117/19989117/interior_front_seats-1774626157823.jpg saved to cache
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a99fbd6-f126-5bf6-9cb7-836d87bd1f98
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xe1f\xbd\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xdc\x89\x00\xe1\\-\x00\x00\x00\x00'
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d108cd0>
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f5f2ac-5511-5533-8bb0-82b3fcf9455f/a4f5f2ac-5511-5533-8bb0-82b3fcf9455f_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8495%252F20178495%252Finterior_rear_seats-1774713173085.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8495/20178495/interior_rear_seats-1774713173085.jpeg saved to cache
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4f5f2ac-5511-5533-8bb0-82b3fcf9455f
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xee2"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x0bB\x9c\x00\xee\'\x92\x00\x00\x00\x00'
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0f8810>
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f5f2ac-5511-5533-8bb0-82b3fcf9455f/a4f5f2ac-5511-5533-8bb0-82b3fcf9455f_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8495%252F20178495%252Finterior_front_seats-1774713124591.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8495/20178495/interior_front_seats-1774713124591.jpeg saved to cache
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4f5f2ac-5511-5533-8bb0-82b3fcf9455f
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c6ec050>
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4032%252F20464032%252Finterior_boot-1774710823320.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4032/20464032/interior_boot-1774710823320.jpg saved to cache
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 476dd998-a5df-551f-98cc-22a675a72032
2026-03-29 20:15:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4ec1ab8-0125-5505-99a8-e9ad51b9f436 with identifier: 6326009
2026-03-29 20:15:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4ec1ab8-0125-5505-99a8-e9ad51b9f436 with scrape type 2
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4ec1ab8-0125-5505-99a8-e9ad51b9f436 with scrape type 2
2026-03-29 20:15:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c4ec1ab8-0125-5505-99a8-e9ad51b9f436, identifier: 6326009
2026-03-29 20:15:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c4ec1ab8-0125-5505-99a8-e9ad51b9f436 with identifier: 6326009
2026-03-29 20:15:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c4ec1ab8-0125-5505-99a8-e9ad51b9f436 with identifier: 6326009
2026-03-29 20:15:12 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c4ec1ab8-0125-5505-99a8-e9ad51b9f436 with identifier: 6326009 to the API
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/6326009.json>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c4ec1ab8-0125-5505-99a8-e9ad51b9f436',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FX67 ZZG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/6326009',
'listing': 'auction',
'location': 'North East Lincolnshire Grimsby',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 82144,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 6000,
'price_includes_vat': False,
'registration_date': '2017-09-01',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Scirocco GT BlueMotion Tech TSI',
'transmission': 'manual',
'trim': 'GT BlueMotion Tech TSI',
'vin': 'WVWZZZ13ZHV009826',
'year': 2017}
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276326009%27 HTTP/1.1" 200 None
2026-03-29 20:15:12 [motorway.uk] INFO: Saving data for 6326009: {'auction_closing_time': 1774884600.0, 'created_time': 1774556629.766543, 'last_price_update_time': 1774815312.86561}
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='6326009') HTTP/1.1" 204 0
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4032/20464032/docs_service_history-1774695284957.jpg?ixlib=js-3.8.0&auto=format&s=deadff69e2c0c35c9dfc2e2ce66146ab> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4032/20464032/instrument_cluster-1774694180559.jpg> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9441/7629441/7629441-docs_service_history-default-1774531553383.jpg?ixlib=js-3.8.0&auto=format&s=2bcfc8c5f762697fa5074c6f1c51ada0> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4032/20464032/interior_dashboard-1774694238387.jpg> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-instrument_cluster-default-1774531470760.jpg> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4032/20464032/interior_rear_seats-1774694223652.jpg> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_front_passenger-1774693503921.jpg> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-exterior_rear_passenger-default-1774531386029.jpg> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_rear_driver-1774693506460.jpg> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_rear_passenger-1774693507699.jpg> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-exterior_front_passenger-default-1774531381115.jpg> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4032/20464032/interior_front_seats-1774694222795.jpg> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9441/7629441/7629441-interior_boot-modified-1774692316716.jpeg> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9441/7629441/7629441-interior_rear_seats-default-1774531351666.jpg> (referer: None)
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9441/7629441/7629441-interior_dashboard-modified-1774692306815.jpeg> (referer: None)
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c4c4750>
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4032%252F20464032%252Fdocs_service_history-1774695284957.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddeadff69e2c0c35c9dfc2e2ce66146ab') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4032/20464032/docs_service_history-1774695284957.jpg?ixlib=js-3.8.0&auto=format&s=deadff69e2c0c35c9dfc2e2ce66146ab saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 476dd998-a5df-551f-98cc-22a675a72032
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c4c6e90>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20464032%252Finstrument_cluster-1774694180559.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20464032/instrument_cluster-1774694180559.jpg saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 476dd998-a5df-551f-98cc-22a675a72032
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c68cd50>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6193654-b09e-586c-8783-6627265bfd2f/f6193654-b09e-586c-8783-6627265bfd2f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9441%252F7629441%252F7629441-docs_service_history-default-1774531553383.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2bcfc8c5f762697fa5074c6f1c51ada0') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9441/7629441/7629441-docs_service_history-default-1774531553383.jpg?ixlib=js-3.8.0&auto=format&s=2bcfc8c5f762697fa5074c6f1c51ada0 saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6193654-b09e-586c-8783-6627265bfd2f
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d0f9bd0>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20464032%252Finterior_dashboard-1774694238387.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20464032/interior_dashboard-1774694238387.jpg saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 476dd998-a5df-551f-98cc-22a675a72032
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c68fb10>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6193654-b09e-586c-8783-6627265bfd2f/f6193654-b09e-586c-8783-6627265bfd2f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9441%252F7629441%252F7629441-instrument_cluster-default-1774531470760.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-instrument_cluster-default-1774531470760.jpg saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6193654-b09e-586c-8783-6627265bfd2f
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c68ff50>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4032%252F20464032%252Finterior_rear_seats-1774694223652.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4032/20464032/interior_rear_seats-1774694223652.jpg saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 476dd998-a5df-551f-98cc-22a675a72032
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6271d0>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20464032%252Fexterior_front_passenger-1774693503921.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_front_passenger-1774693503921.jpg saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 476dd998-a5df-551f-98cc-22a675a72032
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d626350>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6193654-b09e-586c-8783-6627265bfd2f/f6193654-b09e-586c-8783-6627265bfd2f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9441%252F7629441%252F7629441-exterior_rear_passenger-default-1774531386029.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-exterior_rear_passenger-default-1774531386029.jpg saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6193654-b09e-586c-8783-6627265bfd2f
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2dcf8d90>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20464032%252Fexterior_rear_driver-1774693506460.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_rear_driver-1774693506460.jpg saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 476dd998-a5df-551f-98cc-22a675a72032
2026-03-29 20:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9117/19989117/damage_warning_lights-1774771648940.jpg> (referer: None)
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6329d0>
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20464032%252Fexterior_rear_passenger-1774693507699.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_rear_passenger-1774693507699.jpg saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 476dd998-a5df-551f-98cc-22a675a72032
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d5a7c90>
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6193654-b09e-586c-8783-6627265bfd2f/f6193654-b09e-586c-8783-6627265bfd2f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9441%252F7629441%252F7629441-exterior_front_passenger-default-1774531381115.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-exterior_front_passenger-default-1774531381115.jpg saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6193654-b09e-586c-8783-6627265bfd2f
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2e1a6190>
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4032%252F20464032%252Finterior_front_seats-1774694222795.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4032/20464032/interior_front_seats-1774694222795.jpg saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 476dd998-a5df-551f-98cc-22a675a72032
2026-03-29 20:15:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 476dd998-a5df-551f-98cc-22a675a72032, skipping ID generation
2026-03-29 20:15:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 476dd998-a5df-551f-98cc-22a675a72032 with scrape type 1
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 476dd998-a5df-551f-98cc-22a675a72032 sending to next pipeline
2026-03-29 20:15:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 476dd998-a5df-551f-98cc-22a675a72032, identifier: 20464032
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c717e10>
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6193654-b09e-586c-8783-6627265bfd2f/f6193654-b09e-586c-8783-6627265bfd2f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9441%252F7629441%252F7629441-interior_boot-modified-1774692316716.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9441/7629441/7629441-interior_boot-modified-1774692316716.jpeg saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6193654-b09e-586c-8783-6627265bfd2f
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7e4290>
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6193654-b09e-586c-8783-6627265bfd2f/f6193654-b09e-586c-8783-6627265bfd2f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9441%252F7629441%252F7629441-interior_rear_seats-default-1774531351666.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9441/7629441/7629441-interior_rear_seats-default-1774531351666.jpg saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6193654-b09e-586c-8783-6627265bfd2f
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d630950>
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6193654-b09e-586c-8783-6627265bfd2f/f6193654-b09e-586c-8783-6627265bfd2f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9441%252F7629441%252F7629441-interior_dashboard-modified-1774692306815.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9441/7629441/7629441-interior_dashboard-modified-1774692306815.jpeg saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6193654-b09e-586c-8783-6627265bfd2f
2026-03-29 20:15:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 476dd998-a5df-551f-98cc-22a675a72032 with identifier: 20464032
2026-03-29 20:15:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 476dd998-a5df-551f-98cc-22a675a72032 with identifier: 20464032
2026-03-29 20:15:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 476dd998-a5df-551f-98cc-22a675a72032 with identifier: 20464032 to the API
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4032/20464032/interior_front_seats-1774694222795.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '476dd998-a5df-551f-98cc-22a675a72032',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'OV12 AAZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20464032',
'listing': 'auction',
'location': 'Suffolk Ipswich',
'make': 'Mercedes',
'model': 'C Class',
'odometer': 97150,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2025329,
'Height': 2813,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_front_driver-1774693516632.jpg',
'Width': 3751},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1189061,
'Height': 2363,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_rear_driver-1774693506460.jpg',
'Width': 3151},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1095120,
'Height': 2244,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_front_passenger-1774693503921.jpg',
'Width': 2992},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1438124,
'Height': 2403,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4032/20464032/exterior_rear_passenger-1774693507699.jpg',
'Width': 3204},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1771884,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4032/20464032/interior_front_seats-1774694222795.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1028382,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4032/20464032/interior_rear_seats-1774694223652.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1510695,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4032/20464032/interior_dashboard-1774694238387.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1252986,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4032/20464032/instrument_cluster-1774694180559.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 491522,
'Height': 1729,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4032/20464032/interior_boot-1774710823320.jpg',
'Width': 2305},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_476dd998-a5df-551f-98cc-22a675a72032/476dd998-a5df-551f-98cc-22a675a72032_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669675,
'Height': 1947,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4032/20464032/docs_service_history-1774695284957.jpg?ixlib=js-3.8.0&auto=format&s=deadff69e2c0c35c9dfc2e2ce66146ab',
'Width': 2597}],
'price': 3029,
'price_includes_vat': False,
'registration_date': '2012-03-27',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes C220 AMG Sport CDI BlueEFFICIENCY',
'transmission': 'automatic',
'trim': 'C220 AMG Sport CDI BlueEFFICIENCY',
'vin': 'WDD2043022F891333',
'year': 2012}
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720464032%27 HTTP/1.1" 200 None
2026-03-29 20:15:15 [motorway.uk] INFO: Saving data for 20464032: {'created_time': 1774815315.168953, 'last_price_update_time': 1774815315.168964, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20464032') HTTP/1.1" 204 0
2026-03-29 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9441/7629441/7629441-interior_front_seats-default-1774531356697.jpg> (referer: None)
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x05i\xf9\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x9f\x8d\x00\x05W\x13\x00\x00\x00\x00'
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c7e5010>
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a99fbd6-f126-5bf6-9cb7-836d87bd1f98/0a99fbd6-f126-5bf6-9cb7-836d87bd1f98_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9117%252F19989117%252Fdamage_warning_lights-1774771648940.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9117/19989117/damage_warning_lights-1774771648940.jpg saved to cache
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a99fbd6-f126-5bf6-9cb7-836d87bd1f98
2026-03-29 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-exterior_rear_driver-default-1774531385812.jpg> (referer: None)
2026-03-29 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-exterior_front_driver-default-1774531393166.jpg> (referer: None)
2026-03-29 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9117/19989117/interior_boot-1774626211339.jpg> (referer: None)
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d9e5890>
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6193654-b09e-586c-8783-6627265bfd2f/f6193654-b09e-586c-8783-6627265bfd2f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9441%252F7629441%252F7629441-interior_front_seats-default-1774531356697.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9441/7629441/7629441-interior_front_seats-default-1774531356697.jpg saved to cache
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6193654-b09e-586c-8783-6627265bfd2f
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2d6a0e10>
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6193654-b09e-586c-8783-6627265bfd2f/f6193654-b09e-586c-8783-6627265bfd2f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9441%252F7629441%252F7629441-exterior_rear_driver-default-1774531385812.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-exterior_rear_driver-default-1774531385812.jpg saved to cache
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6193654-b09e-586c-8783-6627265bfd2f
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f1f2c8c89d0>
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6193654-b09e-586c-8783-6627265bfd2f/f6193654-b09e-586c-8783-6627265bfd2f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9441%252F7629441%252F7629441-exterior_front_driver-default-1774531393166.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9441/7629441/7629441-exterior_front_driver-default-1774531393166.jpg saved to cache
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6193654-b09e-586c-8783-6627265bfd2f
2026-03-29 20:15:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6193654-b09e-586c-8783-6627265bfd2f, skipping ID generation
2026-03-29 20:15:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6193654-b09e-586c-8783-6627265bfd2f with scrape type 1
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6193654-b09e-586c-8783-6627265bfd2f sending to next pipeline
2026-03-29 20:15:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f6193654-b09e-586c-8783-6627265bfd2f, identifier: 7629441
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'